tensorflow : 'NoneType' object has no attribute 'update'

[Nqabz]

I tried running all your example on 8 Nvidia V100 however I get this error across all of them:

  File "/opt/conda/lib/python3.5/copy.py", line 182, in deepcopy
    y = _reconstruct(x, rv, 1, memo)
  File "/opt/conda/lib/python3.5/copy.py", line 297, in _reconstruct
    state = deepcopy(state, memo)
  File "/opt/conda/lib/python3.5/copy.py", line 155, in deepcopy
    y = copier(x, memo)
  File "/opt/conda/lib/python3.5/copy.py", line 243, in _deepcopy_dict
    y[deepcopy(key, memo)] = deepcopy(value, memo)
  File "/opt/conda/lib/python3.5/copy.py", line 182, in deepcopy
    y = _reconstruct(x, rv, 1, memo)
  File "/opt/conda/lib/python3.5/copy.py", line 306, in _reconstruct
    y.__dict__.update(state)
AttributeError: 'NoneType' object has no attribute 'update'

This is in a docker environment with the following versions:
**

• Tensorflow 1.4.0
• Keras 2.1.2
• Python 3.5.4
• CUDA 9.0

**
Could this be version compatibility or GPU device compatibility? Thanks for any pointers.

[DNXie]

keras-team/keras#8649

[cagbal]

Same issue here!

Tensorflow 1.4.1
Keras 2.1.5
Python 3.5.5
CUDA 8.0

[bzamecnik]

This issue also appears to me when I have two models sharing layers - one for prediction, one for training (with CTC loss and auxiliary inputs). ModelCheckpoint is saving from the training model.