如何修复"module 'tensorflow' has no attribute 'estimator' "错误



我正在使用conda(通过YAML创建的环境)+ pip在我的Linux Mint盒子上设置Tensorflow v1.13.1环境。设置完成后,每当我尝试导入tf.estimator时,我都会收到标题中描述的AttributeError

AttributeError: module 'tensorflow' has no attribute 'estimator'
  • 我没有在 conda 环境(或 pip 上)安装任何版本的 TF。
  • 我确实有另一个以相同方式设置的 conda 环境,但使用 Tensorflow 2.0 alpha,它可以很好地导入tf.estimator
  • 我尝试删除环境并再次构建它
  • 我试过重新启动:(
  • 由于某种原因,我无法将 conda 更新到 4.6:
$ conda update -n base -c defaults conda
# >>>>>>>>>>>>>>>>>>>>>> ERROR REPORT <<<<<<<<<<<<<<<<<<<<<<
Traceback (most recent call last):
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/exceptions.py", line 819, in __call__
return func(*args, **kwargs)
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/cli/main.py", line 78, in _main
exit_code = do_call(args, p)
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/cli/conda_argparse.py", line 77, in do_call
exit_code = getattr(module, func_name)(args, parser)
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/cli/main_update.py", line 14, in execute
install(args, parser, 'update')
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/cli/install.py", line 253, in install
handle_txn(unlink_link_transaction, prefix, args, newenv)
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/cli/install.py", line 282, in handle_txn
unlink_link_transaction.execute()
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/core/link.py", line 223, in execute
self.verify()
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/common/io.py", line 46, in decorated
return f(*args, **kwds)
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/core/link.py", line 200, in verify
self.prepare()
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/core/link.py", line 192, in prepare
stp.remove_specs, stp.update_specs)
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/core/link.py", line 282, in _prepare
mkdir_p(transaction_context['temp_dir'])
File "/usr/share/anaconda3/lib/python3.7/site-packages/conda/gateways/disk/__init__.py", line 60, in mkdir_p
makedirs(path)
File "/usr/share/anaconda3/lib/python3.7/os.py", line 221, in makedirs
mkdir(name, mode)
PermissionError: [Errno 13] Permission denied: '/usr/share/anaconda3/.condatmp'

yml 文件如下所示:

dependencies:
- python
- numpy
- tensorflow
- cudatoolkit==9.0
...

从相关环境内部:

  • $ conda list tensorflow
# packages in environment at /home/cjs/.conda/envs/my-env:
# 
# Name                    Version                   Build  Channel
tensorflow                1.13.1          mkl_py37h54b294f_0
tensorflow-base           1.13.1          mkl_py37h7ce6ba3_0
tensorflow-estimator      1.13.0                     py_0
  • $ pip list | grep tensorflow
tensorflow                  1.13.1
tensorflow-estimator        1.13.0
  • $ which pip
/home/cjs/.conda/envs/my-env/bin/pip
  • $ conda --version
conda 4.5.11
  • $ pip --version
pip 19.0.3 from /home/cjs/.local/lib/python3.7/site-packages/pip (python 3.7)

下面是该问题的最小示例。如您所见,这仅在调用 tf.estimator 的地方发生,所有其他 Tensorflow 属性都按预期运行:

Python 3.7.3 (default, Mar 27 2019, 22:11:17)
[GCC 7.3.0] :: Anaconda, Inc. on linux
Type "help", "copyright", "credits" or "license" for more information.
>>> import tensorflow as tf
>>> tf.__version__
'1.13.1'
>>> tf.estimator
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
AttributeError: module 'tensorflow' has no attribute 'estimator'
>>> tf.estimator.Estimator()
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
AttributeError: module 'tensorflow' has no attribute 'estimator'
>>> from tensorflow import estimator
Traceback (most recent call last):
File "<stdin>", line 1, in <module>
ImportError: cannot import name 'estimator' from 'tensorflow' (/home/cjs/.conda/envs/my-env/lib/python3.7/site-packages/tensorflow/__init__.py)
>>> tf.Variable
<class 'tensorflow.python.ops.variables.VariableV1'>
>>> tf.keras
<module 'tensorflow._api.v1.keras' from '/home/cjs/.conda/envs/my-env/lib/python3.7/site-packages/tensorflow/_api/v1/keras/__init__.py'>
>>> tf.constant
<function constant_v1 at 0x7fb25ea24950>

更新

根据 https://docs.nvidia.com/deploy/cuda-compatibility/index.html#binary-compatibility__table-toolkit-driver,我能够弄清楚我的 nvidia 驱动程序和 cudatoolkit 版本不同步(390.46 与 9.0)。

我现在已经将我的 NVIDIA 驱动程序更新到 v418,并且能够将我的 conda 版本更新到 4.16.14。我将上面显示的环境.yml更新为cudatoolkit==10.1,但我似乎无法弄清楚如何实际安装它。

我的numba -s输出包括这一部分,这让我认为从一开始就存在整个问题是 cuda 找不到我的 GPU(或无法连接到它?

__CUDA Information__
Error: CUDA device intialisation problem. Message:Error at driver init:
[100] Call to cuInit results in CUDA_ERROR_NO_DEVICE:
Error class: <class 'numba.cuda.cudadrv.error.CudaSupportError'>

(分钟)更新

能够确定numba问题的原因是我在更新GPU驱动程序(duh)后没有重新启动。

不过,在这方面并没有完全摆脱困境。新问题如下:

__CUDA Information__
Found 1 CUDA devices
id 0          b'Quadro K620'                              [SUPPORTED]
compute capability: 5.0
pci device id: 0
pci bus id: 1
Summary:
1/1 devices are supported
CUDA driver version                 : 10010
CUDA libraries:
Finding cublas
ERROR: can't locate lib
Finding cusparse
ERROR: can't locate lib
Finding cufft
ERROR: can't locate lib
Finding curand
ERROR: can't locate lib
Finding nvvm
ERROR: can't locate lib
finding libdevice for compute_20...     ERROR: can't open libdevice for compute_20
finding libdevice for compute_30...     ERROR: can't open libdevice for compute_30
finding libdevice for compute_35...     ERROR: can't open libdevice for compute_35
finding libdevice for compute_50...     ERROR: can't open libdevice for compute_50

终于找到了问题。我仍然安装了一些本地(非Conda)Tensorflow软件包,我想这些软件包在python环境中的优先级更高。

此链接解决了我的问题: https://github.com/tensorflow/tensorboard/issues/2067

  • 卸载张量流,张量板
  • 每晚卸载 tb(如果已安装)
  • 使用"点冻结 |grep tensorflow"来检查是否已安装TensorFlow-Estimator包。如果是这样,请将其卸载。
  • 转到站点包并删除与 tensorflow、tensorboard、tensorflow-estimator 等相关的所有 tensorflow 文件夹
  • 重新安装最新版本的张量流和张量板

我问题的关键是站点包,可以在 BOTH 中找到

  • ~/.conda/envs/<my-env>/lib/python3.<xx>/site-packages
  • ~/.local/lib/python3.<xx>/site-packages

其中<my-env>是你的conda环境,<xx>是你的python版本。

只需rm -r <path to package>~/.local/库中的每个 tensorflow 包,然后重新安装 conda 环境即可。

只需卸载tensorflowtensorboardtensorflow-estimator并重新安装tensorflow即可。使用 1.14.0 版为我工作。

pip uninstall tensorflow tensorboard tensorflow-estimator
...
pip install tensorflow==1.14.0
  1. 卸载 tensorflow-estimator
  2. 使用 pip install tensorflow-estimator==(与您的 tf 版本 1.13.1 相同)重新安装它

完成:

我仍然安装了一些本地(非Conda)tensorflow包,这些包在python环境中的优先级更高

在你的

cd ~/.local
rm -r <tensorflow_package_libraries>

删除每个 TensorFlow 包库并重新安装 CONDA 环境。

最新更新