awslabs/gluonts

mxnet version is not compatible with jupyter notebook in Ananconda

300LiterPropofol opened this issue · 1 comments

Description

The pip install "gluonts[mxnet]" command does not work together with notebook package, if installed in Anaconda gluonts[mxnet], you can not use jupyter notebook since there is compatibility issue

To Reproduce

In anaconda prompt admin mode, create an independent environment, conda install conda-forge::notebook can not be successfully installed together with pip install "gluonts[mxnet]" , regardless of order, the later one will fail.

Error message or code output

(Paste the complete error message, including stack trace, or the undesired output that the above snippet produces.)

If install jupyter notebook first, there seems to be pandas version issue.

(mxnet_only_py310) C:\Windows\System32>pip install "gluonts[mxnet]"
Collecting gluonts[mxnet]
  Using cached gluonts-0.14.3-py3-none-any.whl.metadata (9.5 kB)
Collecting numpy~=1.16 (from gluonts[mxnet])
  Downloading numpy-1.26.3-cp310-cp310-win_amd64.whl.metadata (61 kB)
     ---------------------------------------- 61.2/61.2 kB 822.1 kB/s eta 0:00:00
Collecting pandas<3,>=1.0 (from gluonts[mxnet])
  Downloading pandas-2.1.4-cp310-cp310-win_amd64.whl.metadata (18 kB)
Collecting pydantic<3,>=1.7 (from gluonts[mxnet])
  Using cached pydantic-2.5.3-py3-none-any.whl.metadata (65 kB)
Collecting tqdm~=4.23 (from gluonts[mxnet])
  Using cached tqdm-4.66.1-py3-none-any.whl.metadata (57 kB)
Collecting toolz~=0.10 (from gluonts[mxnet])
  Using cached toolz-0.12.0-py3-none-any.whl (55 kB)
Requirement already satisfied: typing-extensions~=4.0 in c:\programdata\anaconda3\envs\mxnet_only_py310\lib\site-packages (from gluonts[mxnet]) (4.7.1)
Collecting numpy~=1.16 (from gluonts[mxnet])
  Downloading numpy-1.23.5-cp310-cp310-win_amd64.whl (14.6 MB)
     ---------------------------------------- 14.6/14.6 MB 4.4 MB/s eta 0:00:00
Collecting mxnet~=1.7 (from gluonts[mxnet])
  Using cached mxnet-1.7.0.post2-py2.py3-none-win_amd64.whl (33.1 MB)
Collecting numpy~=1.16 (from gluonts[mxnet])
  Using cached numpy-1.16.6.zip (5.1 MB)
  Preparing metadata (setup.py) ... done
Collecting requests<2.19.0,>=2.18.4 (from mxnet~=1.7->gluonts[mxnet])
  Using cached requests-2.18.4-py2.py3-none-any.whl (88 kB)
Collecting graphviz<0.9.0,>=0.8.1 (from mxnet~=1.7->gluonts[mxnet])
  Using cached graphviz-0.8.4-py2.py3-none-any.whl (16 kB)
INFO: pip is looking at multiple versions of pandas to determine which version is compatible with other requirements. This could take a while.
Collecting pandas<3,>=1.0 (from gluonts[mxnet])
  Downloading pandas-2.1.3-cp310-cp310-win_amd64.whl.metadata (18 kB)
  Downloading pandas-2.1.2-cp310-cp310-win_amd64.whl.metadata (18 kB)
  Downloading pandas-2.1.1-cp310-cp310-win_amd64.whl.metadata (18 kB)
  Downloading pandas-2.1.0-cp310-cp310-win_amd64.whl.metadata (18 kB)
  Downloading pandas-2.0.3-cp310-cp310-win_amd64.whl.metadata (18 kB)
Requirement already satisfied: python-dateutil>=2.8.2 in c:\programdata\anaconda3\envs\mxnet_only_py310\lib\site-packages (from pandas<3,>=1.0->gluonts[mxnet]) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in c:\programdata\anaconda3\envs\mxnet_only_py310\lib\site-packages (from pandas<3,>=1.0->gluonts[mxnet]) (2023.3.post1)
Collecting tzdata>=2022.1 (from pandas<3,>=1.0->gluonts[mxnet])
  Using cached tzdata-2023.4-py2.py3-none-any.whl.metadata (1.4 kB)
Collecting pandas<3,>=1.0 (from gluonts[mxnet])
  Downloading pandas-2.0.2-cp310-cp310-win_amd64.whl.metadata (18 kB)
  Downloading pandas-2.0.1-cp310-cp310-win_amd64.whl (10.7 MB)
     ---------------------------------------- 10.7/10.7 MB 4.2 MB/s eta 0:00:00
INFO: pip is still looking at multiple versions of pandas to determine which version is compatible with other requirements. This could take a while.
  Downloading pandas-2.0.0-cp310-cp310-win_amd64.whl (11.2 MB)
     ---------------------------------------- 11.2/11.2 MB 4.2 MB/s eta 0:00:00
  Downloading pandas-1.5.3-cp310-cp310-win_amd64.whl (10.4 MB)
     ---------------------------------------- 10.4/10.4 MB 4.8 MB/s eta 0:00:00
  Downloading pandas-1.5.2-cp310-cp310-win_amd64.whl (10.4 MB)
     ---------------------------------------- 10.4/10.4 MB 4.2 MB/s eta 0:00:00
  Downloading pandas-1.5.1-cp310-cp310-win_amd64.whl (10.4 MB)
     ---------------------------------------- 10.4/10.4 MB 5.5 MB/s eta 0:00:00
  Downloading pandas-1.5.0-cp310-cp310-win_amd64.whl (10.4 MB)
     ---------------------------------------- 10.4/10.4 MB 6.1 MB/s eta 0:00:00
INFO: This is taking longer than usual. You might need to provide the dependency resolver with stricter constraints to reduce runtime. See https://pip.pypa.io/warnings/backtracking for guidance. If you want to abort this run, press Ctrl + C.
  Downloading pandas-1.4.4-cp310-cp310-win_amd64.whl (10.0 MB)
     ---------------------------------------- 10.0/10.0 MB 5.9 MB/s eta 0:00:00
  Downloading pandas-1.4.3-cp310-cp310-win_amd64.whl (10.5 MB)
     ---------------------------------------- 10.5/10.5 MB 5.0 MB/s eta 0:00:00
  Downloading pandas-1.4.2-cp310-cp310-win_amd64.whl (10.6 MB)
     ---------------------------------------- 10.6/10.6 MB 5.8 MB/s eta 0:00:00
  Downloading pandas-1.4.1-cp310-cp310-win_amd64.whl (10.6 MB)
     ---------------------------------------- 10.6/10.6 MB 5.8 MB/s eta 0:00:00
  Downloading pandas-1.4.0-cp310-cp310-win_amd64.whl (10.6 MB)
     ---------------------------------------- 10.6/10.6 MB 4.2 MB/s eta 0:00:00
  Downloading pandas-1.3.5-cp310-cp310-win_amd64.whl (10.2 MB)
     ---------------------------------------- 10.2/10.2 MB 4.7 MB/s eta 0:00:00
  Downloading pandas-1.3.4-cp310-cp310-win_amd64.whl (10.2 MB)
     ---------------------------------------- 10.2/10.2 MB 4.7 MB/s eta 0:00:00
  Using cached pandas-1.3.3.tar.gz (4.7 MB)
  Installing build dependencies ... error
  error: subprocess-exited-with-error

  × pip subprocess to install build dependencies did not run successfully.
  │ exit code: 1
  ╰─> [245 lines of output]
      Ignoring numpy: markers 'python_version == "3.7" and (platform_machine != "arm64" or platform_system != "Darwin") and platform_machine != "aarch64"' don't match your environment
      Ignoring numpy: markers 'python_version == "3.8" and (platform_machine != "arm64" or platform_system != "Darwin") and platform_machine != "aarch64"' don't match your environment
      Ignoring numpy: markers 'python_version == "3.7" and platform_machine == "aarch64"' don't match your environment
      Ignoring numpy: markers 'python_version == "3.8" and platform_machine == "aarch64"' don't match your environment
      Ignoring numpy: markers 'python_version == "3.8" and platform_machine == "arm64" and platform_system == "Darwin"' don't match your environment
      Ignoring numpy: markers 'python_version == "3.9" and platform_machine == "arm64" and platform_system == "Darwin"' don't match your environment
      Collecting setuptools>=51.0.0
        Using cached setuptools-69.0.3-py3-none-any.whl.metadata (6.3 kB)
      Collecting wheel
        Using cached wheel-0.42.0-py3-none-any.whl.metadata (2.2 kB)
      Collecting Cython<3,>=0.29.21
        Using cached Cython-0.29.37-py2.py3-none-any.whl.metadata (3.1 kB)
      Collecting numpy==1.19.3
        Using cached numpy-1.19.3.zip (7.3 MB)
        Installing build dependencies: started
        Installing build dependencies: finished with status 'done'
        Getting requirements to build wheel: started
        Getting requirements to build wheel: finished with status 'done'
        Preparing metadata (pyproject.toml): started
        Preparing metadata (pyproject.toml): finished with status 'error'
        error: subprocess-exited-with-error

        × Preparing metadata (pyproject.toml) did not run successfully.
        │ exit code: 1
        ╰─> [210 lines of output]
            setup.py:67: RuntimeWarning: NumPy 1.19.3 may not yet support Python 3.10.
              warnings.warn(
            Running from numpy source directory.
            setup.py:480: UserWarning: Unrecognized setuptools command, proceeding with generating Cython sources and expanding templates
              run_build = parse_setuppy_commands()
            Processing numpy/random\_bounded_integers.pxd.in
            Processing numpy/random\bit_generator.pyx
            Processing numpy/random\mtrand.pyx
            Processing numpy/random\_bounded_integers.pyx.in
            Processing numpy/random\_common.pyx
            Processing numpy/random\_generator.pyx
            Processing numpy/random\_mt19937.pyx
            Processing numpy/random\_pcg64.pyx
            Processing numpy/random\_philox.pyx
            Processing numpy/random\_sfc64.pyx
            Cythonizing sources
            blas_opt_info:
            blas_mkl_info:
            No module named 'numpy.distutils._msvccompiler' in numpy.distutils; trying from distutils
            customize MSVCCompiler
              libraries mkl_rt not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            blis_info:
              libraries blis not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            openblas_info:
              libraries openblas not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
            get_default_fcompiler: matching types: '['gnu', 'intelv', 'absoft', 'compaqv', 'intelev', 'gnu95', 'g95', 'intelvem', 'intelem', 'flang']'
            customize GnuFCompiler
            Could not locate executable g77
            Could not locate executable f77
            customize IntelVisualFCompiler
            Could not locate executable ifort
            Could not locate executable ifl
            customize AbsoftFCompiler
            Could not locate executable f90
            customize CompaqVisualFCompiler
            Could not locate executable DF
            customize IntelItaniumVisualFCompiler
            Could not locate executable efl
            customize Gnu95FCompiler
            Could not locate executable gfortran
            Could not locate executable f95
            customize G95FCompiler
            Could not locate executable g95
            customize IntelEM64VisualFCompiler
            customize IntelEM64TFCompiler
            Could not locate executable efort
            Could not locate executable efc
            customize PGroupFlangCompiler
            Could not locate executable flang
            don't know how to compile Fortran code on platform 'nt'
              NOT AVAILABLE

            atlas_3_10_blas_threads_info:
            Setting PTATLAS=ATLAS
              libraries tatlas not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            atlas_3_10_blas_info:
              libraries satlas not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            atlas_blas_threads_info:
            Setting PTATLAS=ATLAS
              libraries ptf77blas,ptcblas,atlas not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            atlas_blas_info:
              libraries f77blas,cblas,atlas not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            accelerate_info:
              NOT AVAILABLE

            C:\Users\xxx\AppData\Local\Temp\pip-install-ggdt1h7z\numpy_15be062fb46f4012bfec1eaf17f49458\numpy\distutils\system_info.py:1914: UserWarning:
                Optimized (vendor) Blas libraries are not found.
                Falls back to netlib Blas library which has worse performance.
                A better performance should be easily gained by switching
                Blas library.
              if self._calc_info(blas):
            blas_info:
              libraries blas not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            C:\Users\xxx\AppData\Local\Temp\pip-install-ggdt1h7z\numpy_15be062fb46f4012bfec1eaf17f49458\numpy\distutils\system_info.py:1914: UserWarning:
                Blas (http://www.netlib.org/blas/) libraries not found.
                Directories to search for the libraries can be specified in the
                numpy/distutils/site.cfg file (section [blas]) or by setting
                the BLAS environment variable.
              if self._calc_info(blas):
            blas_src_info:
              NOT AVAILABLE

            C:\Users\xxx\AppData\Local\Temp\pip-install-ggdt1h7z\numpy_15be062fb46f4012bfec1eaf17f49458\numpy\distutils\system_info.py:1914: UserWarning:
                Blas (http://www.netlib.org/blas/) sources not found.
                Directories to search for the sources can be specified in the
                numpy/distutils/site.cfg file (section [blas_src]) or by setting
                the BLAS_SRC environment variable.
              if self._calc_info(blas):
              NOT AVAILABLE

            non-existing path in 'numpy\\distutils': 'site.cfg'
            lapack_opt_info:
            lapack_mkl_info:
              libraries mkl_rt not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            openblas_lapack_info:
              libraries openblas not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            openblas_clapack_info:
              libraries openblas,lapack not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            flame_info:
              libraries flame not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            atlas_3_10_threads_info:
            Setting PTATLAS=ATLAS
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\lib
              libraries tatlas,tatlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\lib
              libraries lapack_atlas not found in C:\
              libraries tatlas,tatlas not found in C:\
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\libs
              libraries tatlas,tatlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\libs
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\Library\lib
              libraries tatlas,tatlas not found in C:\ProgramData\anaconda3\Library\lib
            <class 'numpy.distutils.system_info.atlas_3_10_threads_info'>
              NOT AVAILABLE

            atlas_3_10_info:
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\lib
              libraries satlas,satlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\lib
              libraries lapack_atlas not found in C:\
              libraries satlas,satlas not found in C:\
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\libs
              libraries satlas,satlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\libs
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\Library\lib
              libraries satlas,satlas not found in C:\ProgramData\anaconda3\Library\lib
            <class 'numpy.distutils.system_info.atlas_3_10_info'>
              NOT AVAILABLE

            atlas_threads_info:
            Setting PTATLAS=ATLAS
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\lib
              libraries ptf77blas,ptcblas,atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\lib
              libraries lapack_atlas not found in C:\
              libraries ptf77blas,ptcblas,atlas not found in C:\
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\libs
              libraries ptf77blas,ptcblas,atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\libs
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\Library\lib
              libraries ptf77blas,ptcblas,atlas not found in C:\ProgramData\anaconda3\Library\lib
            <class 'numpy.distutils.system_info.atlas_threads_info'>
              NOT AVAILABLE

            atlas_info:
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\lib
              libraries f77blas,cblas,atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\lib
              libraries lapack_atlas not found in C:\
              libraries f77blas,cblas,atlas not found in C:\
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\libs
              libraries f77blas,cblas,atlas not found in C:\ProgramData\anaconda3\envs\mxnet_only_py310\libs
              libraries lapack_atlas not found in C:\ProgramData\anaconda3\Library\lib
              libraries f77blas,cblas,atlas not found in C:\ProgramData\anaconda3\Library\lib
            <class 'numpy.distutils.system_info.atlas_info'>
              NOT AVAILABLE

            lapack_info:
              libraries lapack not found in ['C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\lib', 'C:\\', 'C:\\ProgramData\\anaconda3\\envs\\mxnet_only_py310\\libs', 'C:\\ProgramData\\anaconda3\\Library\\lib']
              NOT AVAILABLE

            C:\Users\xxx\AppData\Local\Temp\pip-install-ggdt1h7z\numpy_15be062fb46f4012bfec1eaf17f49458\numpy\distutils\system_info.py:1748: UserWarning:
                Lapack (http://www.netlib.org/lapack/) libraries not found.
                Directories to search for the libraries can be specified in the
                numpy/distutils/site.cfg file (section [lapack]) or by setting
                the LAPACK environment variable.
              return getattr(self, '_calc_info_{}'.format(name))()
            lapack_src_info:
              NOT AVAILABLE

            C:\Users\xxx\AppData\Local\Temp\pip-install-ggdt1h7z\numpy_15be062fb46f4012bfec1eaf17f49458\numpy\distutils\system_info.py:1748: UserWarning:
                Lapack (http://www.netlib.org/lapack/) sources not found.
                Directories to search for the sources can be specified in the
                numpy/distutils/site.cfg file (section [lapack_src]) or by setting
                the LAPACK_SRC environment variable.
              return getattr(self, '_calc_info_{}'.format(name))()
              NOT AVAILABLE

            numpy_linalg_lapack_lite:
              FOUND:
                language = c
                define_macros = [('HAVE_BLAS_ILP64', None), ('BLAS_SYMBOL_SUFFIX', '64_')]

            C:\Users\xxx\AppData\Local\Temp\pip-build-env-izli8_9p\overlay\Lib\site-packages\setuptools\_distutils\dist.py:275: UserWarning: Unknown distribution option: 'define_macros'
              warnings.warn(msg)
            running dist_info
            running build_src
            build_src
            building py_modules sources
            creating build
            creating build\src.win-amd64-3.10
            creating build\src.win-amd64-3.10\numpy
            creating build\src.win-amd64-3.10\numpy\distutils
            building library "npymath" sources
            error: Microsoft Visual C++ 14.0 is required. Get it with "Build Tools for Visual Studio": https://visualstudio.microsoft.com/downloads/
            [end of output]

        note: This error originates from a subprocess, and is likely not a problem with pip.
      error: metadata-generation-failed

      × Encountered error while generating package metadata.
      ╰─> See above for output.

      note: This is an issue with the package mentioned above, not pip.
      hint: See above for details.
      [end of output]

  note: This error originates from a subprocess, and is likely not a problem with pip.
error: subprocess-exited-with-error

× pip subprocess to install build dependencies did not run successfully.
│ exit code: 1
╰─> See above for output.

note: This error originates from a subprocess, and is likely not a problem with pip.

If install gluonts[mxnet] first, notebook can not be installed, regardless through anaconda prompt admin or anaconda navigator UI

Environment

  • Operating system: Anaconda
  • Python version: 3.6, 3.7, 3.9, 3.10, 3.11, none of them works
  • GluonTS version: automatic version through pip install "gluonts[mxnet]"
  • MXNet version: automatic version through pip install "gluonts[mxnet]"