baseline example not working

[anthony-intel]

This is with

!pip install neural-speed
!pip install intel-extension-for-transformers

Yes - accelerate is not installed - but the baseline example should work "out of the box"

Collecting intel-extension-for-transformers
  Downloading intel_extension_for_transformers-1.3.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (44.2 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 44.2/44.2 MB 13.4 MB/s eta 0:00:00
Requirement already satisfied: packaging in /usr/local/lib/python3.10/dist-packages (from intel-extension-for-transformers) (24.0)
Requirement already satisfied: numpy in /usr/local/lib/python3.10/dist-packages (from intel-extension-for-transformers) (1.25.2)
Collecting schema (from intel-extension-for-transformers)
  Downloading schema-0.7.5-py2.py3-none-any.whl (17 kB)
Requirement already satisfied: pyyaml in /usr/local/lib/python3.10/dist-packages (from intel-extension-for-transformers) (6.0.1)
Collecting neural-compressor (from intel-extension-for-transformers)
  Downloading neural_compressor-2.5-py3-none-any.whl (1.5 MB)
     ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.5/1.5 MB 41.1 MB/s eta 0:00:00
Requirement already satisfied: transformers in /usr/local/lib/python3.10/dist-packages (from intel-extension-for-transformers) (4.38.2)
Collecting deprecated>=1.2.13 (from neural-compressor->intel-extension-for-transformers)
  Downloading Deprecated-1.2.14-py2.py3-none-any.whl (9.6 kB)
Requirement already satisfied: opencv-python-headless in /usr/local/lib/python3.10/dist-packages (from neural-compressor->intel-extension-for-transformers) (4.9.0.80)
Requirement already satisfied: pandas in /usr/local/lib/python3.10/dist-packages (from neural-compressor->intel-extension-for-transformers) (1.5.3)
Requirement already satisfied: Pillow in /usr/local/lib/python3.10/dist-packages (from neural-compressor->intel-extension-for-transformers) (9.4.0)
Requirement already satisfied: prettytable in /usr/local/lib/python3.10/dist-packages (from neural-compressor->intel-extension-for-transformers) (3.10.0)
Requirement already satisfied: psutil in /usr/local/lib/python3.10/dist-packages (from neural-compressor->intel-extension-for-transformers) (5.9.5)
Requirement already satisfied: py-cpuinfo in /usr/local/lib/python3.10/dist-packages (from neural-compressor->intel-extension-for-transformers) (9.0.0)
Requirement already satisfied: requests in /usr/local/lib/python3.10/dist-packages (from neural-compressor->intel-extension-for-transformers) (2.31.0)
Requirement already satisfied: scikit-learn in /usr/local/lib/python3.10/dist-packages (from neural-compressor->intel-extension-for-transformers) (1.2.2)
Requirement already satisfied: pycocotools in /usr/local/lib/python3.10/dist-packages (from neural-compressor->intel-extension-for-transformers) (2.0.7)
Requirement already satisfied: contextlib2>=0.5.5 in /usr/local/lib/python3.10/dist-packages (from schema->intel-extension-for-transformers) (21.6.0)
Requirement already satisfied: filelock in /usr/local/lib/python3.10/dist-packages (from transformers->intel-extension-for-transformers) (3.13.1)
Requirement already satisfied: huggingface-hub<1.0,>=0.19.3 in /usr/local/lib/python3.10/dist-packages (from transformers->intel-extension-for-transformers) (0.20.3)
Requirement already satisfied: regex!=2019.12.17 in /usr/local/lib/python3.10/dist-packages (from transformers->intel-extension-for-transformers) (2023.12.25)
Requirement already satisfied: tokenizers<0.19,>=0.14 in /usr/local/lib/python3.10/dist-packages (from transformers->intel-extension-for-transformers) (0.15.2)
Requirement already satisfied: safetensors>=0.4.1 in /usr/local/lib/python3.10/dist-packages (from transformers->intel-extension-for-transformers) (0.4.2)
Requirement already satisfied: tqdm>=4.27 in /usr/local/lib/python3.10/dist-packages (from transformers->intel-extension-for-transformers) (4.66.2)
Requirement already satisfied: wrapt<2,>=1.10 in /usr/local/lib/python3.10/dist-packages (from deprecated>=1.2.13->neural-compressor->intel-extension-for-transformers) (1.14.1)
Requirement already satisfied: fsspec>=2023.5.0 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.19.3->transformers->intel-extension-for-transformers) (2023.6.0)
Requirement already satisfied: typing-extensions>=3.7.4.3 in /usr/local/lib/python3.10/dist-packages (from huggingface-hub<1.0,>=0.19.3->transformers->intel-extension-for-transformers) (4.10.0)
Requirement already satisfied: python-dateutil>=2.8.1 in /usr/local/lib/python3.10/dist-packages (from pandas->neural-compressor->intel-extension-for-transformers) (2.8.2)
Requirement already satisfied: pytz>=2020.1 in /usr/local/lib/python3.10/dist-packages (from pandas->neural-compressor->intel-extension-for-transformers) (2023.4)
Requirement already satisfied: wcwidth in /usr/local/lib/python3.10/dist-packages (from prettytable->neural-compressor->intel-extension-for-transformers) (0.2.13)
Requirement already satisfied: matplotlib>=2.1.0 in /usr/local/lib/python3.10/dist-packages (from pycocotools->neural-compressor->intel-extension-for-transformers) (3.7.1)
Requirement already satisfied: charset-normalizer<4,>=2 in /usr/local/lib/python3.10/dist-packages (from requests->neural-compressor->intel-extension-for-transformers) (3.3.2)
Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.10/dist-packages (from requests->neural-compressor->intel-extension-for-transformers) (3.6)
Requirement already satisfied: urllib3<3,>=1.21.1 in /usr/local/lib/python3.10/dist-packages (from requests->neural-compressor->intel-extension-for-transformers) (2.0.7)
Requirement already satisfied: certifi>=2017.4.17 in /usr/local/lib/python3.10/dist-packages (from requests->neural-compressor->intel-extension-for-transformers) (2024.2.2)
Requirement already satisfied: scipy>=1.3.2 in /usr/local/lib/python3.10/dist-packages (from scikit-learn->neural-compressor->intel-extension-for-transformers) (1.11.4)
Requirement already satisfied: joblib>=1.1.1 in /usr/local/lib/python3.10/dist-packages (from scikit-learn->neural-compressor->intel-extension-for-transformers) (1.3.2)
Requirement already satisfied: threadpoolctl>=2.0.0 in /usr/local/lib/python3.10/dist-packages (from scikit-learn->neural-compressor->intel-extension-for-transformers) (3.3.0)
Requirement already satisfied: contourpy>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib>=2.1.0->pycocotools->neural-compressor->intel-extension-for-transformers) (1.2.0)
Requirement already satisfied: cycler>=0.10 in /usr/local/lib/python3.10/dist-packages (from matplotlib>=2.1.0->pycocotools->neural-compressor->intel-extension-for-transformers) (0.12.1)
Requirement already satisfied: fonttools>=4.22.0 in /usr/local/lib/python3.10/dist-packages (from matplotlib>=2.1.0->pycocotools->neural-compressor->intel-extension-for-transformers) (4.50.0)
Requirement already satisfied: kiwisolver>=1.0.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib>=2.1.0->pycocotools->neural-compressor->intel-extension-for-transformers) (1.4.5)
Requirement already satisfied: pyparsing>=2.3.1 in /usr/local/lib/python3.10/dist-packages (from matplotlib>=2.1.0->pycocotools->neural-compressor->intel-extension-for-transformers) (3.1.2)
Requirement already satisfied: six>=1.5 in /usr/local/lib/python3.10/dist-packages (from python-dateutil>=2.8.1->pandas->neural-compressor->intel-extension-for-transformers) (1.16.0)
Installing collected packages: schema, deprecated, neural-compressor, intel-extension-for-transformers
Successfully installed deprecated-1.2.14 intel-extension-for-transformers-1.3.2 neural-compressor-2.5 schema-0.7.5

[zhentaoyu]

Hi, this issue seems to have the same reason as #194. pip install neural_speed won't install all packages from requirements.txt and we are trying to fix it now. Thanks.