ztane/python-Levenshtein

MemoryError introduced in latest release

Opened this issue · 3 comments

The latest release introduced a MemoryError to https://github.com/seatgeek/fuzzywuzzy:

(oscar) [0](17s):tstocks@:~/src/data[data:main]$ pip install python-levenshtein==0.12.1
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality.
Looking in indexes: https://devpi.hioscar.com/root/oscar-constrained/+simple/
Collecting python-levenshtein==0.12.1
  Downloading https://devpi.hioscar.com/root/pypi/%2Bf/554/e273a88060d17/python-Levenshtein-0.12.1.tar.gz (50 kB)
     |████████████████████████████████| 50 kB 1.5 MB/s 
Requirement already satisfied: setuptools in /Users/tstocks/.virtualenvs/oscar/lib/python2.7/site-packages (from python-levenshtein==0.12.1) (44.1.1)
Building wheels for collected packages: python-levenshtein
  Building wheel for python-levenshtein (setup.py) ... done
  Created wheel for python-levenshtein: filename=python_Levenshtein-0.12.1-cp27-cp27m-macosx_10_15_x86_64.whl size=73779 sha256=b0407f00b4ada7f265ea658c5b41b662d3cfab4919a19cbfed6c08754d7f0b79
  Stored in directory: /Users/tstocks/Library/Caches/pip/wheels/cf/4b/ac/bbfcaaed5a48c101f76f1f3f4ec8885735fb62f69d2cd6ae5b
Successfully built python-levenshtein
Installing collected packages: python-levenshtein
  Attempting uninstall: python-levenshtein
    Found existing installation: python-Levenshtein 0.12.0
    Uninstalling python-Levenshtein-0.12.0:
      Successfully uninstalled python-Levenshtein-0.12.0
Successfully installed python-levenshtein-0.12.1
(oscar) [0](5s):tstocks@:~/src/data[data:main]$ python2
Python 2.7.17 (default, Jan 11 2021, 14:51:47) 
[GCC Apple LLVM 12.0.0 (clang-1200.0.32.27)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from fuzzywuzzy import fuzz
>>> fuzz.ratio('abc', 'bcd')
Doing overflow check
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
  File "/Users/tstocks/.virtualenvs/oscar/lib/python2.7/site-packages/fuzzywuzzy/utils.py", line 29, in decorator
    return func(*args, **kwargs)
  File "/Users/tstocks/.virtualenvs/oscar/lib/python2.7/site-packages/fuzzywuzzy/utils.py", line 38, in decorator
    return func(*args, **kwargs)
  File "/Users/tstocks/.virtualenvs/oscar/lib/python2.7/site-packages/fuzzywuzzy/fuzz.py", line 51, in ratio
    return utils.intr(100 * m.ratio())
  File "/Users/tstocks/.virtualenvs/oscar/lib/python2.7/site-packages/fuzzywuzzy/StringMatcher.py", line 64, in ratio
    self._ratio = ratio(self._str1, self._str2)
MemoryError
>>> 

This was not present in the previous release.

(oscar) [0](29s):tstocks@:~/src/data[data:main]$ pip install python-levenshtein==0.12.0
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality.
Looking in indexes: https://devpi.hioscar.com/root/oscar-constrained/+simple/
Processing /Users/tstocks/Library/Caches/pip/wheels/89/d4/18/3cb530e7f2d5ee7e1546d39c2acab8794e15db5f8dbdb57e03/python_Levenshtein-0.12.0-cp27-cp27m-macosx_10_15_x86_64.whl
Requirement already satisfied: setuptools in /Users/tstocks/.virtualenvs/oscar/lib/python2.7/site-packages (from python-levenshtein==0.12.0) (44.1.1)
Installing collected packages: python-levenshtein
  Attempting uninstall: python-levenshtein
    Found existing installation: python-Levenshtein 0.12.1
    Uninstalling python-Levenshtein-0.12.1:
      Successfully uninstalled python-Levenshtein-0.12.1
Successfully installed python-levenshtein-0.12.0
(oscar) [0](2s):tstocks@:~/src/data[data:main]$ python2
Python 2.7.17 (default, Jan 11 2021, 14:51:47) 
[GCC Apple LLVM 12.0.0 (clang-1200.0.32.27)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> from fuzzywuzzy import fuzz
>>> fuzz.ratio('abc', 'bcd')
67
>>> 
ztane commented

Ok, it seems I had botched the source distribution...

ztane commented

Should be fixed in 0.12.2. So awkward, I was testing code that was different from what was released :/