GoogleCloudPlatform/DataflowPythonSDK

Unable to install `google-cloud-dataflow` Python package due to missing Beam package

tswast opened this issue · 3 comments

$ pip install google-cloud-dataflow
Collecting google-cloud-dataflow
  Using cached google-cloud-dataflow-2.3.0.tar.gz
Collecting apache-beam[gcp]==2.3.0 (from google-cloud-dataflow)
  Could not find a version that satisfies the requirement apache-beam[gcp]==2.3.0 (from google-cloud-dataflow) (from versions: 0.6.0, 2.0.0, 2.1.0, 2.1.1, 2.2.0)
No matching distribution found for apache-beam[gcp]==2.3.0 (from google-cloud-dataflow)

Workaround

pip install --upgrade setuptools
pip install google-cloud-dataflow==2.2.0

Note that upgrading setuptools was necessary. The Dataflow installation failed with AttributeError: '_NamespacePath' object has no attribute 'sort' before I did that. To workaround this, I had to upgrade setuptools first.

Note: This is in a virtual environment on my Mac.

OS:

$ sw_vers
ProductName:	Mac OS X
ProductVersion:	10.13.3
BuildVersion:	17D102

Python:

$ python --version
Python 3.6.4

pip packages:

$ pip freeze
alembic==0.8.10
apache-airflow==1.9.0
apache-beam==2.2.0
avro==1.8.2
bleach==2.1.2
cachetools==2.0.1
certifi==2018.1.18
chardet==3.0.4
click==6.7
configparser==3.5.0
crcmod==1.7
croniter==0.3.20
dill==0.2.6
docutils==0.14
Flask==0.11.1
Flask-Admin==1.4.1
Flask-Cache==0.13.1
Flask-Login==0.2.11
flask-swagger==0.2.13
Flask-WTF==0.14
funcsigs==1.0.0
future==0.16.0
gapic-google-cloud-pubsub-v1==0.15.4
gitdb2==2.0.3
GitPython==2.1.9
google-apitools==0.5.11
google-auth==1.4.1
google-auth-httplib2==0.0.3
google-cloud-bigquery==0.25.0
google-cloud-core==0.25.0
google-cloud-dataflow==2.2.0
google-cloud-pubsub==0.26.0
google-gax==0.15.16
googleapis-common-protos==1.5.3
googledatastore==7.0.1
grpc-google-iam-v1==0.11.4
grpcio==1.10.0
gunicorn==19.7.1
html5lib==1.0.1
httplib2==0.9.2
idna==2.6
itsdangerous==0.24
Jinja2==2.8.1
lockfile==0.12.2
lxml==3.8.0
Mako==1.0.7
Markdown==2.6.11
MarkupSafe==1.0
mock==2.0.0
numpy==1.14.2
oauth2client==3.0.0
ordereddict==1.1
pandas==0.22.0
pbr==3.1.1
ply==3.8
proto-google-cloud-datastore-v1==0.90.4
proto-google-cloud-pubsub-v1==0.15.4
protobuf==3.3.0
psutil==4.4.2
pyasn1==0.4.2
pyasn1-modules==0.2.1
Pygments==2.2.0
python-daemon==2.1.2
python-dateutil==2.7.2
python-editor==1.0.3
python-nvd3==0.14.2
python-slugify==1.1.4
pytz==2018.3
PyYAML==3.12
requests==2.18.4
rsa==3.4.2
setproctitle==1.1.10
six==1.10.0
smmap2==2.0.3
SQLAlchemy==1.2.5
tabulate==0.7.7
thrift==0.11.0
typing==3.6.4
Unidecode==1.0.22
urllib3==1.22
webencodings==0.5.1
Werkzeug==0.14.1
WTForms==2.1
zope.deprecation==4.3.0

I just tried with a fresh virtualenv and it still fails.

Closing as a duplicate of https://issues.apache.org/jira/browse/BEAM-1251 (Apache Beam does not support Python 3)