Add custom filesystem object to arrow engine
jayceslesar opened this issue · 2 comments
jayceslesar commented
pyarrow 13.0.0 doesnt work with AWS SSO but my org has a custom filesystem object that does, how could I go about injecting my custom s3 filesystem into pyathena instead of using the default one provided.
with engine.connect() as conn:
# How can I inject here?jayceslesar commented
laughingman7743 commented
It cannot be changed to a custom S3 file system.
https://github.com/laughingman7743/PyAthena/blob/master/pyathena/arrow/result_set.py#L86-L114