snowflakedb/snowpark-python

SNOW-1434813: [Local testing] Add support for copy_into_table with on_error option

mraraujo opened this issue · 4 comments

Using snowflake-snowpark-python==1.16.0.

_analyzer.py checks

        if isinstance(logical_plan, CopyIntoTableNode):
            self._conn.log_not_supported_error(
                external_feature_name="DateFrame.copy_into_table",
                raise_error=NotImplementedError,
            )

However, DataFrame.copy_into_table appears explicitly in the list of supported APIs for local testing in: https://docs.snowflake.com/en/developer-guide/snowpark/python/testing-locally#list-of-supported-apis

Hello @mraraujo ,

Thanks for raising the issue. The data frame.copy_into_table() API is not yet supported, so we will fix the documentation.

Regards,
Sujan

@mraraujo thanks for the feedback. we are going to replace the list of supported api section with new sections explaining limitations/unsupported features.

in the meanwhile, may I ask if you are looking for the support of copy_into_table API?

@sfc-gh-aling yes, we use copy_into_table to ingest data into snowflake due to its flexibility (especially the ability to define behavior on_error and to log the results of the copy).
Adding it to local testing would help us increase test coverage on those parts of our system as well.

thanks @mraraujo for the context, we will prioritize this feature request, I have updated the title of this issue.
btw the documentation is fixed now, thanks again for the feedback!