airbytehq/PyAirbyte

Source Shopify: Connector Failed Error due to JSON Schema

Opened this issue · 0 comments

Connector

source-shopify

Issue

Running a source read with the below code fails with a ConnectorFailedError

    source = ab.get_source(
        "source-shopify",
        install_if_missing=True,
        config={
            "shop": shopify_resource["store_name"],
            "credentials": {
                "auth_method": "api_password",
                "api_password": shopify_resource["token"],
            },
        },
    )

    source.check()
    source.get_available_streams()
    source.select_streams(["customers", "orders"])
    bq_cache = BigQueryCache(
        project_name=bigquery_resource["project_id"],
        dataset_name="shopify_test",
        credentials_path= file_path
    )

    result = source.read(cache=bq_cache, force_full_refresh=True)

    return result

The error message is:

Started `source-shopify` read operation at 09:58:38...
Read started on stream: customers at 09:58:57...
Read started on stream: orders at 10:00:46...
Could not determine airbyte type from JSON schema: {'description': 'Timestamp 
when the marketing consent status was last updated.', 'anyOf': [{'type': 
'string', 'format': 'date-time'}, {'type': 'string'}, {'type': 'null'}]}
Failed `source-shopify` read operation at 10:03:32.