Does data sharing support versioning for incremental ingestion

[Assem Mohammed Ali]

Does Atlassian analytics data sharing support history sharing(tableConfig.cdfEnabled=true in the OSS Delta Sharing Server), so that my connector can query table changes?

Like below:

# Load table changes from version 0 to version 5, as a Pandas DataFrame.
delta_sharing.load_table_changes_as_pandas(table_url, starting_version=0, ending_version=5)

[Mohsin Shaikh · Accepted solution]

Hello @Assem Mohammed Ali

Hope you are doing well.

I am Mohsin from Atlassian Analytics to help you with this request.

Atlassian Analytics data shares do not currently support full Delta Change Data Feed (CDF) history sharing via the open-source Delta Sharing protocol (i.e., tableConfig.cdfEnabled=true), which would allow you to use methods like delta_sharing.load_table_changes_as_pandas(table_url, starting_version=0, ending_version=5) to query table changes by version.

Please refer this link for more information:

Extract the latest changes from data shares

Best Regards,

Mohsin