Use data shares to read or export your data from the Atlassian Data Lake

[#1]

Hi, Atlassian Analytics community!

After an insightful early access program, we’re pleased to announce that our data shares feature is now generally available in Atlassian Analytics. Data shares will enable your organization to read or export your data from the Atlassian Data Lake into your own environments or third-party tools — one of our most highly requested features.

How to get started

Organization admins can create a data share by doing the following:

1. Select Data from the global navigation.

2. Select Data shares from the left sidebar.

3. Select Create data share.

I’ve also recorded a demo video to walk you through how to set up a data share in Atlassian Analytics:

Read our documentation for more details about data shares.

Things to note

• At this time, you can only access Jira data and account data through data shares.

• The schema for Data Lake connections in Analytics and data shares are different. More about the schema for data shares.

Thank you to our EAP participants

Special shout-out to those who joined our early access program, tested data shares, and provided feedback. We couldn’t have gotten here without you. 🥳

Tell us what you think

We’re excited for you to start using data shares. Leave a comment below or contact support if you have any questions, concerns, or feedback.

[Kevin Paugam]

Hello,

this is great that table "'jira_issue_enhanced_table" was added to the data share.

However, we found that field "Labels" was not available in any of the tables provided through the data share.

Any idea how we could get this field in our external BI tool?

[Tracy Chow]

@Kevin Paugam The "labels" column is not currently available in the `jira_issue_enhanced_table` table, but you can query the data from the `jira_issue_field` table.

More details can be found on this suggestion ticket: https://jira.atlassian.com/browse/ANALYTICS-254. 

[Dwight Thompson]

It looks like the Team field (customfield_11401) is not available in data shares, is that correct?

I should clarify: The field is there in the "jira_issue_field" table. I can find instances of customfield_11401 within the "field_id" column of that table. But in the same rows, the "value" column has the IDs of the teams, not the names of the teams. I don't know where, or if, the team names are stored anywhere within the data share schema. I can't find them anywhere.

[Tracy Chow]

Hi @Dwight Thompson, is the Team field you're using the Atlassian Team field? https://support.atlassian.com/atlassian-account/docs/using-atlassian-teams-in-jira-projects/ 

The data for team names is not available for data shares yet. I have created a feature request on your behalf here: https://jira.atlassian.com/browse/ANALYTICS-290 

[gomesp5]

Hi, thank for your presentation. Could you demonstrate the conection from jira data lake to power bi?. I can´t to realize this issues.

Thank

[Tracy Chow]

Hi @gomesp5, after you've created your data share credentials from Atlassian Analytics, you can follow the steps outlined here: https://learn.microsoft.com/en-us/power-query/connectors/delta-sharing to connect it to Power BI using the Delta Sharing connector.

If you have any trouble, feel free to contact our support team.

[Ram Rajamani]

@Tracy Chow   can you send the steps for Tableau to connect to Data Lake.  Assuming that we have to create data share credentials and then do something.   Ask is for Tableau to connect to data lake in Production and refresh daily at regular intervals.  Please advise on the steps.  Thanks

[Tracy Chow]

@Ram Rajamani Here is the documentation for connecting your data share to Tableau with their Delta Sharing connector: https://exchange.tableau.com/en-us/products/1019. Note you have to be on version Tableau 2024.1 and later.

[Medishetty, Vikram Swamy]

@Tracy Chow We have successfully connected from python to data sahre and able to see the schemas, now if we need to retrive all the custom fields on on all issues, how do we go about doing that? 

[Tracy Chow]

@Medishetty, Vikram Swamy You can query the tables starting with jira_issue_field (along with jira_issue_field_metadata and jira_issue_field_option) to retrieve your custom field data. If you have further questions on this, please contact our support team. Thanks

[Filip Swiatczak]

hey @Tracy Chow can you confirm if Snowflake can connect to the Atlassian Delta Sharing please?

From my research, there is a Snowflake connector from Delta Lake docs here: https://docs.delta.io/latest/snowflake-integration.html
but the Stage in Snowflake (connection bit in snowflake) doesn't describe the way to pass in the bearerToken as Credentials. Snowflake Docs don't mention this (https://docs.snowflake.com/en/sql-reference/sql/create-stage) so assume it might be some generic form, if possible. 

Please clarify as I imagine it would help many Snowflake users. 
Thank you! 

[Claire Gayrard]

Hi @Filip Swiatczak, currently Snowflake doesn't have a direct connector for data shares, powered by the Databricks Delta Sharing Protocol.

Snowflake customers load data via a Python or Spark pipeline. Python and Spark have libraries that orchestrate the protocol with quick-start examples.

Let me know if you still have questions.

Cheers,
Claire

[MobilityStream]

Hi @Filip Swiatczak

As @Claire Gayrard  pointed out there is no Snowflake direct connector. However, you could use Snowflake for Jira to bring your Jira data into Snowflake. Unlike Atlassian Data Lake shares, it also supports Assets, Tempo worklogs, and other third party Marketplace apps data. Give it a try.

Kind regards,

The Mobility Team

[Jitesh Mehta]

Hello Atlassian Team,

I created a new data share and connected Jira Cloud woth Power BI. Unfortunately, I do not see all Jira tables within Power BI, for eample - I simply want to see all sprints as part of a project and all issues as part of a sprint, but i do not see any relationship in the schema for sprint table. Please suggest if I am missing anything. I see there are tables available like "Issue sprint history" and "Issue status history" in the Atlassian data lake schema as part of data source, but I can't find them in the data share schema tables exported into Power BI. Please help.

Thanks & Regards,

Jitesh Mehta