I am trying to pull Jira data in ETL tool azure data factory but the tables are not loading it's tim

sudhir kumar rai July 5, 2022

We are trying to extract JIRA data like Issues, Ticket details from ETL tool called Azure Data Factory through JIRA connector, We are successfully created the coonection but tables are not loading it is getting timed out.

image.png

4 answers

0 votes
Jeffrey Wolfe November 1, 2024

Hello,

Alternatively, you can use other third-party services like Skyvia. I have not encountered such problems while using this tool.

0 votes
Himanshu Rathi April 17, 2023

Hello,

I am experiencing a similar issue with my pipeline in Azure. My pipeline is set up to transfer data from Jira to the data lake, and I have used an API token to establish the connection.

However, I am encountering a problem where only one table gets copied successfully while others are not. I have tried using a for loop and a single copy activity, but the other tables are not being copied at all. I have attached some screenshots for reference.

Have any of you encountered this issue before? I would greatly appreciate any insights or advice on how to resolve this.

Thank you in advance.

Phillip C
Contributor
May 6, 2024

hey @Himanshu Rathi  any luck with this one?

*edit: looks to be solved below.

0 votes
ofir.nayman
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
October 3, 2022

hi

which user name i need to put in the linked service?

0 votes
Nic Brough -Adaptavist-
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
July 5, 2022

Welcome to the Atlassian Community!

This isn't an Atlassian problem, you'll need to talk to the Azure Data Factory people about why you can't get it to read your Jira database.

All we can suggest is that you look at the settings, are you sure the connection is properly configured?

sudhir kumar rai July 6, 2022

Hey Nic, 

 

Yes, connection is properly configured, we are also trace the connection using wire shark, please check below details, it's application data which is causing issue.image.png Check below jira connection configuration

 JiraConnection2022-07-07 110710.png

Nic Brough -Adaptavist-
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
July 7, 2022

All wireshark is telling us is that it can reach and talk to the other end.

It's not telling us that your connection settings are right or why Azure Data Factory isn't reading the data.

sudhir kumar rai July 7, 2022

Hey Nic, we have resolved the issue form data factory end, we have checked JIRA URL in postman and its working. Thanks

 

Nic Brough -Adaptavist-
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
July 8, 2022

Ok, great, so the fault was definitely the setup of the Azure Data Factory.

Thanks for letting us know!

Like sudhir kumar rai likes this
sudhir kumar rai July 28, 2022

Hey Nic,

We are trying to explore two option to connect JIRA cloud and extract data using

Azure Data Factory, we have managed to extract data by using query (Select * from "Platform"."Api_Issue") tables, 

image.png

now we want to go inside ticket UDIC2-33780 and capture the "Description", "Estimation Parameter" and "Acceptance criteria" fileds data, please guide us from which table we can pull the below fields data?

image.png

Nic Brough -Adaptavist-
Rising Star
Rising Star
Rising Stars are recognized for providing high-quality answers to other users. Rising Stars receive a certificate of achievement and are on the path to becoming Community Leaders.
July 28, 2022

You'll need to look at how your Azure Data Factory is storing the data it is extracting over the REST APIs.  I can't tell you what shape it is storing the data in.

Prateek Fulsundar
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
August 3, 2022

Hello- I'm facing the same issue, can you please share if my Jira user permissions need to have specific configurations to allow connection from Data factory to Jira?

Jira_ADF.PNG

sudhir kumar rai August 3, 2022

Hi Prateek,

You need to create API token to connect JIRA cloud. Please click on right most icon, in my case SR (Red Marked) is showing, then click on your ICON> Managed Account>Security>Create API Token>copy API token and paste it in linked service password, that's it your connection will be successfulimage.png

Prateek Fulsundar
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
August 4, 2022

It worked. Thank you !

Hamza Moussaoui
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
July 15, 2024

hello guys  i want to pull all data available in jira and store in data lake in azure  i can perform this using the linked service because the api only pull 100 max  

 

Suggest an answer

Log in or Sign up to answer
DEPLOYMENT TYPE
CLOUD
PRODUCT PLAN
STANDARD
TAGS
AUG Leaders

Atlassian Community Events