What adapters will Assets Data Manager support?

[#1]

Hello community!

One of the most frequent question we’re being asked relates to the third-party systems Data Manager will integrate with. As we integrate AirTrack's code into the Atlassian platform post acquisition, thorough testing is essential to ensure all previous functionality works as expected. While we cannot yet guarantee functionality for all OOTB import types and adapters from day 1 after launch, our objective is to achieve feature parity. To provide insight, here's a list of OOTB import types and adapters that were available in AirTrack, and that we are working on validating.

Please feel free to comment away if there are any adapters you would like to see us add in the future!

Generic Adapters

• Flat Files (CSVs)
• SQL - Read Only access to a SQL Database

Product Specific Adapters

Product	Vendor	Connector Type	Product Type
Active Directory	Microsoft	Powershell	Systems Management
AirLock	AirLock	API	Cyber
Apptio	Apptio	API	Systems Management
Aternity	Aternity	API	Systems Management
Azure Active Directory Device (Entra ID)	Microsoft	API	Systems Management
Azure Active Directory User (Entra ID)	Microsoft	API	Systems Management
Azure VM	Microsoft	API	Systems Management
BigFix	HCL Technologies	API	System Management, Patch
Data Platform	Flexera Software	API	Data Normalization
Defender	Microsoft	API	Patch
Dynatrace OneAgent	Dynatrace	API	System Management
Falcon	Crowdstrike	API	Cyber
FlexNet Manager Suite (FNMS)	Flexera Software	API	Asset
Hyper-V	Microsoft	Powershell	System Management
InTune	Microsoft	API	Systems Management, Patch
jamf Cloud	jamf	API	Systems Management (MAC)
Lansweeper	Lansweeper	API or SQL	Asset
nexThink	nexThink	API	System Management
palo alto XDR	Palo Alto Networks	API	Cyber
Puppet	Puppet	API	System Management
Qualys	Qualys	API	Cyber
RISC Networks	Flexera Software	API	System Management (Cloud)
Secureworks	Red Cloak	API	Cyber
ServiceNow	ServiceNow	API	CMDB, Asset
snow	Snow Software	API	Asset
SolarWinds	SolarWinds	API	System Management, inc Networks
System Center Configuration Manager	Microsoft	DB Query	Systems Management, Patch
tenable.io (Vulnerability Management)	Tenable	API	Cyber
tenable.sc (Security Centre)	Tenable	API	Cyber
VMWare	Dell	Powershell	System Management (Virtual)
VMWare Carbon Black Defence	Dell	API	Cyber
VMWare Carbon Black Protect	Dell	API	Cyber
VMWare Carbon Black Response	Dell	API	Cyber
Windows Server Update Services (WSUS)	Microsoft	API	Systems Management
Workspace One - UEM	VMWare	API	Mobile System Management

[Andrew Costa]

For the 'flat files' like CSVs, will we be able to schedule imports (including with authentication), for files formats that are not supported or tools which do have have extensive APIs to leverage? 

Also are there any plans to leverage anything contained within AWS ? 

[Mike Villis]

+1 on AWS. Would need it to support multi account orgs. Priority on Ec2/RDS but would ideally like most assets and tags so we can start linking them up to services in Assets.

[Murthy A M]

AWS Integration is the must required and on waiting list for cloud for a while now, we are expecting the AWS integration to be in the list to be able to integrate and bring all Saas assets into JSM/Assets.

[Karyn Findlay]

Hi @Andrew Costa 

1. As part of the Data Manager architecture, we have what we call an Assets Adapters client, this is set-up On Prem in your network and will be used to load CSV's or connect to any of the out of the box tools to consume data.  From this On Prem server, you can run any scheduling tool like Windows Task Scheduler, a Unix CronJob or any other approved Scheduling tool in your organisation. 
   
   So, essentially the scheduling tool can collect the CSV file from a network location and then run the load of that CSV into Data Manager.
   
   
2. We can only support CSV files at this stage and we're only able to support those out of the box adapters with APIs.
   
   
3. Regarding AWS, we're currently defining our connector roadmap.  Can you provide some further detail around what services of AWS and the alternate data types you'd like to import? 

[Krister Broman _Advania_]

Can Assets Data Manager connect with Atlassian Discovery Agent? 

[Karyn Findlay]

@Krister Broman _Advania_ at this stage, it won't be possible to connect Assets Discovery to Data Manager.  However, you could bring to data into Data Manager via an Assets Schema.

[Knut Arne Ristebråten]

Would be great if the solution will support a generic adapter for imports from custom REST API's - including feature for authentication.
The Asset import module in JSM today do not support authentication, and we aren't able to use it. Workaround stated in JSDCLOUD-11482 with having endpoints publically accessable are not a option for us.

There are multiple custom API's utilized, so this would be a highly needed feature for us.

[Frank Schreiber]

thanks for sharing, i am curious: are there any plans to enrich the 'Product specific Adapters' with connectors to sync with user/identity/organizational data maintained in Workday and/or IdentityNow?

[Karyn Findlay]

@Frank Schreiber to expand our connectors into other area's like user and organisation is certainly on the cards.  We aim to work with our customers to get an understanding of what tools we should focus on and in what order.

[Knut Arne Ristebråten]

@Dorothea Linneweber or @Karyn Findlay , regarding my comment earlier in this article about importing from REST API with authentication, is this something that are being worked on? And will be included in data manager when or in near future after release/rollout?

If not available, when users migrate from on-prem to cloud, they need to build their own import modules outside of Atlassian products that will result in increased cost and complexity for the company - just to being able to import data from simple api's that require authentication.. It's not exactly a salespoint for migration to cloud.
New budjet year is upcomming, and planning for Cloud migration are/might be in progress, so would be good for companies to know if they need to perform extra development to support their needs, or if they can wayt for the Asset Data Manager release.

Assets already support import from REST API's. It just needs support for authentication that needs to be in place - and a easy way to schedule the import.

[Dirk Ronsmans]

I'd like to echo the comment from @Knut Arne Ristebråten  as well.

Having a generic REST API adapter would be great and limit the number of custom/product specific adapters that need to be created.

[Dorothea Linneweber]

Hi @Knut Arne Ristebråten , thank you for the suggestions! For now, the first iteration of Data Manager won't include public APIs to integrate with, however it is something we are looking to add in the future, similar to Assets itself where we're recently launched both Oauth2.0 and JWT authentication. Whilst Data Manager might not immediately help with DC-Cloud migration needs, we are working closely with the JCMA team to include Assets in their tooling as part of the FY25 roadmap. Whilst this continues to undergo technical investigations around scope and feasibility, updates will be shared via: https://jira.atlassian.com/browse/MIG-1168 

As for Data Manager, we have big hopes to open this up - for example - to be able to import from schemas of different cloud and DC instances in the future. That said, for now all efforts are focussed on shipping our first MVP candidate so we can't share any timelines yet unfortunately.

[Knut Arne Ristebråten]

Thank you for your comment  @Dorothea Linneweber in reply of my comment.

Just to clarify, as I understood mostly of your reply that you were talking about API to request the Asset Data Manager itself. (I might have misunderstood you here).

My request/question are to configure Asset Data Manager to import data from custom REST API sources. Not configure other clients to communicate with the Asset Data Manager's API.

Scenario:

• We have services delivered from Vendor A 
• Vendor A have these services available for us to import from the endpoint services[.]vendorA[.]com/API/services.json
  The endpoint require authentication (data must not be publicly available to the internet or other Atlassian sites)
  The services attribute can change daily.
• We want to create a "REST API import" (hypothetical name) inside Asset Data Manager
• We want to configure that adapter to import data from services[.]vendorA[.]com/API/services.json
• After configuration, import, clensing etc that data will be created inside our JSM Asset catalog called "Our Vendor A's object Schema) so we can relate our internal services to our vendors services, to see how we are affected if e.g. Vendor A's service status changes.

Might be that you answered that scenario in your comment, but I wanted to state the scenario we are after just in case :)

[Dirk Ronsmans]

@Dorothea Linneweber ,

Any more details you can share regarding the generic csv adapter?

The main use-case we hear about are csv/excel files as a source but stored on a Sharepoint library (or OneDrive). Would that be possible out of the box with the generic one or is this one that does no type of Authentication?

Or do you have any suggestions on what to use to connect to Sharepoint (or any other filesharing system eventually)?

[Murali Makam]

Hi @Karyn Findlay You had asked a question on AWS integration. We would like to connect to AWS config aggregator and bring in key AWS resources we use like the Virtual Machine instances, databases (RDS instance, Dynamo DB, Mongo DB, SQL etc.,), S3 buckets, Elastic Beanstalk, AWS ECS (Elastic Container Service), AWS Security Groups, AWS Rest API's, Network information etc., We can connect to AWS Config Aggregator setup in one account in one region to bring in these AWS resources. This helps instead of integrating with every account.

BTW, We had similar automation from ServiceNow to AWS Config Aggregator. We need to be able to pull AWS resources into JSM Assets in an automated way.

Now we are doing manual export into csv's and manual import into JSM assets. With automation, we would like to bring more AWS Resources and streamline our processes and improve productivity, quality, accuracy and timeliness of data into JSM.
thanks

[Karyn Findlay]

@Dirk Ronsmans here is our SAC documentation for configuration a Flat File connector.  Regarding consuming from Sharepoint.  I believe this should be possible using the ability to see the Sharepoint locations as a mapped network drive.  If your server that runs the Data Manager Clients, can see that  location then using the Cleans and Import client and a scheduling tool you will be able to schedule the consumption of the CSV file on a desired frequency.

@Murali Makam thanks for the information around AWS. There won't be a native adapter initially but it is high on our priority list.  For now, the CSV exports will need to continue, but you could bring them in through Data Manager and potentially using scheduling, as referenced above to try and remove the manual piece.

@Knut Arne Ristebråten I checked with engineering, if our understanding is correct, you're looking for a generic adapter that will connect to third-party APIs and bring data into Data Manager.  At this stage, this is not on the roadmap.  What Doro was referring to was providing an API for Data Manager where other tools can push data into Data Manager.

[Dirk Ronsmans]

@Karyn Findlay thanks for the link! We'll need to test this and see if we can get it going. I'm sure a lot of companies still store a lot of their data in files on sharepoint.

Regarding the generic API adapter i would like to add my vote on that to put it on the (short term) roadmap. 

A lot of tools will most likely have an api but not that widely used per region and would greatly benefit from this without having to wait for an edge case adapter being created and maintained.

I'm sure you can skip a large number of product specific adapters by creating a single generic one.

[Murali Makam]

Thanks @Karyn Findlay on your suggestion for AWS resources - we will try to automate the export of AWS resources into csv file and then we will use Data Manager to reconcile and import into JSM assets. Thanks

[Murali Makam]

Hi @Karyn Findlay Does Data Manager have a direct integration with JSM Assets for creating or updating schemas, object types, and objects? If not, how do we achieve that?

[Vincent Chan]

Hi everyone, @Karyn Findlay

I hope you're all doing well!

I've been exploring the current documentation and connectors, and I noticed that the list is a bit more reduced: Data Manager Adapters Client. https://support.atlassian.com/jira-service-management-cloud/docs/data-manager-adapters-client/.

I'm really excited to learn more about the roadmap for further adapter documentation and deployment. Would you have any insights on upcoming updates https://www.atlassian.com/roadmap/cloud. This would be greatly appreciated.

Thanks so much for your help and looking forward to the future developments!

Best regards,

[Karyn Findlay]

Hi @Vincent Chan ,

We're currently focusing on working with vendors in order to be able to get access to test environments for testing the above listed adapters that are yet to be released.  We need to ensure that they work in the Atlassian environment.

We are prioritizing based on customer feedback that is received through jira.atlassian.com (JAC).  Those tickets with the highest number of votes will, where possible, take precedence.  If there are any in particular you are interested in, let me know and I will create a JAC; which will enable the voting process for all customers.

Regards,

Karyn

[Paolo Pozzoli]

As for others the lack of AWS connector will be a show stopper for us on using this feature. Please let us know a roadmap for such a connector.

The other question would be if there will be a feature to build our own connectors.

[Karyn Findlay]

Hi @Paolo Pozzoli 

The AWS connector is high on our Roadmap but I am yet to have a timeline for delivery.  I have created this JAC Ticket: https://jira.atlassian.com/browse/JSDCLOUD-15598.  Please vote for this feature request, to help maintain it as a high priority item and feel free to watch it, in order to get updates.

Regarding the ability create your own custom adapters.  At this stage, we have had requests for this too, but at this stage, this is still a backlog item and not yet in on our Roadmap.

Regards,
Karyn

[Marcelo Garcia Majewski]

Hello, I am trying to configure data loading from a Databricks source. I have installed the Databricks JDBC drivers in the JIRA environment, and the connection was successful. However, when I run a select statement, I receive a generic error message saying: "Something went wrong, contact the administrator." The query logs in Databricks show that the table call is successful, but it seems that the "assets" plugin cannot handle the data format or something similar. There are no failure references in the JIRA logs. Does anyone have any ideas on what might be causing this issue? Is there a specific connector recommended for this data load connection with the Databricks source?