What is the maximum amount of data that can be sent through Insight api?

[Will Savage]

I ask this because I have to load >200k records via insight. I've started with a test load of only 1500, broke it up up into 3 seperate chunks of 500 records each. But only around half actually make it into my object types. After the initial dump of 200k records, it will be much less going forward. 

thanks

[Mikael Sandberg · Accepted solution]

Hi @Will Savage,

Welcome to Atlassian Community!

Does your objects in Assets have an user type attribute? Did you check the import report to see if you got any errors while doing the import? 

[Will Savage]

Thanks for this Mikael, after checking the report it seems it was removing duplicates...thanks for pointing this out!!

[Will Savage]

By chance can you tell me how insight removes/find duplicates? Is it based on the attribute I define as "identifier" labal: true??

[Mikael Sandberg]

It should be based on the attribute that is set as unique. The label is just used to display the objects in the list on the left-hand side.

[Will Savage]

Is there documentation that explains how to set an attribute as unique?

[Mikael Sandberg]

Verify attribute values to be unique it the documentation for it, but basically you go to the Attribute list and click on the cog wheel on the right and under general you can set the attribute to be unique.

[Will Savage]

can this be done in the mapping, or only with the UI?

[Mikael Sandberg]

You have to do it from the UI or via the API endpoint for attributes, the mapping cannot create new attributes.

[Will Savage]

Have you encountered the getExecution status endpoint ever be in an endless cycle of "processing"? How can I fix that.

[Mikael Sandberg]

I haven't, the only endpoints I used for the status is submitProgress and getStatus for the mapping.