Json importer - paginated REST endpoint

[Joachim Bollen [ACA IT]]

Hi,

I'm trying to do an import in Insight via calling a REST endpoint with the json importer. This works fine, but unfortunately, the response is paginated (50 items per page), where the total is over 3000 items. The total number of items is available in the response, and with a "start"-parameter added to the url we can get the next page.

Is there a way to let Insight loop over the multiple pages, or do I have to configure a separate import for each page?

[Zihni Saglam · Accepted solution]

Hi Joachim

Unfortunately there is no way to loop over multiple pages. Question, is it possible to make sure there is an "unlimited" parameter on the Endpoint, or to create another Import type for the same Data?
Maybe create a small application to extract all the JSON info and consolidate it into a File which can be imported? Or even a DB Import?

[Joachim Bollen [ACA IT]]

Hi Zihni,

I've found an alternative endpoint to get the full data for this request, but unfortunately this is not always possible. 

Creating a small application to concatenate this data is a possibility, but I was hoping that Insight could do it without this app...

[Martin Cleaver]

Readers can at least vote for https://jira.mindville.com/browse/ICS-1063?jql=labels%20%3D%20json