I am working on a spring scheduler application. The main function of the application is to pull the records from confluent rest proxy and do some business functionality.
Steps that we are following:
1. Create consumer instance. We are always creating a unique instance when the scheduler runs. (ex. instanceName + service.getCurrentTime()) We have used POST /consumers/(string:group_name)
2. create subscription using the instanceId generated. We have used POST /subscription
3. fetching records(encrypted records). We have used GET /records
This has been observed that when we have pushed few records in topics after the subscription, in that case records are getting pulled when the next scheduler runs, but lets say when we restart kafka (this happens locally as well as on the server) and push records to the topics in that case we need to retry many times 2-3 times atleaset in order to get the records.
I am currently experiencing this issue on server. I have checked with my automation team and found that my consumer group id is valid.
Attributes instanceAttributes = recordsService.createInstance(instanceName + service.getCurrentTime());
// Topics to subscribe
// Fetch records -- Trouble in getting records
ResponseEntity<String> response = recordsService.getRecords(instanceAttributes);
Hi Community! We're thrilled to share that Team Calendars for Confluence is now a built-in feature for Confluence Data Center releases 7.11 and beyond. A long time favorite, Team Cale...
Connect with like-minded Atlassian users at free events near you!Find an event
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no Community Events near you at the moment.Host an event
You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events