How to rebuild corrupted Elasticsearch index

John Lawlor

I am using a remote Elasticsearch instance with Bitbucket. It looks like the index has become corrupt or something:

2019-03-11 10:18:09,398 ERROR [search-indexing:thread-1] c.a.b.i.s.i.e.DefaultIndexEventWorker Indexing - Failed for repository NSI/nsi (id: 1532) with error: Unexpected error occurred when requesting index state document (id=1532) the HTTP Status code is: 404
com.atlassian.bitbucket.internal.search.indexing.exceptions.IndexException: Unexpected error occurred when requesting index state document (id=1532) the HTTP Status code is: 404
at com.atlassian.bitbucket.internal.search.indexing.indexer.IndexStateService.lambda$save$2(IndexStateService.java:148)
at rx.internal.operators.OnSubscribeMap$MapSubscriber.onNext(OnSubscribeMap.java:69)
at rx.internal.operators.OperatorMerge$MergeSubscriber.emitScalar(OperatorMerge.java:511)
at rx.internal.operators.OperatorMerge$MergeSubscriber.tryEmit(OperatorMerge.java:466)
at rx.internal.operators.OperatorMerge$MergeSubscriber.onNext(OperatorMerge.java:244)
at rx.internal.operators.OperatorMerge$MergeSubscriber.onNext(OperatorMerge.java:148)
at rx.internal.operators.OnSubscribeMap$MapSubscriber.onNext(OnSubscribeMap.java:77)
at rx.internal.producers.SingleProducer.request(SingleProducer.java:65)
at rx.Subscriber.setProducer(Subscriber.java:211)
at rx.internal.operators.OnSubscribeMap$MapSubscriber.setProducer(OnSubscribeMap.java:102)
at rx.internal.operators.OnSubscribeToObservableFuture$ToObservableFuture.call(OnSubscribeToObservableFuture.java:75)
at rx.internal.operators.OnSubscribeToObservableFuture$ToObservableFuture.call(OnSubscribeToObservableFuture.java:43)
at rx.Observable.unsafeSubscribe(Observable.java:10327)
at rx.internal.operators.OnSubscribeMap.call(OnSubscribeMap.java:48)
at rx.internal.operators.OnSubscribeMap.call(OnSubscribeMap.java:33)
at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:48)
at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:30)
at rx.Observable.unsafeSubscribe(Observable.java:10327)
at rx.internal.operators.OnSubscribeMap.call(OnSubscribeMap.java:48)
at rx.internal.operators.OnSubscribeMap.call(OnSubscribeMap.java:33)
at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:48)
at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:30)
at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:48)
at rx.internal.operators.OnSubscribeLift.call(OnSubscribeLift.java:30)
at rx.Observable.unsafeSubscribe(Observable.java:10327)

 

Does anyone know how to rebuild the index for a remote Elasticsearch instance?

John Lawlor

You can check your index as follows:

http://<ip of elastic search instance>:9200/_cat/indices

Rebuild a corrupt index:

'Content-Type: application/json' -H 'Accept: application/json' https://<a href="http://confluence:8080/display/CMS/bitbucket.openet.com/rest/indexing/latest/sync" target="_blank" rel="nofollow noopener noreferrer">bitbucket.mycompany.com/rest/indexing/latest/sync</a>curl -u <admin user> -X POST -H 

Once you do this if you check this URL again:

http://<ip of elastic search instance>:9200/_cat/indices

You should see the numbers on the right most column start to increase again:

yellow open bitbucket-project       qdfaTpJST6yQSygS-cnlyA 5 1    172 1131    52kb    52kb
yellow open bitbucket-search-v1     H0fGxz-RSB6hA_gA0lCbmw 5 1 152894 1623 715.9mb 715.9mb
yellow open bitbucket-index-state   d4fYg7BUR86kKAtJLtaPiw 5 1   1040  140 242.8kb 242.8kb
yellow open bitbucket-repository    Wu1f02P8Td6pWaBJIEDJhw 5 1   1131    0 404.5kb 404.5kb
yellow open bitbucket-index-version iedAk2sxQtW-qPgVLyoGaA 5 1      1    0   3.9kb   3.9kb

See also:

https://confluence.atlassian.com/bitbucketserverkb/elasticsearch-has-got-corrupted-index-861012994.html