We are seeing "git fsck" return hundreds of missing or corrupt trees in some of our repositories. This causes users to see errors when viewing Pull Requests in the Bitbucket UI. We are running a 3 node Bitbucket Data Center cluster on RedHat 7 VMs using TCP/IP clustering (not multicast). The Servers are configured with one NIC which serves both the inter-cluster communication and user requests. Most of the objects returned by git fsck exist on disk in ./objects but have 0KB size. Looking in our backups, we do not see these missing trees in a valid state which makes us think that they are being created as 0 byte objects. git gc --prune=all does not help. Also, we do not find these trees in an exhaustive search of the rev-list, using ls-tree across every entry. Do you know why we might have so many 0 byte objects being created in our repos? It is a serious problem which blocks our uses from merging pull requests, affecting their daily work.
