Upgrade to bitbucket 6.1 from 5.3.4

[Purchasing Plexina]

Upgraded to bitbucket 6.1.0 using installer in ubuntu-64 bit 16.04. After upgrading all the repositories shows as empty. No error messages in atlassian-bitbucekt.log file. 

Git version upgraded from 2.7 to 2.19.2 in ubuntu prior to upgrade 

Ubuntu version - 16.04 

Already verified this post 

https://confluence.atlassian.com/bitbucketserverkb/repository-is-not-updated-by-pushing-content-immediately-after-its-creation-779171782.html?_ga=2.138751155.1646099186.1551461782-362559847.1546549345

The hook script is present and its executable by bitbucket user. 

[Purchasing Plexina]

@[deleted] 

I am stuck with this upgrade and forced to roll back to the current version. It would be great if bitbucket engineering/support team take a look at this issue. 

Thanks.

[Purchasing Plexina]

@Fadoua  @Mark Lang 

Hi, 

I am trying to get some help for this upgrade issue. Could you guys please take a look at this issue? Please advise me if there is something different I have to do fo this upgrade

Thanks,

Al

[Fadoua]

@Purchasing Plexina 

Did you check if it is not a permission issue at the files level?

Best,

Fadoua

[Purchasing Plexina]

@Fadoua 

Thanks for looking into this issue. 

I verified the file permissions both bitbucket home and data directory is owned by atlbitbucket user. Application is also running as service owned by atlbitbucket user. 

All this directories are with atlbitbuket:atlbitbucket permissions

/opt/atlassian/bitbucket 

/var/atlassian/application-data 

/var/atlassian/bitbucket 

[Fadoua]

@Purchasing Plexina  what errors are you seeing on the logs?

[Purchasing Plexina]

@Fadoua 

On Access Log 

grep -i error /var/atlassian/application-data/bitbucket/log/atlassian-bitbucket-access.log

x.x.x.x| http | i@1K6RYCLx872x43x1 | - | 2019-04-01 14:32:54,315 | "GET /mvc/error404 HTTP/1.1" | "http://x.x.x.x:7990/admin/server-settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36" | - | - | - | - | - | 1wn6m8y |
x.x.x.x| http | o@1K6RYCLx872x43x1 | - | 2019-04-01 14:32:54,402 | "GET /mvc/error404 HTTP/1.1" | "http://x.x.x.x:7990/admin/server-settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36" | 404 | 0 | 13875 | - | 87 | 1wn6m8y |
x.x.x.x| http | i@1K6RYCLx873x53x0 | - | 2019-04-01 14:33:12,701 | "GET /mvc/error404 HTTP/1.1" | "http://x.x.x.x:7990/admin/server-settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36" | - | - | - | - | - | 1wn6m8y |
x.x.x.x| http | o@1K6RYCLx873x53x0 | - | 2019-04-01 14:33:12,752 | "GET /mvc/error404 HTTP/1.1" | "http://x.x.x.x:7990/admin/server-settings" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36" | 404 | 0 | 13573 | - | 51 | 1wn6m8y |
x.x.x.x| http | i@1K6RYCLx874x121x0 | - | 2019-04-01 14:34:46,653 | "GET /mvc/error404 HTTP/1.1" | "http://x.x.x.x:7990/admin" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36" | - | - | - | - | - | 1wn6m8y |
x.x.x.x| http | o@1K6RYCLx874x121x0 | - | 2019-04-01 14:34:46,705 | "GET /mvc/error404 HTTP/1.1" | "http://x.x.x.x:7990/admin" "Mozilla/5.0 (Macintosh; Intel Mac OS X 10_14_0) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.121 Safari/537.36" | 404 | 0 | 13573 | - | 51 | 1wn6m8y |

====================================

On Bitbucket log - I don't see any errors 

Only these warnings

grep -i error /var/atlassian/application-data/bitbucket/log/atlassian-bitbucket.log

2019-04-01 14:03:53,474 WARN  [Caesium-1-3]  c.a.a.c.DefaultApplinkStatusService Unrecognized error while attempting to retrieve status of Application Link '7c3354b5-676f-317a-b256-f720faaf83e7'

2019-04-01 14:04:13,507 WARN  [Caesium-1-3]  c.a.a.c.DefaultApplinkStatusService Unrecognized error while attempting to retrieve status of Application Link '1af864e6-c190-3771-b3da-10581cbfe7f9'

===========================================

[Purchasing Plexina]

@Fadoua @Julius Davies _bit-booster_com_ 

I found the issue, I did rsync of 

/var/atlassian/bitbucket/shared/data/repositories/  

/var/atlassian/application-data/bitbucket/shared/data/repositories 

After this the repositories are working fine.

Thanks for looking in to this. 

Al

[Fadoua]

Oh it is just like Jira. You have to run an indexing.

Glad your issue has been fixed @Purchasing Plexina !

Best,

Fadoua

[Julius Davies _bit-booster_com_]

Are the actual bare repos on disk ("under the hood" so to speak) also empty?   They are in $BITBUCKET_HOME/shared/data/repositories/ on the server's disk.

[Purchasing Plexina]

The repositories are present under

/var/atlassian/bitbucket/shared/data/repositories. They are not empty. Any other config needs to be updated?

[Julius Davies _bit-booster_com_]

So "git log" works in any of those and shows interesting data?

Also, are you sure you're on Bitbucket 6.1?  That version has not been released yet.  The version currently offered via https://www.atlassian.com/software/bitbucket/download is 6.0.1 (as of Monday, March 4th, 2019).

I definitely recommend opening up a support ticket with Atlassian.  

[Alagappan Vairavan]

Sorry,  the bitbucket version is 6.0.1. The log files are present and its not showing any error message. There are bunch of warnings 

WARN  [spring-startup]  com.hazelcast.instance.Node [10.0.1.14]:5701 [atlbitbucket] [3.11.1] No join method is enabled! Starting standalone.

WARN  [spring-startup]  c.a.s.i.p.s.OsgiBundledPathScanner Cannot scan directory /com/atlassian/plugin/connect/con

fluence/ in bundle com.atlassian.plugins.atlassian-connect-plugin; it does not exist

WARN  [Caesium-1-4]  c.a.s.i.p.PullRequestCommitBackfillJob An exception was encountered while backfilling. The jo

b has failed and will be attempted again on next startup.

java.lang.IllegalArgumentException: [/var/atlassian/application-data/bitbucket/shared/data/repositories/13] does not exist

at com.google.common.base.Preconditions.checkArgument(Preconditions.java:216)