Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in
Celebration

Earn badges and make progress

You're on your way to the next level! Join the Kudos program to earn points and save your progress.

Deleted user Avatar
Deleted user

Level 1: Seed

25 / 150 points

Next: Root

Avatar

1 badge earned

Collect

Participate in fun challenges

Challenges come and go, but your rewards stay with you. Do more to earn more!

Challenges
Coins

Gift kudos to your peers

What goes around comes around! Share the love by gifting kudos to your peers.

Recognition
Ribbon

Rise up in the ranks

Keep earning points to reach the top of the leaderboard. It resets every quarter so you always have a chance!

Leaderboard

Come for the products,
stay for the community

The Atlassian Community can help you and your team get more value out of Atlassian products and practices.

Atlassian Community about banner
4,466,883
Community Members
 
Community Events
176
Community Groups

Bitbucket Server and Amazon EFS

Want to run a cold/standby for Bitbucket server for high availability. If there's an issue with the primary instance, we can shut it down and start the secondary instance which will connect to the NFS mount containing the shared data. Currently using NFS from a Windows server (yes it's a little slower than local stoarge, but works well), but was looking into using Amazon EFS instead. 

When looking through Atlassian docs, the only thing I see regarding EFS is "You can't use Amazon Elastic File System (EFS) for Bitbucket Server's shared home directory.", but I don't see a listed reason as to why EFS can't be used over a NFS share. 

Is there a particular/documented reason as to why EFS can not be used if already using NFS?

1 answer

0 votes
Jeff Thomas Atlassian Team Dec 12, 2019

EFS and Git don't play very well together because of the way Git interacts with the file system. It's known to not be performant for Git.

Does Bitbucket Data Center clustering support Amazon EFS?

Not at this time. As noted in Amazon EFS Performance:

"The distributed nature of Amazon EFS […] results in a small latency overhead for each file operation. Due to this per-operation latency, overall throughput generally increases as the average I/O size increases, because the overhead is amortized over a larger amount of data."

Git typically involves many thousands of small file operations and the additional latency for each file operation means git is not suited to a distributed file system such as EFS. Since EFS's Max I/O option has an even higher latency, it is also not suitable for Bitbucket Data Center.

Source: Bitbucket Data Center FAQ

Jeff Thomas Atlassian Team Apr 16, 2020

Hi @LUIS ALBERTO LEON TORIBIOS

From my read of the announcement, I don't believe these changes in AWS will change our recommendation to not use EFS. While EFS increased the limit in read and write operations per second, it does not change (from what I can tell) the latency overhead for each operation. That latency overhead per operation is what will cause slow Git performance.

Isn't the main issue with git and EFS the fact that there's a bit of latency on each request, but native git is a huge amount of tiny files, each piece of latency adds up. Under LFS, while there might still be some latency, with less requests going to the files, it won't be a death by 1000 papercuts issue?

 

CCM

AWS annouced EFS now allows you to drive up to 3x higher read throughput on your file system. The problem is only for read operations.

https://aws.amazon.com/about-aws/whats-new/2021/01/amazon-elastic-file-system-triples-read-throughput/

This is an interesting discussion as we are going through setting up Bitbucket Datacenter with two instances on AWS cloud.

If not AWS EFS, what is the best recommended approach to share files on AWS? 

Haven't seen a good documentation of this specifically for AWS which Bitbucket proposes.

 

Can someone help? 

Hello,

I asked a related question on AWS FSX ontap.   Will the FSX ontap service's performance meet the requirements for a HA bitbucket environment?

https://community.atlassian.com/t5/Bitbucket-questions/Bitbucket-Enterprise-HA-Using-AWS-FSX-Ontap-NFS/qaq-p/1808601#M65928

Thanks,

Best,

-dkw

Like Steffen Opel _Utoolity_ likes this
Like # people like this

I’m curious as well if EFS is at all viable with the increased performance?

We will be looking to migrate our Bitbucket Data Center cluster to AWS and would love to go cloud-native with all of the components.

Suggest an answer

Log in or Sign up to answer
TAGS

Atlassian Community Events