Currently, it is not possible to use other SCM repositories other than GIT on Bitbucket Server. There is an open feature request BAM-18970 to support non-Bitbucket Server repos. Once this is implemented, it should be eventually possible to support other VCS as well (as they will rely on post-commit hook scripts).
Hope that helps.
While Support for non-Bitbucket Server repos for Bamboo Specs (Java and YAML) (BAM-18970) is now available as of Bamboo 6.5, this only includes "Git, Bitbucket Cloud, Github and Subversion repositories", whereas Mercurial didn't make the cut because "according to [Atlassian's] analytics Mercurial repositories usage is really small among [Atlassian's] customers".
Accordingly, please watch and vote for Support Mercurial repository for Bamboo Specs (BAM-19836) to make Atlassian aware of continued interest in Mercurial support.
G’day Bamboo customers, Bamboo DC 8.1 is now available with it the following features and programs: SAML 2.0, OpenID Connect, and Crowd SSO In order to help admins with a simplified user manage...
Connect with like-minded Atlassian users at free events near you!Find an event
Connect with like-minded Atlassian users at free events near you!
Unfortunately there are no Community Events near you at the moment.Host an event
You're one step closer to meeting fellow Atlassian users at your local event. Learn more about Community Events