We are using the atlassian/aws-elasticbeanstalk-deploy:0.2.5 pipe
When deploying EB actually fails to roll out the new version. This can be seen in Pipeline execution log:
INFO: Deploying to environment "backend-prod". Previous version: "Backend-7726-65a956a5" -> New version: "Backend-7756-0420f451".
:heavy_check_mark: Deployment triggered successfully. URL: http://masked.ap-southeast-1.elasticbeanstalk.com
...
INFO: Checking deployment status in Elastic Beanstalk...
INFO: Environment "backend-prod" is now running version "Backend-7726-65a956a5" with status "Ready".
you can see that the new version is actually not deployed, and old version is still running, however pipeline never fails and incorrectly marks deployment as completed in Bitbucket, thus making the notifications and Deployments dashboard useless.