Create
cancel
Showing results for 
Search instead for 
Did you mean: 
Sign up Log in

SCP-Deploy Broken Pipe issue less than a minute after pipe starts

Kamil November 15, 2021

I'm using SCP-Deploy with OpenSSH on Windows Server. Everything worked fine for the first few runs. Suddenly I started getting Broken Pipe issue and scp proces freezes. The pipeline doesn't stop, looks like it's still going, no error is shown, but nothing happens and I have to stop it manually as it never progresses:


scp: E:/Sites/MYAPI/Microsoft.AspNetCore.Identity.EntityFrameworkCore.dll: Broken pipe

 

This happened intermittently, now happens pretty much every time I run the pipe. Tried setting ServerAliveInterval etc, but this doesn't help the issue. Any idea why this could be the case? SCP is my only option, apart from slow SFTP to move files to Windows Server from Bitbucket Pipelines hence any help would be greatly appreciated. Files I'm moving are not huge, it's a 200mb in total of .NET API where no one file is extremely large. The Broken Pipe issue shows up pretty much at the beginning of the transfer.

SCP yml section:

- pipe: atlassian/scp-deploy:1.2.1
variables:
USER: $WEB2_USER
SERVER: $WEB2_SERVER
SSH_PORT: '22'
REMOTE_PATH: $WEB2_PATH/Services
LOCAL_PATH: /opt/atlassian/pipelines/agent/build/deploy/Services/*
EXTRA_ARGS: ['-o', 'ServerAliveInterval=60', '-o', 'ServerAliveCountMax=10']
DEBUG: 'true'

There is no difference when I remove EXTRA_ARGS

 

1 answer

0 votes
Igor Stoyanov
Atlassian Team
Atlassian Team members are employees working across the company in a wide variety of roles.
November 19, 2021

@kamilkloc hi. Thanks for your question. Looks like the problem is on your side if it works on the start and after some time it doesn't. Maybe you should check i.e firewall settings or networking etc.

Regards, Igor.

Kamil November 19, 2021

Might be on my side, or OpenSSH side, I checked firewall etc, all seems fine, no idea what it could be to be honest, especially that it worked fine multiple times beforehand. 

One thing that is bugging me is the fact that it only says "broken pipe" and bitbucket pipeline doesn't stop - seems like it's still running indefinitely (although not progressing) and has to be manually interrupted. Debug option doesn't show anything neither, no other messages apart from broken pipe next to the random file when it tries pushing it to the server.

Kent Hosbjerg
I'm New Here
I'm New Here
Those new to the Atlassian Community have posted less than three times. Give them a warm welcome!
October 26, 2022

Hi @kamilkloc ,

We are experiencing the same issue.

We upgraded scp-deploy version 0.3.0 > 1.2.1 because we thought it was a version issue. But, the error is still there.

Did you find a solution to the problem ?

Like Kamil likes this
Kamil October 26, 2022

Yes, solution was to move to Azure Pipelines. Bitbucket has very very poor support for Windows deployment and it is just more painful and hacky to set up for it to work than its worth it. Intermittent issues keep happening,  bitbucket Staff keeps saying the problem is on my side... well, we tried 3 different Windows machines, same results. In Azure we set up our Windows machine as User Agent and it works smoothly and downloads the repo on the server level, rather than having to SCP it onto server. Bit bucket pipelines we're fine to learn how pipelines work, that's it, sadly.

Like Kent Hosbjerg likes this

Suggest an answer

Log in or Sign up to answer
TAGS
AUG Leaders

Atlassian Community Events