Sentry-cli: error: http error: [55] Failed sending data to the peer (Send failure: Broken pipe)

[phil-zZ]

when i upload-dsym by command:

sentry-cli --log-level debug upload-dsym --org sentry --project myProject .

[INFO] sentry_cli::api request POST http://mysentry.cn:9000/api/0/projects/sentry/myProject/files/dsyms/
[INFO] sentry_cli::api using token authentication
[INFO] sentry_cli::api sending form data
error: http error: [55] Failed sending data to the peer (Send failure: Broken pipe)

[mitsuhiko]

I cannot reproduce this. Might make sense to check your server setup and run in verbose mode.

[xiansanluo]

@inft I had the same error when I try to exec sentry-cli releases files v1.1 upload-sourcemaps ~/python/mycmdb/static
However, I just use nginx as a reverse proxy ,just config it like this:

    location / {
        # First attempt to serve request as file, then
        # as directory, then fall back to displaying a 404.
        proxy_pass http://localhost:9000; 
    }

Then visit sentry by port 80, It seems good to me.

[mitsuhiko]

Any chance this is the chinese firewall tampering with the request? Does this happen over SSL as well?

[xiansanluo]

I just intall sentry in local with docker.
And when I exec upload-sourcemaps (about 50 js files), there still have the same error.
However , Setup a Reverse Proxy can fix it . https://docs.sentry.io/server/installation/python/

[xiansanluo]

Maybe uwsgi can not deal with so many requests, but for nginx ,it is fine

[nhducit]

I have this error also. I havn't got this error before. Today we moved to new office, are there any chance this is network issue?

[mitsuhiko]

@nhducit in sentry-cli? Is this self hosted sentry? can you run sentry-cli with debug logs?

[nhducit]

1. in sentry-cli?
   using react-native-sentry
2. Is this self hosted sentry?
   no
3. can you run sentry-cli with debug logs?
   I don't know how to change the sentry-cli config in react-native-sentry. Which file I should change to change debug logs level?

I switched to another wifi connection and the issue is solved

[HazAT]

@nhducit
So you can add the --log-level debug in Xcode under Build Phases -> Upload Debug Symbols to Sentry
or
on Android in gradle with

project.ext.sentryCli = [
    logLevel: "debug"
]
apply from: "../../node_modules/react-native-sentry/sentry.gradle"

https://docs.sentry.io/clients/react-native/manual-setup/#android

[jmesquita]

Just to try and contribute to the conversation, I just started debugging this and this is what I get when I try to upload a 11MB sourcemap. The other sourcemaps uploaded just fine but they were much smaller and uploaded just fine.

This is a self-hosted docker sentry installation. You see localhost because there's a SSH reverse tunnel to access the instance while we put your nginx config in place.

I'll continue to post here as I find more details.

./node_modules/.bin/sentry-cli --log-level debug --url http://localhost:8082 --auth-token <key> releases -o sentry -p <project> files 0.0.1-test upload-sourcemaps dist/main.0ee2215a9c6a7e0b7751.bundle.js.map
[INFO] sentry_cli::commands::releases found: dist/main.0ee2215a9c6a7e0b7751.bundle.js.map (12004903 bytes)
> Analyzing 1 sources
> Adding source map references
[INFO] sentry_cli::api request POST http://localhost:8082/api/0/projects/sentry/cr-portal/releases/
[INFO] sentry_cli::api using token authentication
[INFO] sentry_cli::api sending JSON data (49 bytes)
[INFO] sentry_cli::api > POST /api/0/projects/sentry/cr-portal/releases/ HTTP/1.1
[INFO] sentry_cli::api > Host: localhost:8082
[INFO] sentry_cli::api > Accept: */*
[INFO] sentry_cli::api > User-Agent: sentry-cli/1.29.0
[INFO] sentry_cli::api > Authorization: Bearer f971db7f***
[INFO] sentry_cli::api > Content-Type: application/json
[INFO] sentry_cli::api > Content-Length: 49
[INFO] sentry_cli::api < HTTP/1.1 208 ALREADY REPORTED
[INFO] sentry_cli::api < Content-Length: 385
[INFO] sentry_cli::api < X-XSS-Protection: 1; mode=block
[INFO] sentry_cli::api < Content-Language: en
[INFO] sentry_cli::api < X-Content-Type-Options: nosniff
[INFO] sentry_cli::api < Vary: Accept-Language, Cookie
[INFO] sentry_cli::api < Allow: GET, POST, HEAD, OPTIONS
[INFO] sentry_cli::api < X-Frame-Options: deny
[INFO] sentry_cli::api < Content-Type: application/json
[INFO] sentry_cli::api response: 208
[INFO] sentry_cli::api body: {"lastDeploy": null, "dateCreated": "2018-02-05T16:04:03.915Z", "lastEvent": null, "shortVersion": "0.0.1-test", "authors": [], "owner": null, "newGroups": 0, "data": {}, "projects": [{"slug": "<project>", "name": "<project>"}], "dateReleased": null, "url": null, "deployCount": null, "commitCount": null, "version": "0.0.1-test", "firstEvent": null, "lastCommit": null, "ref": null}
[INFO] sentry_cli::api request GET http://localhost:8082/api/0/projects/sentry/cr-portal/releases/0.0.1-test/files/
[INFO] sentry_cli::api using token authentication
[INFO] sentry_cli::api > GET /api/0/projects/sentry/cr-portal/releases/0.0.1-test/files/ HTTP/1.1
[INFO] sentry_cli::api > Host: localhost:8082
[INFO] sentry_cli::api > Accept: */*
[INFO] sentry_cli::api > User-Agent: sentry-cli/1.29.0
[INFO] sentry_cli::api > Authorization: Bearer f971db7f***
[INFO] sentry_cli::api > GET /api/0/projects/sentry/cr-portal/releases/0.0.1-test/files/ HTTP/1.1
[INFO] sentry_cli::api > Host: localhost:8082
[INFO] sentry_cli::api > Accept: */*
[INFO] sentry_cli::api > User-Agent: sentry-cli/1.29.0
[INFO] sentry_cli::api > Authorization: Bearer f971db7f***
[INFO] sentry_cli::api < HTTP/1.1 200 OK
[INFO] sentry_cli::api < Content-Length: 749
[INFO] sentry_cli::api < X-XSS-Protection: 1; mode=block
[INFO] sentry_cli::api < X-Content-Type-Options: nosniff
[INFO] sentry_cli::api < Content-Language: en
[INFO] sentry_cli::api < Vary: Accept-Language, Cookie
[INFO] sentry_cli::api < Link: <http://localhost:8082/api/0/projects/sentry/cr-portal/releases/0.0.1-test/files/?&cursor=100:-1:1>; rel="previous"; results="false"; cursor="100:-1:1", <http://localhost:8082/api/0/projects/sentry/cr-portal/releases/0.0.1-test/files/?&cursor=100:1:0>; rel="next"; results="false"; cursor="100:1:0"
[INFO] sentry_cli::api < Allow: GET, POST, HEAD, OPTIONS
[INFO] sentry_cli::api < X-Frame-Options: deny
[INFO] sentry_cli::api < Content-Type: application/json
[INFO] sentry_cli::api response: 200
[INFO] sentry_cli::api body: [{"sha1": "c7dbfb9839bd0c0ec2aee5b3c87398a2659e6dff", "dist": null, "name": "~/inline.ade69854ac6d185e43a9.bundle.js.map", "dateCreated": "2018-02-05T16:09:47.343Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "3", "size": 7788}, {"sha1": "45eac4c07b36115f1effe61285c49bf6185ddfc8", "dist": null, "name": "~/scripts.846e47a5dd78c6cba5c5.bundle.js.map", "dateCreated": "2018-02-05T16:09:35.953Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "2", "size": 33589}, {"sha1": "a543bc4314e144fd59fc96f29efbf9db45b2b93f", "dist": null, "name": "~/styles.9d3fd2754b25a24fde02.bundle.css.map", "dateCreated": "2018-02-05T16:07:12.742Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "1", "size": 141403}]
> Uploading source maps for release 0.0.1-test
> ~/main.0ee2215a9c6a7e0b7751.bundle.js.map
░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░░ 0/1
[INFO] sentry_cli::api request POST http://localhost:8082/api/0/projects/sentry/cr-portal/releases/0.0.1-test/files/
[INFO] sentry_cli::api using token authentication
[INFO] sentry_cli::api sending form data
[INFO] sentry_cli::api > POST /api/0/projects/sentry/cr-portal/releases/0.0.1-test/files/ HTTP/1.1
[INFO] sentry_cli::api > Host: localhost:8082
[INFO] sentry_cli::api > Accept: */*
[INFO] sentry_cli::api > User-Agent: sentry-cli/1.29.0
[INFO] sentry_cli::api > Authorization: Bearer f971db7f***
[INFO] sentry_cli::api > Content-Length: 12005268
error: http error: [55] Failed sending data to the peer (Send failure: Broken pipe)

[mitsuhiko]

Presumably your self hosted sentry cannot accept files of that size. I'm going to close this issue as this seems unlikely to be related to sentry-cli. Everything so far points at this being a configuration error on self hosted sentries.

If someone encounters this on sentry.io please run in debug mode and reply with logs.

[jmesquita]

To support your argument here @mitsuhiko, we've configured Nginx as we had planned and the problem just went away. No changes to the container... Not sure what the deal was there but it is definitely not a sentry-cli problem.

[robrohan]

Don't do the following

Doco says gzip wont work: https://docs.sentry.io/clients/javascript/sourcemaps/ - they seem to upload fine, but don't map correctly.

We're evaluating sentry and want to see how well it works with source maps, but we ran into this error as well. A workaround we used was to gzip the .map files to reduce the file size and they uploaded just fine (we are using the docker container version).

Probably not something you want to do forever, but can help get you over the line if you just want to see how it handles source maps.

[mitsuhiko]

@robrohan is this on self hosted or sentry.io? On self hosted you will need to make sure nginx is on front of your sentry install or at least http keepalives are disabled in the sentry-cli config.

[robrohan]

Hi @mitsuhiko - it is self hosted. It's using the offical docker / docker-compose that you guys put out (which doesn't have nginx in there by default oddly enough). It's fine for us as we're just evaluating the product.

This one: https://github.com/getsentry/onpremise

[mitsuhiko]

@robrohan then disable keepalives in the sentry cli config: https://docs.sentry.io/learn/cli/configuration/#configuration-values (http.keepalive to false)

[robrohan]

@mitsuhiko thanks mate that got them to upload. Oddly it failed the first time, but uploaded when I ran the command a second time (it does that every time: first fails second works). Anyway good enough for us to evaluate!

By the way, thanks for having this project open source. This is the only open source product I can find that does what it does - and the hobbyist tier ... double plus good :-D

[Atrejoe]

@mitsuhiko I there any way that I can assert that the keep-alive is actually disabled when I have set it?

I have successfully set the preferences in a .sentryclirc file:

[defaults]
url=https://my.private.sentry/
org=myorg
[http]
keepalive=false

when using sentry-cli info, the 'default' part is displayed:

Sentry Server: https://my.private.sentry/
Default Organization: myorg
Default Project: -

But I cannot assert that my keepalive setting is picked up. Deliberately setting invalid config values does not give me any hints.

When setting the debug level to info, while requesting this information (sentry-cli --log-level info info) , I do get a bit more, but still nothing on the keep-alive setting:

[INFO] sentry_cli::api request GET https://my.private.sentry/api/0/ [INFO] sentry_cli::api > GET /api/0/ HTTP/1.1 [INFO] sentry_cli::api > Host: my.private.sentry [INFO] sentry_cli::api > Accept: */* [INFO] sentry_cli::api > User-Agent: sentry-cli/1.29.1 [INFO] sentry_cli::api < HTTP/1.1 200 OK [INFO] sentry_cli::api < Allow: GET, HEAD, OPTIONS [INFO] sentry_cli::api < Content-Type: application/json [INFO] sentry_cli::api < Content-Language: en [INFO] sentry_cli::api < Vary: Accept-Language, Cookie [INFO] sentry_cli::api < X-XSS-Protection: 1; mode=block [INFO] sentry_cli::api < X-Content-Type-Options: nosniff [INFO] sentry_cli::api < X-Frame-Options: deny [INFO] sentry_cli::api < X-Powered-By: ARR/3.0 [INFO] sentry_cli::api < X-Forwarded-Proto: https [INFO] sentry_cli::api < Host: my.private.sentry [INFO] sentry_cli::api < X-Forwarded-Protocol: https [INFO] sentry_cli::api < Date: Wed, 06 Jun 2018 10:12:39 GMT [INFO] sentry_cli::api < Content-Length: 44 [INFO] sentry_cli::api response: 200 [INFO] sentry_cli::api body: {"version": "0", "user": null, "auth": null} Sentry Server: https://my.private.sentry Default Organization: myorg Default Project: -

The reverse proxy did resolve the broken pipe errors, but I'm now trying to find the reason for another error:
https://forum.sentry.io/t/502-generic-error-when-publishing-release-using-sentry-cli/3964

[adamlc]

@Atrejoe I'm also having the same issues. I think the reverse proxy is just masking the broken pipe error to be honest. 502 is a bad gateway error, meaning that sentry isn't responding correctly.

This issue has recently occurred for us after no infrastructure changes at all. I can only assume something may have changed in sentry-cli thats broken this.

[Atrejoe]

@adamlc I think too that the reverse proxy is masking the situation, that's why I wanted to see the Sentry server logs.
If this doesn't work I may have to see if can intercept the actual traffic between the proxy and Sentry.
Thanks for your response so I don't feel too alone in this. Have you resolved this somehow?
But let's leave this issue be about the broken pipe and attempt fix the 502 at the Sentry Forum :)

[adamlc]

I'll have to come back to this at some point. For now I've just had to disable source map uploading. When I bypassed the reverse proxy and uploaded to sentry directly I got the same "[55] Failed sending data to the peer (Send failure: Broken pipe)" error.

I guess the next thing to try would be to upload them directly using curl and see what happens? https://docs.sentry.io/clients/javascript/sourcemaps/#uploading-source-maps-to-sentry

[Atrejoe]

I further investigated and logged the log output by Sentry, see:
https://forum.sentry.io/t/502-generic-error-when-publishing-release-using-sentry-cli/3964/2?u=robert_cs

In short: in the example Sentry indicated a successful response (201), but the content was deemed invalid by the reverse proxy. The only difference between the two similar Sentry responses I now suspect is the size of the response (2 bytes difference), which may be something like an unfinished line end or EOF. (highly untested suspicion)

@adamlc going down the curl route might be interesting

[Atrejoe]

We have upgraded to Sentry 9, and now the broken pipe error seems to has been fixed.
(We now have to bypass the reverse proxy for this, as this is still giving 502's)

[pengshaosu]

@Atrejoe
Hi,
You sure Sentry 9 is working fine about the issue.

I have one self-hosted sentry(9.0.0) on docker, but still reporting the error[55].

I try to change the sentry.conf.py setting, but get another error[56].

SENTRY_WEB_OPTIONS = {
    # 'workers': 3,  # the number of web workers
    'limit-post': 31457280  # in bytes ~ 30MB
}

error: API request failed
  caused by: [56] Failure when receiving data from the peer

Appreciate your attention.

[Atrejoe]

That is a coincidence, just this week SourceMap uploads to Sentry have become relevant for us again.

And yes, this error response is still seen. We use this when uploading new releases and the reason for this to happen may be that the release we are sending already has been sent to Sentry, we we have to investigate further.

We experience the 55 error reason:

[55] Failed sending data to the peer (Send failure: Connection was aborted)

We have at lease had one success.
We still upload directly to the Sentry instance, not the reverse proxy.
We are now on Sentry 9.1.2.

[mitsuhiko]

This is likely caused by you not running an nginx in front. Can you verify that you are running an nginx in front of sentry?

[Atrejoe]

We are not, we are using a IIS reverse proxy.

Currently we are doing the source maps uploads over plain http directly to the Sentry instance, running in Docker.
But as said, we also had a success before:

[09:35:44]uploading sourcemaps for version 1.1.1 to sentry http://dockermachine:9000
[09:35:44]> Analyzing 18 sources
[09:35:44]> Adding source map references
[09:35:44]> Validating sources
[09:35:44]> Uploading source maps for release 1.1.1
[09:35:44]
[09:35:44]Source Map Upload Report
[09:35:44]  Scripts
[09:35:44]    ~/customer-portal/assets/js/google-charts-presets.js
[09:35:44]    ~/customer-portal/assets/js/underscore.mixin.deepExtend.js
[09:35:44]  Minified Scripts
[09:35:44]    ~/customer-portal/assets/js/jquery-3.2.1.min.js (no sourcemap ref)
[09:35:44]      - warning: could not determine a source map reference (Could not auto-detect referenced sourcemap for ~/customer-portal/assets/js/jquery-3.2.1.min.js.)
[09:35:44]      - error: missing sourcemap!
[09:35:44]    ~/customer-portal/main-es2015.a2c73e4cf871a8c9a40b.js (sourcemap at main-es2015.a2c73e4cf871a8c9a40b.js.map)
[09:35:44]    ~/customer-portal/main-es5.fec7c09bbc2919e2f4d8.js (sourcemap at main-es5.fec7c09bbc2919e2f4d8.js.map)
[09:35:44]    ~/customer-portal/polyfills-es2015.0cc5377576d194f64fab.js (sourcemap at polyfills-es2015.0cc5377576d194f64fab.js.map)
[09:35:44]    ~/customer-portal/polyfills-es5.b5b61f6726ab80db9eb1.js (sourcemap at polyfills-es5.b5b61f6726ab80db9eb1.js.map)
[09:35:44]    ~/customer-portal/runtime-es2015.858f8dd898b75fe86926.js (sourcemap at runtime-es2015.858f8dd898b75fe86926.js.map)
[09:35:44]    ~/customer-portal/runtime-es5.741402d1d47331ce975c.js (sourcemap at runtime-es5.741402d1d47331ce975c.js.map)
[09:35:44]    ~/customer-portal/scripts.d941dc5eab1f45c0b068.js (sourcemap at scripts.d941dc5eab1f45c0b068.js.map)
[09:35:44]  Source Maps
[09:35:44]    ~/customer-portal/main-es2015.a2c73e4cf871a8c9a40b.js.map
[09:35:44]    ~/customer-portal/main-es5.fec7c09bbc2919e2f4d8.js.map
[09:35:44]    ~/customer-portal/polyfills-es2015.0cc5377576d194f64fab.js.map
[09:35:44]    ~/customer-portal/polyfills-es5.b5b61f6726ab80db9eb1.js.map
[09:35:44]    ~/customer-portal/runtime-es2015.858f8dd898b75fe86926.js.map
[09:35:44]    ~/customer-portal/runtime-es5.741402d1d47331ce975c.js.map
[09:35:44]    ~/customer-portal/scripts.d941dc5eab1f45c0b068.js.map
[09:35:44]    ~/customer-portal/styles.8debd8c8dfeab96ebcae.css.map
[09:35:44]      - warning: missing sourcecode (webpack:///$stdin)
[09:35:44]      - warning: missing sourcecode (webpack:///./node_modules/@mdi/font/scss/_path.scss)
[09:35:44]      - warning: missing sourcecode (webpack:///./node_modules/@mdi/font/scss/_core.scss)
[09:35:44]      - warning: missing sourcecode (webpack:///./node_modules/@mdi/font/scss/_icons.scss)
[09:35:44]      - warning: missing sourcecode (webpack:///./node_modules/@mdi/font/scss/_extras.scss)
[09:35:44]      - warning: missing sourcecode (webpack:///./node_modules/@mdi/font/scss/_animated.scss)

[mitsuhiko]

I would propose to disable keepalive in the .sentryclirc and see if this resolves the issue:

[http]
keepalive = false

[Atrejoe]

We already have that, see also:
https://github.com/getsentry/sentry-cli/issues/40#issuecomment-395019544

What I also see, is that we are on Sentry CLI 1.33.0, it may be worth upgrading.

[Atrejoe]

We bumped Sentry-CLI to 1.47.1 and set output verbosity to debug, redacted log:

TLDR: still fails with [55]

[14:19:25]uploading sourcemaps for version 1.1.2 to sentry http://dockerhost:9000
[14:19:25]> Analyzing 18 sources
[14:19:25]> Adding source map references
[14:19:25]> Validating sources
[14:19:25]> Uploading source maps for release 1.1.2
[14:19:25]
[14:19:25]stderr:   INFO    2019-08-06 14:19:24.314796900 +02:00 Loaded config from .sentryclirc
[14:19:25]  DEBUG   2019-08-06 14:19:24.316791300 +02:00 sentry-cli version: 1.47.1, platform: "windows", architecture: "x86_64"
[14:19:25]  INFO    2019-08-06 14:19:24.316791300 +02:00 sentry-cli was invoked with the following command line: "node_modules\\@sentry\\cli\\sentry-cli" "--log-level" "DEBUG" "--auth-token" "*******" "--url" "http://dockerhost:9000" "releases" "-o" "myorg" "-p" "projectname" "files" "1.1.2" "upload-sourcemaps" "--url-prefix=~/" "--validate" "dist"
[14:19:25]  DEBUG   2019-08-06 14:19:24.324770900 +02:00 built glob set; 0 literals, 0 basenames, 0 extensions, 0 prefixes, 0 suffixes, 4 required extensions, 0 regexes  (from globset)
[14:19:25]  DEBUG   2019-08-06 14:19:24.325768500 +02:00 MYFILE: Ignore(IgnoreMatch(Types(Glob(UnmatchedIgnore))))  (from ignore)

.... few more ignores and includes omitted for clarity and sensitivity

[14:19:25]  WARN    2019-08-06 14:19:24.328787700 +02:00 The default --no-rewrite will disappear. Please specify --rewrite or --no-rewrite explicitly during sourcemap upload.
[14:19:25]  DEBUG   2019-08-06 14:19:24.977041800 +02:00 request POST http://dockerhost:9000/api/0/projects/myorg/projectname/releases/
[14:19:25]  DEBUG   2019-08-06 14:19:24.977041800 +02:00 using token authentication
[14:19:25]  DEBUG   2019-08-06 14:19:24.977041800 +02:00 json body: {"version":"1.1.2","projects":["projectname"]}
[14:19:25]  DEBUG   2019-08-06 14:19:24.977041800 +02:00 retry number 0, max retries: 0
[14:19:25]  DEBUG   2019-08-06 14:19:24.985993500 +02:00 > POST /api/0/projects/myorg/projectname/releases/ HTTP/1.1
[14:19:25]  DEBUG   2019-08-06 14:19:24.985993500 +02:00 > Host: dockerhost:9000
[14:19:25]  DEBUG   2019-08-06 14:19:24.985993500 +02:00 > Accept: */*
[14:19:25]  DEBUG   2019-08-06 14:19:24.985993500 +02:00 > Connection: TE
[14:19:25]  DEBUG   2019-08-06 14:19:24.985993500 +02:00 > TE: gzip
[14:19:25]  DEBUG   2019-08-06 14:19:24.985993500 +02:00 > User-Agent: sentry-cli/1.47.1
[14:19:25]  DEBUG   2019-08-06 14:19:24.985993500 +02:00 > Authorization: Bearer 08cd752b***
[14:19:25]  DEBUG   2019-08-06 14:19:24.985993500 +02:00 > Content-Type: application/json
[14:19:25]  DEBUG   2019-08-06 14:19:24.985993500 +02:00 > Content-Length: 65
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 < HTTP/1.1 208 ALREADY REPORTED
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 < Content-Length: 409
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 < X-XSS-Protection: 1; mode=block
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 < Content-Language: en
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 < X-Content-Type-Options: nosniff
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 < Vary: Accept-Language, Cookie
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 < Allow: GET, POST, HEAD, OPTIONS
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 < X-Frame-Options: deny
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 < Content-Type: application/json
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 response status: 208
[14:19:25]  DEBUG   2019-08-06 14:19:25.018939400 +02:00 body: {"dateReleased": null, "commitCount": 0, "url": null, "data": {}, "lastDeploy": null, "deployCount": 0, "dateCreated": "2019-08-06T09:16:23.807Z", "lastEvent": null, "version": "1.1.2", "firstEvent": null, "lastCommit": null, "shortVersion": "1.1.2", "authors": [], "owner": null, "newGroups": 0, "ref": null, "projects": [{"slug": "projectname", "name": "projectname"}]}
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 request GET http://dockerhost:9000/api/0/organizations/myorg/chunk-upload/
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 using token authentication
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 retry number 0, max retries: 0
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 > GET /api/0/organizations/myorg/chunk-upload/ HTTP/1.1
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 > Host: dockerhost:9000
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 > Accept: */*
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 > Connection: TE
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 > TE: gzip
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 > User-Agent: sentry-cli/1.47.1
[14:19:25]  DEBUG   2019-08-06 14:19:25.019903200 +02:00 > Authorization: Bearer 08cd752b***
[14:19:25]  DEBUG   2019-08-06 14:19:25.041843600 +02:00 < HTTP/1.1 200 OK
[14:19:25]  DEBUG   2019-08-06 14:19:25.041843600 +02:00 < Content-Length: 237
[14:19:25]  DEBUG   2019-08-06 14:19:25.041843600 +02:00 < X-XSS-Protection: 1; mode=block
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 < Content-Language: en
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 < X-Content-Type-Options: nosniff
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 < Vary: Accept-Language, Cookie
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 < Allow: GET, POST, HEAD, OPTIONS
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 < X-Frame-Options: deny
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 < Content-Type: application/json
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 response status: 200
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 body: {"maxFileSize": 2147483648, "hashAlgorithm": "sha1", "concurrency": 4, "chunkSize": 8388608, "maxRequestSize": 33554432, "url": "https://errors.myorg.nl/api/0/organizations/myorg/chunk-upload/", "chunksPerRequest": 64, "compression": ["gzip"]}
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 request GET http://dockerhost:9000/api/0/projects/myorg/projectname/releases/1.1.2/files/?cursor=
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 using token authentication
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 retry number 0, max retries: 0
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 > GET /api/0/projects/myorg/projectname/releases/1.1.2/files/?cursor= HTTP/1.1
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 > Host: dockerhost:9000
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 > Accept: */*
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 > Connection: TE
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 > TE: gzip
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 > User-Agent: sentry-cli/1.47.1
[14:19:25]  DEBUG   2019-08-06 14:19:25.042841 +02:00 > Authorization: Bearer 08cd752b***
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < HTTP/1.1 200 OK
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < Content-Length: 5809
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < X-XSS-Protection: 1; mode=block
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < X-Content-Type-Options: nosniff
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < Content-Language: en
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < Vary: Accept-Language, Cookie
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < Link: <https://errors.myorg.nl/api/0/projects/myorg/projectname/releases/1.1.2/files/?&cursor=100:-1:1>; rel="previous"; results="false"; cursor="100:-1:1", <https://errors.myorg.nl/api/0/projects/myorg/projectname/releases/1.1.2/files/?&cursor=100:1:0>; rel="next"; results="false"; cursor="100:1:0"
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < Allow: GET, POST, HEAD, OPTIONS
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < X-Frame-Options: deny
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 < Content-Type: application/json
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 response status: 200
[14:19:25]  DEBUG   2019-08-06 14:19:25.073786800 +02:00 body: [
    {"sha1": "bbb41cf40157b764c2a4101a4eee543ecaedec09", "dist": null, "name": "~/myprojectroot/assets/js/google-charts-presets.js",           "dateCreated": "2019-08-06T09:16:24.378Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40741", "size": 1793}
  , {"sha1": "67bdacbd077ee59f411109fd119ee9f58db15a5f", "dist": null, "name": "~/myprojectroot/assets/js/jquery-3.2.1.min.js",                "dateCreated": "2019-08-06T09:22:54.707Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40752", "size": 86663}
  , {"sha1": "34e2159935aa8d4ad1e98f97dcc73f675e08cb5c", "dist": null, "name": "~/myprojectroot/assets/js/underscore.mixin.deepExtend.js",     "dateCreated": "2019-08-06T09:22:55.219Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40758", "size": 3972}
  , {"sha1": "64727680c27a4131f16126af486c9d49e981f895", "dist": null, "name": "~/myprojectroot/main-es2015.6e0ca32c518bf11840fd.js",          "dateCreated": "2019-08-06T09:22:55.569Z", "headers": {"Sourcemap"   : "main-es2015.6e0ca32c518bf11840fd.js.map", "Content-Type": "application/octet-stream"}, "id": "40763", "size": 3319952}
  , {"sha1": "51075ca50e7659212dd852161f6e1dc064bc76eb", "dist": null, "name": "~/myprojectroot/main-es2015.6e0ca32c518bf11840fd.js.map",      "dateCreated": "2019-08-06T09:16:24.121Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40740", "size": 19689429}
  , {"sha1": "e712afc703c0e1a7db9e95ed9bc1df23c93dabc6", "dist": null, "name": "~/myprojectroot/main-es2015.c09ba01df98d6bb6ba6e.js",          "dateCreated": "2019-08-06T11:26:16.365Z", "headers": {"Sourcemap"   : "main-es2015.c09ba01df98d6bb6ba6e.js.map", "Content-Type": "application/octet-stream"}, "id": "40778", "size": 3319953}
  , {"sha1": "32e5b6442b6eb5a669c79b7512fbdaea7a207ea4", "dist": null, "name": "~/myprojectroot/main-es2015.c09ba01df98d6bb6ba6e.js.map",      "dateCreated": "2019-08-06T11:26:16.520Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40779", "size": 19689429}
  , {"sha1": "e3a7fdeb88192c9bae1fb3ea1e02be4c70a8400c", "dist": null, "name": "~/myprojectroot/main-es5.8b597e93c9d008da5ebe.js",             "dateCreated": "2019-08-06T09:16:24.522Z", "headers": {"Sourcemap"   : "main-es5.8b597e93c9d008da5ebe.js.map", "Content-Type": "application/octet-stream"}, "id": "40743", "size": 3579417}
  , {"sha1": "22a0cb7a281a0529d35b0e6acdd0f65ce786668a", "dist": null, "name": "~/myprojectroot/main-es5.f01dd61ed1f9da64dbec.js",             "dateCreated": "2019-08-06T11:26:16.013Z", "headers": {"Sourcemap"   : "main-es5.f01dd61ed1f9da64dbec.js.map", "Content-Type": "application/octet-stream"}, "id": "40772", "size": 3579418}
  , {"sha1": "ddf7288ed430665ca784c539562c494c05bf3fbd", "dist": null, "name": "~/myprojectroot/polyfills-es2015.0cc5377576d194f64fab.js",     "dateCreated": "2019-08-06T09:16:24.839Z", "headers": {"Sourcemap"   : "polyfills-es2015.0cc5377576d194f64fab.js.map", "Content-Type": "application/octet-stream"}, "id": "40747", "size": 41670}
  , {"sha1": "d217b46427ee0dc1b6afa2d06bfab1ca7443d320", "dist": null, "name": "~/myprojectroot/polyfills-es2015.0cc5377576d194f64fab.js.map", "dateCreated": "2019-08-06T09:16:24.427Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40742", "size": 214461}
  , {"sha1": "12a8f3b0da700c51b432e49f861b556aab132669", "dist": null, "name": "~/myprojectroot/polyfills-es5.b5b61f6726ab80db9eb1.js",        "dateCreated": "2019-08-06T09:16:24.943Z", "headers": {"Sourcemap"   : "polyfills-es5.b5b61f6726ab80db9eb1.js.map", "Content-Type": "application/octet-stream"}, "id": "40749", "size": 117557}
  , {"sha1": "c68c92ae0d772e5f52524ee373f50f5ec925ca64", "dist": null, "name": "~/myprojectroot/polyfills-es5.b5b61f6726ab80db9eb1.js.map",    "dateCreated": "2019-08-06T09:16:24.739Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40746", "size": 584802}
  , {"sha1": "b92ba971b5b14681fd40c9c2e101b8b8b053f0d5", "dist": null, "name": "~/myprojectroot/runtime-es2015.858f8dd898b75fe86926.js",       "dateCreated": "2019-08-06T09:16:24.897Z", "headers": {"Sourcemap"   : "runtime-es2015.858f8dd898b75fe86926.js.map", "Content-Type": "application/octet-stream"}, "id": "40748", "size": 1504}
  , {"sha1": "e802f48368f5edea63484d8272357c2c89b362ff", "dist": null, "name": "~/myprojectroot/runtime-es2015.858f8dd898b75fe86926.js.map",   "dateCreated": "2019-08-06T09:22:55.486Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40762", "size": 7969}
  , {"sha1": "84b2a90444e100ea9721228e5fd436c0f38b47b6", "dist": null, "name": "~/myprojectroot/runtime-es5.741402d1d47331ce975c.js",          "dateCreated": "2019-08-06T09:16:24.649Z", "headers": {"Sourcemap"   : "runtime-es5.741402d1d47331ce975c.js.map", "Content-Type": "application/octet-stream"}, "id": "40745", "size": 1501}
  , {"sha1": "b9c1b8191ab7cae0379b6d5b400ca5b17e073908", "dist": null, "name": "~/myprojectroot/runtime-es5.741402d1d47331ce975c.js.map",      "dateCreated": "2019-08-06T09:22:55.275Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40759", "size": 7966}
  , {"sha1": "d8e65882e096cad922113f2bd71eca6525f1d00a", "dist": null, "name": "~/myprojectroot/scripts.d941dc5eab1f45c0b068.js",              "dateCreated": "2019-08-06T09:16:24.606Z", "headers": {"Sourcemap"   : "scripts.d941dc5eab1f45c0b068.js.map", "Content-Type": "application/octet-stream"}, "id": "40744", "size": 71605}
  , {"sha1": "673204135d08826714fc188109332871cb527663", "dist": null, "name": "~/myprojectroot/scripts.d941dc5eab1f45c0b068.js.map",          "dateCreated": "2019-08-06T09:22:55.174Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40757", "size": 683154}
  , {"sha1": "b4ba5a779b96c62ada4c09e2c8a701810cf80bfa", "dist": null, "name": "~/myprojectroot/styles.8debd8c8dfeab96ebcae.myorgs.map",       "dateCreated": "2019-08-06T09:22:54.770Z", "headers": {"Content-Type": "application/octet-stream"}, "id": "40753", "size": 528126}]
[14:19:25]  DEBUG   2019-08-06 14:19:25.808813 +02:00 error: running update nagger
[14:19:25]  DEBUG   2019-08-06 14:19:25.808813 +02:00 skipping update nagger because session is not attended
[14:19:25]error: API request failed
[14:19:25]  caused by: [55] Failed sending data to the peer
[14:19:25]  DEBUG   2019-08-06 14:19:25.808813 +02:00 client close; no transport to shut down  (from sentry)

at about one third you see:

[14:19:25] DEBUG 2019-08-06 14:19:25.018939400 +02:00 < HTTP/1.1 208 ALREADY REPORTED

...likely indicating that this is an existing release, which is a situation that should be handled, but the actual error is only later on.

[mitsuhiko]

Thanks for the log. I will have a look at this and see what the root cause might be. I believe the error reported in the last comment is unrelated to the actual issue here.

[pengshaosu]

I get the error:

error: API request failed
  caused by: [55] Failed sending data to the peer
  DEBUG   2019-08-12 14:39:52.874055300 +08:00 client close; no transport to shut down  (from sentry)

How to resolve it?

[pengshaosu]

@Atrejoe
Hi,
Has any graceful info about the issue, still notworking when i uploading source-map.

[Atrejoe]

@BYK Do you know if this will be included into a release and if releases are planned?
We are using official Docker images. Do we need to switch to building our own images?

[BYK]

@Atrejoe for folks using the onpremise repo, it should be resolved after https://github.com/getsentry/onpremise/pull/237/files

If you are only using the Docker images, we probably should update the default configuration in them too but not sure that'd be the best for everyone.

Anyway, if you need this fix ASAP, you can simply apply the changes from https://github.com/getsentry/onpremise/pull/237/files to your own config file and you should be good to go.

[Atrejoe]

@BYK I can confirm that adjusting this config works.

For people using Docker from the command line (or batch files), adding this fixed it!

    -e SENTRY_WEB_OPTIONS={'protocol':'uwsgi','uwsgi-socket':'None','http-keepalive':true,'memory-report':false}