Onpremise: sentry/images/* missing on 20.10.1

Created on 28 Oct 2020 · 7Comments · Source: getsentry/onpremise

Version Information

FYI: Most of the text is logs - dont be scared of the wall :)

Version: 20.10.1
.env:

SENTRY_IMAGE=getsentry/sentry:20.10.1
SNUBA_IMAGE=getsentry/snuba:20.10.1
RELAY_IMAGE=getsentry/relay:20.10.1
SYMBOLICATOR_IMAGE=getsentry/symbolicator:0.2.0

Description

I have two different environments, one nightly and one release.
The favicon did not work for the release env. So I started to investigate thinking this was an https issue. After a bit of a time I realised that the favicon was not present on the web container. Nor _static/1603895540/sentry/images/*

From the web container

find / -name *.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/chrome.d2ea9d.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/arm.7cd0a3.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/internet-explorer.728900.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/empty-app-icon-180x180.7192a9.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/sentry-robot.f8ee35.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/ubuntu.0f89b7.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/windows.029c1a.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/nvidia.1e694a.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/linux.6ea05f.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/codesworth.40f8f9.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/electron.444f6c.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/edge.f1ae44.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/amd.9a9448.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/qq-browser.1c7c14.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/android.4e24c6.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/sentry-avatar.5e48e0.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/chromium.c60ec2.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/playstation.c46c60.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/safari.862df2.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/sentry-pattern.a141b8.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/opera.ef8ba7.png
/usr/local/lib/python2.7/site-packages/rest_framework/static/rest_framework/img/glyphicons-halflings-white.png
/usr/local/lib/python2.7/site-packages/rest_framework/static/rest_framework/img/grid.png
/usr/local/lib/python2.7/site-packages/rest_framework/static/rest_framework/img/glyphicons-halflings.png
/usr/local/lib/python2.7/site-packages/rest_framework/static/rest_framework/docs/img/grid.png
/usr/local/lib/python2.7/site-packages/celery/utils/static/celery_128.png
/usr/local/lib/python2.7/idlelib/Icons/idle_32.png
/usr/local/lib/python2.7/idlelib/Icons/idle_16.png
/usr/local/lib/python2.7/idlelib/Icons/idle_48.png
/usr/share/pixmaps/debian-logo.png
/usr/share/gtk-doc/html/p11-kit/up.png
/usr/share/gtk-doc/html/p11-kit/left.png
/usr/share/gtk-doc/html/p11-kit/home.png
/usr/share/gtk-doc/html/p11-kit/right.png
/usr/share/gtk-doc/html/p11-kit/up-insensitive.png
/usr/share/gtk-doc/html/p11-kit/right-insensitive.png
/usr/share/gtk-doc/html/p11-kit/left-insensitive.png

Where on the nightlys web container:

root@4f6327ea49b5:/# find / -name *.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/spot/sentry-robot.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/spot/codesworth.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/sentry-glyph-black.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/pattern/sentry-pattern.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/sentry-email-avatar.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/sentry-pattern.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/circle-bottom-right.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/icon-circle-exclamation.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/circle-middle-right.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/arrow-increase.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/circle-middle-left.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/circle-top-right.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/circle-bg.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/sentry_logo_mark.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/circle-top-left.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/sentry_logo_full.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/circle-bottom-center.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/circle-top-center.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/arrow-decrease.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/avatar-notch.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/circle-bottom-left.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/email/icon-warning.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/empty-app-icon-180x180.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/apple-touch-icon-152x152.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/default-organization-logo.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/apple-touch-icon-76x76.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/sentry-avatar.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/apple-touch-icon-120x120.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/apple-touch-icon.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/nvidia.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/linux.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/arm.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/windows.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/qq-browser.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/amd.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/safari.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/android.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/edge.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/opera.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/chrome.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/internet-explorer.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/electron.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/ubuntu.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/playstation.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/logos/context/chromium.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/favicon_dev.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/python128x128.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/rails48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/ios48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/java48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/ruby48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/python48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/django48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/go48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/javascript48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/php48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/platforms/node48x48.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/favicon.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/screenshots/thumb-1.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/screenshots/thumb-3.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/screenshots/thumb-2.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/images/favicon-dark.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/chrome.d2ea9d.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/arm.7cd0a3.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/internet-explorer.728900.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/empty-app-icon-180x180.7192a9.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/sentry-robot.f8ee35.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/ubuntu.0f89b7.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/windows.029c1a.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/nvidia.1e694a.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/linux.6ea05f.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/codesworth.40f8f9.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/electron.444f6c.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/edge.f1ae44.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/amd.9a9448.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/qq-browser.1c7c14.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/android.4e24c6.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/sentry-avatar.5e48e0.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/chromium.c60ec2.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/playstation.c46c60.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/safari.862df2.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/sentry-pattern.a141b8.png
/usr/local/lib/python2.7/site-packages/sentry/static/sentry/dist/opera.ef8ba7.png
/usr/local/lib/python2.7/site-packages/rest_framework/static/rest_framework/img/glyphicons-halflings-white.png
/usr/local/lib/python2.7/site-packages/rest_framework/static/rest_framework/img/grid.png
/usr/local/lib/python2.7/site-packages/rest_framework/static/rest_framework/img/glyphicons-halflings.png
/usr/local/lib/python2.7/site-packages/rest_framework/static/rest_framework/docs/img/grid.png
/usr/local/lib/python2.7/site-packages/celery/utils/static/celery_128.png
/usr/local/lib/python2.7/idlelib/Icons/idle_32.png
/usr/local/lib/python2.7/idlelib/Icons/idle_16.png
/usr/local/lib/python2.7/idlelib/Icons/idle_48.png
/usr/share/pixmaps/debian-logo.png
/usr/share/gtk-doc/html/p11-kit/up.png
/usr/share/gtk-doc/html/p11-kit/left.png
/usr/share/gtk-doc/html/p11-kit/home.png
/usr/share/gtk-doc/html/p11-kit/right.png
/usr/share/gtk-doc/html/p11-kit/up-insensitive.png
/usr/share/gtk-doc/html/p11-kit/right-insensitive.png
/usr/share/gtk-doc/html/p11-kit/left-insensitive.png

Steps to Reproduce

set .env to use the latest release:

SENTRY_IMAGE=getsentry/sentry:20.10.1
SNUBA_IMAGE=getsentry/snuba:20.10.1
RELAY_IMAGE=getsentry/relay:20.10.1
SYMBOLICATOR_IMAGE=getsentry/symbolicator:0.2.0

docker-compose down
docker image prune -a
./install
docker-compose up -d
Cry a bit due to lack of favicon like its 1990's

Logs

Please share any applicable logs:

ls -1 sentry_install_log-*.txt | tail -1 | xargs cat # latest instal logs

`sentry@sentry:~/sentryOnPrem$ ls -1 sentry_install_log-*.txt | tail -1 | xargs cat # latest instal logs
Checking minimum requirements...

Creating volumes for persistent storage...
Created sentry-data.
Created sentry-postgres.
Created sentry-redis.
Created sentry-zookeeper.
Created sentry-kafka.
Created sentry-clickhouse.
Created sentry-symbolicator.

sentry/sentry.conf.py already exists, skipped creation.
sentry/config.yml already exists, skipped creation.
sentry/requirements.txt already exists, skipped creation.
symbolicator/config.yml already exists, skipped creation.
relay/config.yml already exists, skipped creation.

Fetching and updating Docker images...

Some service image(s) must be built from source by running:
    docker-compose build worker web snuba-cleanup cron ingest-consumer symbolicator-cleanup post-process-forwarder
20.10.1: Pulling from getsentry/sentry
8d691f585fa8: Pulling fs layer
3fd6980f9df6: Pulling fs layer
c4f890363b98: Pulling fs layer
b8cfb9853b0a: Pulling fs layer
03a65e68bd5f: Pulling fs layer
74fd7792bf9a: Pulling fs layer
bb2024cd6bbc: Pulling fs layer
e74fa5de680f: Pulling fs layer
dae0eea108a7: Pulling fs layer
07cc196e1a97: Pulling fs layer
1881e2b0218c: Pulling fs layer
0b6965ef0fc9: Pulling fs layer
5df780d49856: Pulling fs layer
ac2e6fded9c0: Pulling fs layer
b8cfb9853b0a: Waiting
03a65e68bd5f: Waiting
74fd7792bf9a: Waiting
bb2024cd6bbc: Waiting
e74fa5de680f: Waiting
dae0eea108a7: Waiting
07cc196e1a97: Waiting
1881e2b0218c: Waiting
0b6965ef0fc9: Waiting
5df780d49856: Waiting
ac2e6fded9c0: Waiting
3fd6980f9df6: Verifying Checksum
3fd6980f9df6: Download complete
b8cfb9853b0a: Verifying Checksum
b8cfb9853b0a: Download complete
03a65e68bd5f: Verifying Checksum
03a65e68bd5f: Download complete
74fd7792bf9a: Verifying Checksum
74fd7792bf9a: Download complete
c4f890363b98: Verifying Checksum
c4f890363b98: Download complete
bb2024cd6bbc: Verifying Checksum
bb2024cd6bbc: Download complete
8d691f585fa8: Verifying Checksum
8d691f585fa8: Download complete
8d691f585fa8: Pull complete
3fd6980f9df6: Pull complete
c4f890363b98: Pull complete
b8cfb9853b0a: Pull complete
03a65e68bd5f: Pull complete
74fd7792bf9a: Pull complete
bb2024cd6bbc: Pull complete
dae0eea108a7: Verifying Checksum
dae0eea108a7: Download complete
1881e2b0218c: Verifying Checksum
1881e2b0218c: Download complete
0b6965ef0fc9: Verifying Checksum
0b6965ef0fc9: Download complete
07cc196e1a97: Verifying Checksum
07cc196e1a97: Download complete
5df780d49856: Verifying Checksum
5df780d49856: Download complete
ac2e6fded9c0: Verifying Checksum
ac2e6fded9c0: Download complete
e74fa5de680f: Verifying Checksum
e74fa5de680f: Download complete
e74fa5de680f: Pull complete
dae0eea108a7: Pull complete
07cc196e1a97: Pull complete
1881e2b0218c: Pull complete
0b6965ef0fc9: Pull complete
5df780d49856: Pull complete
ac2e6fded9c0: Pull complete
Digest: sha256:c7f37d609b43fdafcb643655ab0d48c21d503e2b390928a5db67253bee4781e2
Status: Downloaded newer image for getsentry/sentry:20.10.1
docker.io/getsentry/sentry:20.10.1

Building and tagging Docker images...

Building web
Step 1/5 : ARG SENTRY_IMAGE
Step 2/5 : ARG SENTRY_PYTHON3
Step 3/5 : FROM ${SENTRY_IMAGE}${SENTRY_PYTHON3:+-py3}
 ---> b81fbb0a7446
Step 4/5 : COPY . /usr/src/sentry
 ---> 10d297fcd033
Step 5/5 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
 ---> Running in 4b70649732ba
/usr/local/lib/python2.7/site-packages/OpenSSL/crypto.py:12: CryptographyDeprecationWarning: Python 2 is no longer supported by the Python core team. Support for it is now deprecated in cryptography, and will be removed in a future release.
  from cryptography import x509
DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support
Removing intermediate container 4b70649732ba
 ---> 21e9cbf31296

Successfully built 21e9cbf31296
Successfully tagged sentry-onpremise-local:latest
zookeeper uses an image, skipping
clickhouse uses an image, skipping
memcached uses an image, skipping
postgres uses an image, skipping
redis uses an image, skipping
symbolicator uses an image, skipping
kafka uses an image, skipping
snuba-transactions-consumer uses an image, skipping
relay uses an image, skipping
snuba-sessions-consumer uses an image, skipping
snuba-consumer uses an image, skipping
snuba-outcomes-consumer uses an image, skipping
snuba-replacer uses an image, skipping
snuba-api uses an image, skipping
smtp uses an image, skipping
nginx uses an image, skipping
Building symbolicator-cleanup   ...
Building snuba-cleanup          ...
Building ingest-consumer        ...
Building web                    ...
Building cron                   ...
Building worker                 ...
Building post-process-forwarder ...
Building ingest-consumer
Building post-process-forwarder
Building symbolicator-cleanup
Building web
Building cron
Step 1/5 : ARG SENTRY_IMAGE
Step 2/5 : ARG SENTRY_PYTHON3
Step 3/5 : FROM ${SENTRY_IMAGE}${SENTRY_PYTHON3:+-py3}
 ---> b81fbb0a7446
Step 4/5 : COPY . /usr/src/sentry
 ---> Using cache
 ---> 10d297fcd033
Step 5/5 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
 ---> Using cache
 ---> 21e9cbf31296

Successfully built 21e9cbf31296
Successfully tagged sentry-onpremise-local:latest
Building ingest-consumer        ... done
Building snuba-cleanup
Step 1/5 : ARG SENTRY_IMAGE
Step 2/5 : ARG SENTRY_PYTHON3
Step 3/5 : FROM ${SENTRY_IMAGE}${SENTRY_PYTHON3:+-py3}
 ---> b81fbb0a7446
Step 4/5 : COPY . /usr/src/sentry
 ---> Using cache
 ---> 10d297fcd033
Step 5/5 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
 ---> Using cache
 ---> 21e9cbf31296

Successfully built 21e9cbf31296
Step 1/5 : ARG SENTRY_IMAGE
Step 2/5 : ARG SENTRY_PYTHON3
Step 3/5 : FROM ${SENTRY_IMAGE}${SENTRY_PYTHON3:+-py3}
Step 1/5 : ARG BASE_IMAGE
Step 2/5 : FROM ${BASE_IMAGE}
Successfully tagged sentry-onpremise-local:latest
Building post-process-forwarder ... done
Building worker
 ---> f91ead8550da
Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron &&     rm -r /var/lib/apt/lists/*
 ---> b81fbb0a7446
Step 4/5 : COPY . /usr/src/sentry
 ---> Using cache
 ---> 10d297fcd033
Step 5/5 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
 ---> Using cache
 ---> 21e9cbf31296

Successfully built 21e9cbf31296
Successfully tagged sentry-onpremise-local:latest
Building cron                   ... done
Step 1/5 : ARG SENTRY_IMAGE
Step 2/5 : ARG SENTRY_PYTHON3
Step 3/5 : FROM ${SENTRY_IMAGE}${SENTRY_PYTHON3:+-py3}
 ---> b81fbb0a7446
Step 4/5 : COPY . /usr/src/sentry
 ---> Using cache
 ---> 10d297fcd033
Step 5/5 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
 ---> Using cache
 ---> 21e9cbf31296

Successfully built 21e9cbf31296
Successfully tagged sentry-onpremise-local:latest
Building web                    ... done
 ---> Running in 9f591a73d490
Step 1/5 : ARG BASE_IMAGE
Step 2/5 : FROM ${BASE_IMAGE}
 ---> 1563b0e59ae1
Step 3/5 : RUN apt-get update && apt-get install -y --no-install-recommends cron &&     rm -r /var/lib/apt/lists/*
Step 1/5 : ARG SENTRY_IMAGE
Step 2/5 : ARG SENTRY_PYTHON3
Step 3/5 : FROM ${SENTRY_IMAGE}${SENTRY_PYTHON3:+-py3}
 ---> b81fbb0a7446
Step 4/5 : COPY . /usr/src/sentry
 ---> Using cache
 ---> 10d297fcd033
Step 5/5 : RUN if [ -s /usr/src/sentry/requirements.txt ]; then pip install -r /usr/src/sentry/requirements.txt; fi
 ---> Using cache
 ---> 21e9cbf31296

Successfully built 21e9cbf31296
Successfully tagged sentry-onpremise-local:latest
Building worker                 ... done
 ---> Running in 69a35165a1a6
Get:1 http://security.debian.org/debian-security stretch/updates InRelease [53.0 kB]
Ign:2 http://deb.debian.org/debian stretch InRelease
Get:3 http://deb.debian.org/debian stretch-updates InRelease [93.6 kB]
Get:4 http://deb.debian.org/debian stretch Release [118 kB]
Get:1 http://security.debian.org/debian-security buster/updates InRelease [65.4 kB]
Get:2 http://deb.debian.org/debian buster InRelease [121 kB]
Get:5 http://deb.debian.org/debian stretch Release.gpg [2410 B]
Get:3 http://deb.debian.org/debian buster-updates InRelease [51.9 kB]
Get:6 http://security.debian.org/debian-security stretch/updates/main amd64 Packages [606 kB]
Get:4 http://security.debian.org/debian-security buster/updates/main amd64 Packages [243 kB]
Get:7 http://deb.debian.org/debian stretch-updates/main amd64 Packages [2596 B]
Get:5 http://deb.debian.org/debian buster/main amd64 Packages [7906 kB]
Get:8 http://deb.debian.org/debian stretch/main amd64 Packages [7080 kB]
Get:6 http://deb.debian.org/debian buster-updates/main amd64 Packages [7856 B]
Fetched 8396 kB in 3s (2812 kB/s)
Reading package lists...Fetched 7956 kB in 3s (2623 kB/s)
Reading package lists...
Reading package lists...
Reading package lists...
Building dependency tree...
Reading state information...

Building dependency tree...Suggested packages:
  anacron logrotate checksecurity
Recommended packages:
  exim4 | postfix | mail-transport-agent
The following NEW packages will be installed:
  cron
0 upgraded, 1 newly installed, 0 to remove and 0 not upgraded.
Need to get 95.4 kB of archives.
After this operation, 257 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian stretch/main amd64 cron amd64 3.0pl1-128+deb9u1 [95.4 kB]

Reading state information...
The following additional packages will be installed:
  lsb-base sensible-utils
Suggested packages:
  anacron logrotate checksecurity
Recommended packages:
  default-mta | mail-transport-agent
debconf: delaying package configuration, since apt-utils is not installed
The following NEW packages will be installed:
  cron lsb-base sensible-utils
Fetched 95.4 kB in 0s (2085 kB/s)
0 upgraded, 3 newly installed, 0 to remove and 1 not upgraded.
Need to get 143 kB of archives.
After this operation, 383 kB of additional disk space will be used.
Get:1 http://deb.debian.org/debian buster/main amd64 sensible-utils all 0.0.12 [15.8 kB]
Selecting previously unselected package cron.
Get:2 http://deb.debian.org/debian buster/main amd64 lsb-base all 10.2019051400 [28.4 kB]
(Reading database ... 6661 files and directories currently installed.)
Preparing to unpack .../cron_3.0pl1-128+deb9u1_amd64.deb ...
Get:3 http://deb.debian.org/debian buster/main amd64 cron amd64 3.0pl1-134+deb10u1 [99.0 kB]
Unpacking cron (3.0pl1-128+deb9u1) ...
debconf: delaying package configuration, since apt-utils is not installed
Fetched 143 kB in 0s (2500 kB/s)
Selecting previously unselected package sensible-utils.
Setting up cron (3.0pl1-128+deb9u1) ...
(Reading database ... 6829 files and directories currently installed.)
Preparing to unpack .../sensible-utils_0.0.12_all.deb ...
Unpacking sensible-utils (0.0.12) ...
Selecting previously unselected package lsb-base.
Preparing to unpack .../lsb-base_10.2019051400_all.deb ...
Unpacking lsb-base (10.2019051400) ...
Adding group `crontab' (GID 101) ...
Done.
Selecting previously unselected package cron.
Preparing to unpack .../cron_3.0pl1-134+deb10u1_amd64.deb ...
Unpacking cron (3.0pl1-134+deb10u1) ...
update-rc.d: warning: start and stop actions are no longer supported; falling back to defaults
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Setting up lsb-base (10.2019051400) ...
Setting up sensible-utils (0.0.12) ...
Setting up cron (3.0pl1-134+deb10u1) ...
Adding group `crontab' (GID 101) ...
Done.
invoke-rc.d: could not determine current runlevel
invoke-rc.d: policy-rc.d denied execution of start.
Removing intermediate container 9f591a73d490
 ---> d91093def4e2
Step 4/5 : COPY entrypoint.sh /entrypoint.sh
 ---> 491991829606
Step 5/5 : ENTRYPOINT ["/entrypoint.sh"]
 ---> Running in 16de4bf8526e
Removing intermediate container 16de4bf8526e
 ---> cf8ee72a6950

Successfully built cf8ee72a6950
Successfully tagged symbolicator-cleanup-onpremise-local:latest
Building symbolicator-cleanup   ... done
Removing intermediate container 69a35165a1a6
 ---> 905ee3556648
Step 4/5 : COPY entrypoint.sh /entrypoint.sh
 ---> ddfc0c79beeb
Step 5/5 : ENTRYPOINT ["/entrypoint.sh"]
 ---> Running in 99c66179351c
Removing intermediate container 99c66179351c
 ---> 5cf679874181

Successfully built 5cf679874181
Successfully tagged snuba-cleanup-onpremise-local:latest
Building snuba-cleanup          ... done

Docker images built.
Removing network onpremise_default
Network onpremise_default not found.
Removing network sentry_onpremise_default
Network sentry_onpremise_default not found.
Creating network "sentry_onpremise_default" with the default driver
Bootstrapping and migrating Snuba...
Creating sentry_onpremise_redis_1 ...
Creating sentry_onpremise_clickhouse_1 ...
Creating sentry_onpremise_zookeeper_1  ...
Creating sentry_onpremise_redis_1      ... done
Creating sentry_onpremise_clickhouse_1 ... done
Creating sentry_onpremise_zookeeper_1  ... done
Creating sentry_onpremise_kafka_1      ...
Creating sentry_onpremise_kafka_1      ... done
+ '[' b = - ']'
+ snuba bootstrap --help
+ set -- snuba bootstrap --no-migrate --force
+ set gosu snuba snuba bootstrap --no-migrate --force
+ exec gosu snuba snuba bootstrap --no-migrate --force
%3|1603914422.904|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.128.5:9092 failed: Connection refused (after 2ms in state CONNECT)
%3|1603914423.902|FAIL|rdkafka#producer-1| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.128.5:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
2020-10-28 19:47:03,904 Connection to Kafka failed (attempt 0)
Traceback (most recent call last):
  File "/usr/src/snuba/snuba/cli/bootstrap.py", line 58, in bootstrap
    client.list_topics(timeout=1)
cimpl.KafkaException: KafkaError{code=_TRANSPORT,val=-195,str="Failed to get metadata: Local: Broker transport failure"}
%3|1603914424.906|FAIL|rdkafka#producer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.128.5:9092 failed: Connection refused (after 0ms in state CONNECT)
%3|1603914425.907|FAIL|rdkafka#producer-2| [thrd:kafka:9092/bootstrap]: kafka:9092/bootstrap: Connect to ipv4#192.168.128.5:9092 failed: Connection refused (after 0ms in state CONNECT, 1 identical error(s) suppressed)
2020-10-28 19:47:05,909 Connection to Kafka failed (attempt 1)
Traceback (most recent call last):
  File "/usr/src/snuba/snuba/cli/bootstrap.py", line 58, in bootstrap
    client.list_topics(timeout=1)
cimpl.KafkaException: KafkaError{code=_TRANSPORT,val=-195,str="Failed to get metadata: Local: Broker transport failure"}
2020-10-28 19:47:07,723 Failed to create topic events
Traceback (most recent call last):
  File "/usr/src/snuba/snuba/cli/bootstrap.py", line 94, in bootstrap
    future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 439, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
cimpl.KafkaException: KafkaError{code=TOPIC_ALREADY_EXISTS,val=36,str="Topic 'events' already exists."}
2020-10-28 19:47:07,725 Failed to create topic ingest-sessions
Traceback (most recent call last):
  File "/usr/src/snuba/snuba/cli/bootstrap.py", line 94, in bootstrap
    future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 432, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
cimpl.KafkaException: KafkaError{code=TOPIC_ALREADY_EXISTS,val=36,str="Topic 'ingest-sessions' already exists."}
2020-10-28 19:47:07,726 Failed to create topic cdc
Traceback (most recent call last):
  File "/usr/src/snuba/snuba/cli/bootstrap.py", line 94, in bootstrap
    future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 432, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
cimpl.KafkaException: KafkaError{code=TOPIC_ALREADY_EXISTS,val=36,str="Topic 'cdc' already exists."}
2020-10-28 19:47:07,727 Failed to create topic event-replacements
Traceback (most recent call last):
  File "/usr/src/snuba/snuba/cli/bootstrap.py", line 94, in bootstrap
    future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 432, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
cimpl.KafkaException: KafkaError{code=TOPIC_ALREADY_EXISTS,val=36,str="Topic 'event-replacements' already exists."}
2020-10-28 19:47:07,728 Failed to create topic snuba-commit-log
Traceback (most recent call last):
  File "/usr/src/snuba/snuba/cli/bootstrap.py", line 94, in bootstrap
    future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 432, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
cimpl.KafkaException: KafkaError{code=TOPIC_ALREADY_EXISTS,val=36,str="Topic 'snuba-commit-log' already exists."}
2020-10-28 19:47:07,730 Failed to create topic errors-replacements
Traceback (most recent call last):
  File "/usr/src/snuba/snuba/cli/bootstrap.py", line 94, in bootstrap
    future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 432, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
cimpl.KafkaException: KafkaError{code=TOPIC_ALREADY_EXISTS,val=36,str="Topic 'errors-replacements' already exists."}
2020-10-28 19:47:07,731 Failed to create topic outcomes
Traceback (most recent call last):
  File "/usr/src/snuba/snuba/cli/bootstrap.py", line 94, in bootstrap
    future.result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 432, in result
    return self.__get_result()
  File "/usr/local/lib/python3.8/concurrent/futures/_base.py", line 388, in __get_result
    raise self._exception
cimpl.KafkaException: KafkaError{code=TOPIC_ALREADY_EXISTS,val=36,str="Topic 'outcomes' already exists."}
Starting sentry_onpremise_zookeeper_1 ...
Starting sentry_onpremise_redis_1     ...
Starting sentry_onpremise_zookeeper_1 ... done
Starting sentry_onpremise_clickhouse_1 ...
Starting sentry_onpremise_redis_1      ... done
Starting sentry_onpremise_kafka_1      ...
Starting sentry_onpremise_clickhouse_1 ... done
Starting sentry_onpremise_kafka_1      ... done
+ '[' m = - ']'
+ snuba migrations --help
+ set -- snuba migrations migrate --force
+ set gosu snuba snuba migrations migrate --force
+ exec gosu snuba snuba migrations migrate --force
Finished running migrations


Setting up database...
Creating sentry_onpremise_smtp_1 ...
Creating sentry_onpremise_postgres_1 ...
Creating sentry_onpremise_symbolicator_1 ...
Starting sentry_onpremise_redis_1        ...
Creating sentry_onpremise_memcached_1    ...
Starting sentry_onpremise_redis_1        ... done
Starting sentry_onpremise_zookeeper_1    ...
Starting sentry_onpremise_clickhouse_1   ...
Starting sentry_onpremise_zookeeper_1    ... done
Starting sentry_onpremise_clickhouse_1   ... done
Starting sentry_onpremise_kafka_1        ...
Starting sentry_onpremise_kafka_1        ... done
Creating sentry_onpremise_snuba-replacer_1 ...
Creating sentry_onpremise_snuba-transactions-consumer_1 ...
Creating sentry_onpremise_snuba-outcomes-consumer_1     ...
Creating sentry_onpremise_snuba-api_1                   ...
Creating sentry_onpremise_snuba-sessions-consumer_1     ...
Creating sentry_onpremise_snuba-consumer_1              ...
Creating sentry_onpremise_postgres_1                    ... done
Creating sentry_onpremise_smtp_1                        ... done
Creating sentry_onpremise_memcached_1                   ... done
Creating sentry_onpremise_symbolicator_1                ... done
Creating sentry_onpremise_snuba-outcomes-consumer_1     ... done
Creating sentry_onpremise_snuba-consumer_1              ... done
Creating sentry_onpremise_snuba-transactions-consumer_1 ... done
Creating sentry_onpremise_snuba-sessions-consumer_1     ... done
Creating sentry_onpremise_snuba-api_1                   ... done
Creating sentry_onpremise_snuba-replacer_1              ... done
19:47:25 [WARNING] sentry.utils.geo: settings.GEOIP_PATH_MMDB not configured.
/usr/local/lib/python2.7/site-packages/OpenSSL/crypto.py:12: CryptographyDeprecationWarning: Python 2 is no longer supported by the Python core team. Support for it is now deprecated in cryptography, and will be removed in a future release.
  from cryptography import x509
19:47:33 [INFO] sentry.plugins.github: apps-not-configured
Operations to perform:
  Apply all migrations: admin, auth, contenttypes, jira_ac, nodestore, sentry, sessions, sites, social_auth
Running migrations:
  No migrations to apply.
Creating missing DSNs
Correcting Group.num_comments counter
Unable to find image 'alpine:latest' locally
latest: Pulling from library/alpine
188c0c94c7c5: Already exists
Digest: sha256:c0e9560cda118f9ec63ddefb4a173a2b2a0347082d7dff7dc14272e7841a5b5a
Status: Downloaded newer image for alpine:latest

----------------
You're all done! Run the following command to get Sentry running:

  docker-compose up -d

sentry@sentry:~/sentryOnPrem$

Bug

Source

AlexanderRydberg

All 7 comments

https://github.com/getsentry/sentry/blob/20.10.1/setup.py#L108-L109
vs
https://github.com/getsentry/sentry/blob/master/setup.py#L108-L113

@BYK I guess you fixed it in the new release ;) ?

AlexanderRydberg on 29 Oct 2020

@AlexanderRydberg yeah #21475 and #21461 resolved this. Sorry for the inconvenience :)

The fixes will be out, latest November 16th with the 20.11.0 release or a potential 20.10.2 release in the coming days.

The 404s and lack of favicons should be harmless other than making you cry a little bit as you mentioned 😉

BYK on 29 Oct 2020

😄1

I guess there is also javascript parts that are not loading in 20.10.1, not just images. Are you testing the releases for functionality or is this planned for the future? For now, we're gonna stay on 20.09

max-wittig on 1 Dec 2020

@max-wittig we do test the releases for event ingestion for each commit. The issue here was us optimizing the packaging and not realizing this was stripping some needed files too as we rely on the acceptance tests that are part of our CI builds but not after the packaging step.

Anyway, 20.10.1 should be fine, the missing ads.js file is a dummy file to detect adblockers to show a message and this was remedied in future versions. I recommend switching to 20.11.1 at this point.

BYK on 1 Dec 2020

We're a bit scared of the QA now as we had a few problems in the past with sentry (see: https://github.com/getsentry/onpremise/issues/723), so we usually wait at least a month. This again shows, that we never want to be on the latest release. But we will catch up next year 😉

max-wittig on 1 Dec 2020

@max-wittig runnin self-hosted Sentry at scale is always risky, don't expect that risk to get reduced if you use an older version as the setup is quite different that what we are running on production and is geared towards smaller instances.

We may add some load testing in the future to detect #723-like situations earlier.

Would love to increase your confidence in releases though :)

//cc @chadwhitacre

BYK on 1 Dec 2020

The risk get's reduced a bit by others upgrading early and finding and reporting problems 😉 . We also have a dev, stage and prod setup.

Adding load testing tests would be nice. Btw. thanks for all the work, you're putting into the source available version of sentry 👍

max-wittig on 1 Dec 2020

❤1

Was this page helpful?

0 / 5 - 0 ratings