Web: as a developer, i want stage server to always have a fresh prod backup on it, so i can stage latest data

Created on 14 Feb 2018  路  6Comments  路  Source: gitcoinco/web

requirements:

  • stage server should download / restore backup from prod on it nightly
Gitcoin Internal Tool Gitcoin.co

Most helpful comment

I'm going to add this as a subtask to the multi-QA environment project.

Seems like it'd be easiest to run jobs on QA env spinup to:

  • Fetch the latest prod backup from S3
  • Import DB dump into the QA db
  • Execute migrations
  • Update all media asset fields entries for staging (avatar assets are stored in a different bucket and subdomain on staging).

All 6 comments

Do we still want this ?

I'm going to add this as a subtask to the multi-QA environment project.

Seems like it'd be easiest to run jobs on QA env spinup to:

  • Fetch the latest prod backup from S3
  • Import DB dump into the QA db
  • Execute migrations
  • Update all media asset fields entries for staging (avatar assets are stored in a different bucket and subdomain on staging).

This would be nice - maybe we can organize an epic/project board for staging resurrection and improvements? what do you think @kuhnchris would you be interested in organizing it?

@danlipert sure, interested yes - it only makes sense for "big" changes tho, or for test cycles (e.a. either on demand or during the test cycles before deployment) - anything particular you need me to think this through?

if we do this, we need to harden the stage servers to prevent prod data leaks. (put the web interface behind a password is probably the first step)

yes, either that - or use a system like Guacamole for remote access, or require a VPN (openVPN + docker is so easily set up, it's a crime)

Was this page helpful?
0 / 5 - 0 ratings

Related issues

frankchen07 picture frankchen07  路  4Comments

kziemianek picture kziemianek  路  3Comments

Skyge picture Skyge  路  3Comments

wizzfile picture wizzfile  路  3Comments

sethmcleod picture sethmcleod  路  4Comments