Breaking Glass on Database

Breaking glass on the production or staging database is a way to save production or staging outages if something extreme happens that cannot be patched with software patches. Staging is the wild-west, so we can just curl -X POST if we need to truncate all of the tables in staging.

Getting to the Database on an AWS Instance

To break glass,
  1. 1.
    Sign into the AWS management console and open up cloudshell
    Windows task manager virtualization check
  2. 2.
    In cloudshell, clone civiform: git clone
  3. 3.
    In cloudshell, run civiform's bin/breakglass-db-access prod script to break glass into prod. Or just bin/breakglass-db-access to break glass into staging. The breakglass-db-access script puts you directly in psql shell connected to the production or staging environment.
  4. 4.
    Make sure to exit out of the postgresql shell by running \q or pressing ctrl + d to terminate the ec2 instance and delete the emergency DB security group, or you may need to manually clean things up afterwards.
  5. 5.
    To manually clean up any instances, go to EC2 console and terminate any remaining instances and delete any keys.
    AWS EC2 console page

Getting to the Database on an Azure Instance