Heroku Advent Calendar 2016 Day 6 article. I've been writing Heroku's Advent Calendar for about three years in a row, no matter what.

Introduction.

I was inspired by this article by Crowdworks.

Things to do when running a production service in Heroku & configuration examples

I created a Docker container that can execute the following shell commands, which I did in the above article Adding a preview environment that can synchronize data with production.

• Copy Heroku Postgres from the Production environment to the Staging environment
• Mask personal information from the copied DB
• Synchronize the Puroduction environment bucket in AWS S3 to the Staging environment bucket

I'm deploying this Docker container to Heroku.

As you can see, Heroku has a mechanism to deploy Docker containers, which is not well known, but it is actually made before you know it.
https://devcenter.heroku.com/articles/container-registry-and-runtime

In order to run the backup command in heroku or the CLI in AWS, as in this case
Rather than making an existing build pack (or rather, a build pack that could do something about it, but I haven't looked it up)
I think it's more convenient to create Docker container because it's easier to check the operation on the development machine.

In the case of Docker container, if you can deploy Docker container other than Heroku, you can build it in any cloud environment, even in a suitable internal server, I think it is a good point.

Remote Repository

Github.

https://github.com/konyu/heroku-aws-backup

Docker hub

https://hub.docker.com/r/konyu/heroku-aws-backup/

How to get an API key for AWS and Heroku

Obtain the AWS and Heroku API keys in advance and make a note of them

The URLs for each method are as follows

AWS access key and secret key

http://docs.aws.amazon.com/AWSSimpleQueueService/latest/SQSGettingStartedGuide/AWSCredentials.html

Heroku api token

https://devcenter.heroku.com/articles/authentication#api-token-storage

How to build in the local environment

git@github.com:konyu/heroku-aws-backup.git
cd heroku-aws-backup
docker build --rm -t heroku-aws-backup .

Local startup method

Start with AWS and Heroku environment variables in --env

docker run -it --rm --env AWS_ACCESS_KEY_ID=xxxxxxx\fnDroid
--env AWS_SECRET_ACCESS_KEY=xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx}
--env AWS_DEFAULT_REGION=ap-northeast-1
--env HEROKU_API_KEY=xxxxxxxxxxxxxxxxxxxxx
heroku-aws-backup bash

Backup shell file modifications

If you're using a cloned Github repository as I write here, you can use

There is a sample file for backup in sh/backup.sh, so you can rewrite it to suit your environment.

It would be good to make sh/backup.sh and rewrite the shell file appropriately when you write it in the From of Dockerfile and use it.

https://github.com/konyu/heroku-aws-backup/blob/master/sh/backup.sh.

# sample backup shell
# echo "start daily buckup!!!"

# echo "== stopping worker =="
# heroku ps:scale worker=0 -a APP_BE_BAKED_UP

# echo "== copying database to preview from production =="
# heroku pg:copy ORIGINAL_DB_NAME DB_TO_BE_COPIED --confirm APP_BE_BAKED_UP -a APP_BE_BAKED_UP

# echo "== clearing jobs =="
# heroku run rake jobs:clear -a APP_BE_BAKED_UP

# echo "== copying s3 bucket to staging from production =="
# aws s3 sync --delete --acl public-read s3://ORIGINAL_BUCKET s3://BUCKET_TO_BE_COPIED

# echo "== starting worker =="
# heroku ps:scale worker=1 -a APP_BE_BAKED_UP

Running in Heroku

Install the Heroku cli.

If you don't have Heroku's CLI command installed, you should be able to use the OS in the following URL

https://devcenter.heroku.com/articles/heroku-command-line

Add Heroku container registry

heroku plugins:install heroku-container-registry

Deploy to Heroku

Move to this repository directory

Log in to Heroku

heroku login
> enter your id and password

Create application(in the case of a new one)

heroku create APP_NAME_YOU_WANT

Modify application (in case of modification)

Added git remote to be able to deploy to heroku

heroku git:remote -a APP_NAME_YOU_WANT

Deploying to Heroku

heroku container:push web

Setting environment variables

Setting environment variables
heroku config:set AWS_ACCESS_KEY_ID=xxxxxxx AWS_SECRET_ACCESS_KEY=xxxxxxxxxxxxxxxxxx AWS_DEFAULT_REGION=ap-northeast-1 HEROKU_API_KEY=xxxxx -app APP_NAME_YOU_WANT

Adding a Scheduler

heroku addons:create scheduler:standard -app APP_NAME_YOU_WANT

Add a shell to the Scheduler to run

The shell to run should be written with the full path.

Note that it doesn't work well if you write the path relative to your home directory when you start with heroku run bash -a APP_NAME.