make-deploy/README.md

# make-deploy

A simple Makefile based deployment system.

**make-deploy** was initially hosted at https://git.dnix.de/an/make-deploy. Since it has become heavily used at chefkoch.de for system deployments, and lots of code is committed there, we moved the repo to https://git.chefkoch.net/pub/make-deploy. A mirror still exists at https://git.dnix.de/mirror/make-deploy.

**make-deploy** is licensed under the terms of the MIT-License. See [LICENSE](LICENSE) for info.

## Installation

1. Clone **make-deploy** as a submodule into your repository:

    $ git submodule add https://git.chefkoch.net/pub/make-deploy
    
2. Create a symlink to the Makefile:

	$ ln -s make-deploy/Makefile .
	
3. Create `config.mk` (for common config options) and `secrets.mk` (for sensitive information, should be git-crypted) in your project.

Example `config.mk`:

    DEPLOY_NAME = my-project
	DEPLOY_PATH = /srv
	DEPLOY_TYPE = compose
	DEPLOY_HOSTS = server01.example.com server02.example.com

	DOCKER_IMAGE = dr.example.com/my-project:latest
	DOCKER_LOGIN = 1
	DOCKER_REGISTRY = dr.example.com

	SSH_USER = ci

Example `secrets.mk`:

    DOCKER_USER = root
    DOCKER_PASS = secret1234

By setting `DEPLOY_CONFIG_OVERRIDE`, an alternative config can be loaded to override existing configuration settings. This is useful in script calling make deploy or in a `.gitlab-ci.yml` in order to control settings for different targets.

## Usage

### Philosophy

**make-deploy** lets you deploy software on the commandline with make.

Doing as much config as you can in `config.mk`, via `DEPLOY_OVERRIDE_CONFIG` and in `secrets.mk` will keep this ability intact without depending on complex build systems (e.g. Gitlab deployments controlled by .gitlab-ci.yml and other stuff like that). OTOH it does not stop you from doing this: simply call `make deploy` in your build pipeline in order to get the best of both worlds.

Relying only on GNU Make and simple CLI tools makes deployments robust and still possible, when big parts of your infrastructure are broken and have to be redeployed.

### Working principle

**make-deploy** calls several stages in the deployment process, which are `mandatory prepare build test upload pre-deploy pre-local pull start post-local post-deploy reload`.

`mandatory`: Checks if all needed variables are set in config.mk.

`cleanup`:  Runs `cleanup.sh` on each remote target, meant to be used to wipe contents of prior installations.

`prepare`: Creates needed directory for the deployment on the target system, sets secure file permissions for `secrets.mk`.

`build`: Calls `build.sh` locally. This is for building purposts, e.g. docker build and push.

`test`: Calls `test.sh` locally,

`upload`: rsyncs the contents of the repo to the target systems.

`pre-deploy`: Runs `pre-deploy.sh` remotely on the target hosts. Used for service specific purposes.

`pre-local`: Runs `pre-local.sh` locally. Used for service specific purposes.

`pull`: Pulls docker images (if appropriate).

`start`: Starts the service.

`post-local`: Runs `post-local.sh` locally. Used for service specific purposes.

`post-deploy`: Runs `post-deploy.sh` remotely on the target hosts. Used for service specific purposes.

`reload`: Runs `reload.sh` remotely on the target hosts.  Used for service specific reloading/restarting.

### Start the deployment process

    make deploy

### Update **make-deploy** submodule in your project

    make self-update

### Available options for DEPLOY_TYPE

#### simple

Just copy the repo to the remote location(s). Put additional logic into build.sh, start.sh, pre-deploy.sh, and post-deploy.sh.

#### compose

Docker Compose deployment.

##### swarm

Docker Swarm deployment.

##### k8s

K8S deployment.

`K8S_CONTEXT`: K8S context to be used. Make sure to properly set up your K8S credentials (kube config) and provide a local copy of kubectl.

##### helm

K8S deployment via helm.

`K8S_CONTEXT`: K8S context to be used. Make sure to properly set up your K8S credentials (kube config) and provide a local copy of kubectl.

`NAMESPACE`: K8S namespace. TODO: This will be renamed to K8S_NAMESPACE in the future.

`HELM_VALUES_FILE`: Contains the specific variables for this deployment.

`HELM_CHART_NAME`: Name of the helm chart.

`HELM_CHART_PATH`: Path of the helm chart.

The helm deployment processes the contents of `HELM_VALUES_FILE` with envsubst and pipes the result to `helm upgrade` to deploy the application.

##### cron

Deploy cronjob.

##### systemd

systemd. (TBD)

##### apt

APT deployment on debian-like distributions.

##### tf

Deploy via Terraform. Config is mostly done with terraform.

`TF_FLAGS`: What you think.

`TF_TARGET`: Limits deployment to `TF_TARGET`.