Devops Continious delivery and automation with Councourse and Terraform
System
The purpose of this application is to create a system that makes
you control and manage projects for development in a safer and easier way
using Terraform for configuration files and Concourse to create a pipeline
connecting things together and giving you and your team a visual overview
and status of the system before staging and deploying a finished product.
In this pipeline you will see a basic infrastructure of a pipeline which will
build a Springboot application docker image container and deploy it to a
Heroku cloud service container-registry before creating -ci -staging and -production
with statuscake monitoring it. The application contains a basic REST API using swagger
as a tool with a few working tests.
The pipeline will automatically detect and update the CI everytime there is a change in the application
after it has been commited and pushed to master and give a warning if tests or anything else fails.
####Tools needed
Git account
git bash or a similar CLI
Docker
fly CLI
Heroku CLI
Instruction
Before starting you need some pre-knowledge of Concourse, Docker and Heroku.
Once you have installed everything follow the concourse tutorial:
https://concoursetutorial.com/
Once you have some overview lets start with running our pipeline.
But before we do that we need to add and do some terraform config changes in our infrastructure (exam-infra).
First you need to fork and then clone exam-app and exam-infra from your on repositroy and make it your own.
-
In root folder of exam-Infra rename Credentials_example.yaml file to
credentials.yaml -
In your new credentials.yaml file replace content as follows:
-Create private and public keys for app and infra by opening up a CLI (like git bash) and
type 'ssh-keygen'. Then choose a suitable name like 'sshKeyApp' and press anter 3 times. Do the same again for exam-app.
You have now created a public key and private key. Take good care of these and dont EVER push these public on github or anywhere else.-Then type 'cat <your sshkey name' and copy the output of the private key (not the one that ends with .pub) and replace with the one in credentials.yaml,
appkey under app and infrakey under infra. Make sure they are EXACTLY positioned as the examples.-Now you need to add the public keys to your github repositories. appkey.pub to your exam-app repo and opposite for exam-infra .
Type 'cat <sshKeynameApp.pub> and copy this key. in your app repo click on settings---> deploy keys ---> add deploy key and paste
the key in there but remember to click "allow write access" right below it. do the same again for exam-infra.-Create a Heroku account and add your heroku email and Heroku API key inside credentials.yaml
-Create a StatusCake account and add statuscake_api_key in credentials.yml
-Create a github token by selecting the settings inside your profile. Click on 'developer settings' ----> then 'personal access token'.
and then 'generate new token'. copy and paste the token inside credentials.yaml -
Next we need to add these two new repositiories to your pipeline.
Navigate to your Infra repository and copy your ssh uri. In your cloned exam-infra folder navigate
to concourse/ and open pipeline.yml in a editor. paste your copied ssh uri infra under resources: name: exam-infra uri: and do the same thing for
exam app. -
Navigate to exam-infra/terraform/ and open provider_heroku-tf and add your Heroku email.
-
In same folder open up statuscake.tf and add username. Username is defined in 'userdetail' inside profile settings'
in your account. commit and push everything to github ones again and remember to delete .tfState if any inside /terraform/
Now you can followw the concourse tutorial again, but make sure you run Docker compose up -d inside exam-app. Then Wget and fly commands inside exam-infra.
Start with running the Infra pipeline first and then app ones infra turns green.
Check your heroku ci to verify it has been created.
Run Rest applicaion
You can run the REST Api application locally with heroku cli installed by opening up the cli , navigate to root of exam-app and run 'heroku local'
or through this tutorial: https://devcenter.heroku.com/articles/deploying-spring-boot-apps-to-heroku
Application will then be available at http://localhost:/movierest/api/swagger-ui.html