108 lines
5.2 KiB
Org Mode
108 lines
5.2 KiB
Org Mode
#+TITLE: Gitlab GCP Deployment
|
|
#+AUTHOR: James Blair
|
|
#+EMAIL: mail@jamesblair.net
|
|
#+DATE: 5th January 2021
|
|
|
|
This org file is intended to capture and automate the end to end workflow to deploy an instance of [[https://gitlab.com][Gitlab]] on [[https://console.cloud.google.com][Google Cloud Platform]].
|
|
|
|
We'll use shell blocks inside this file which can be executed with [[https://orgmode.org/worg/org-contrib/babel/][Babel]]. Additionally we want to explore tangling these source code blocks to shell script files within this document so that the scripts can then be executed by a continous delivery pipeline.
|
|
|
|
*Notes:*
|
|
1. To interact with this org file we're using the [[https://github.com/humacs/humacs][Humacs]] distribution of [[https://www.gnu.org/software/emacs/][Emacs]].
|
|
1. This workflow has only been tested on the ~Ubuntu 20.04~ linux distribution, via [[https://ubuntu.com/wsl][WSL 2]].
|
|
|
|
|
|
* Step 1 - Ensure GCP SDK is installed
|
|
|
|
To automate our interactions with Google Cloud Platform we'll use the [[https://cloud.google.com/sdk/docs/install#deb][GCP SDK]] which provides us with a number of command line tools to interact with the platform, such as ~gcloud~, ~gsutil~ and ~kubectl~.
|
|
|
|
Tangle the shell block below to a shell script by pressing *, b t* in emacs command mode:
|
|
|
|
#+NAME: Install google cloud sdk
|
|
#+BEGIN_SRC bash :shebang #!/bin/bash :tangle 1-install-gcp-sdk.sh
|
|
# Add the Cloud SDK distribution URI as a package source
|
|
echo "deb [signed-by=/usr/share/keyrings/cloud.google.gpg] https://packages.cloud.google.com/apt cloud-sdk main" | sudo tee /etc/apt/sources.list.d/google-cloud-sdk.list
|
|
|
|
# Make sure apt-transport-https is installed
|
|
sudo apt-get install -y apt-transport-https ca-certificates gnupg
|
|
|
|
# Import the Google Cloud public key
|
|
curl https://packages.cloud.google.com/apt/doc/apt-key.gpg | sudo apt-key --keyring /usr/share/keyrings/cloud.google.gpg add -
|
|
|
|
# Update and install the SDK
|
|
sudo apt-get update && sudo apt-get install -y google-cloud-sdk
|
|
#+END_SRC
|
|
|
|
|
|
* Step 2 - Configure Google Cloud Platform resources
|
|
|
|
With GCP SDK now installed we need to authenticate, create a project and then create a virtual machine instance that we will install Gitlab into later in the workflow.
|
|
|
|
First up is authentication so our GCP SDK installation can carry out actions in a given account and project. This part of the process is currently a manual step as the authentication process includes some interactive steps.
|
|
|
|
In future we could automate this process as part of a continous delivery pipeline using a GCP service account with permission to create virtual machine instances.
|
|
|
|
#+NAME: Authenticate with google cloud platform
|
|
#+BEGIN_SRC bash :shebang #!/bin/bash :tangle no
|
|
gcloud auth login
|
|
#+END_SRC
|
|
|
|
|
|
Once we have authenticated we can create a project and then create a new virtual machine instance within that project.
|
|
|
|
Firstly let's create a new project, a project is the logical boundary all our cloud resources for this deployment will live within. To be able to deploy resources we also need to enable billing.
|
|
|
|
Tangle the shell block below to a shell script by pressing *, b t* in emacs command mode:
|
|
|
|
#+NAME: Create a new google cloud project
|
|
#+begin_src bash :shebang #!/bin/bash :tangle 2-configure-gcp-project.sh
|
|
# Create a project id based on date
|
|
export gcp_project_id="gitlab-gcp-"$(date +"%s")
|
|
|
|
# Create new project using a random project id
|
|
gcloud projects create $gcp_project_id
|
|
|
|
# Ensure billing is enabled for the project
|
|
export gcp_billing_account=$(gcloud alpha billing accounts list --limit=1 --format='value(name.basename())')
|
|
gcloud alpha billing projects link $gcp_project_id --billing-account $gcp_billing_account
|
|
|
|
# Make sure the project is set active
|
|
gcloud config set project $gcp_project_id
|
|
#+end_src
|
|
|
|
|
|
Once we have a project we can create a new virtual machine. To create a virtual machine we need to ensure compute engine apis are enabled.
|
|
|
|
Tangle the shell block below to a shell script by pressing *, b t* in emacs command mode:
|
|
|
|
#+begin_src bash :shebang #!/bin/bash :tangle 3-create-virtual-machine.sh
|
|
# Ensure compute engine apis are enabled in the project
|
|
gcloud services enable compute.googleapis.com
|
|
|
|
# Create name for virtual machine based on date
|
|
export gcp_machine_name="gitlab-gcp-"$(date +"%s")
|
|
|
|
# Create the new machine
|
|
gcloud compute instances create $gcp_machine_name --zone australia-southeast1-a
|
|
#+end_src
|
|
|
|
|
|
* Step 3 - Install docker on virtual machine
|
|
|
|
Next up we need to install [[https://docker.com][Docker]] on the newly created virtual machine so that we can then deploy Gitlab as a container.
|
|
|
|
By default the virtual machine operating system for the vm we created on GCP is [[https://debian.org][Debian]]. There are instructions for installing Docker on a debian machine [[https://docs.docker.com/engine/install/debian/#install-using-the-repository][here]].
|
|
|
|
#+begin_src bash :shebang #!/bin/bash :tangle 4-install-docker.sh
|
|
# Retrieve the vm name
|
|
export gcp_machine_name=$(gcloud compute instances list --limit=1 --format='value(name.basename())')
|
|
|
|
# Connect to the machine using ssh
|
|
gcloud compute ssh $gcp_machine_name --ssh-key-file ~/.ssh/$USER -- "curl -fsSL https://get.docker.com -o get-docker.sh && sudo sh get-docker.sh"
|
|
|
|
#+end_src
|
|
|
|
* Step 4 - Install gitlab via docker
|
|
|
|
Coming soon...
|