DEV Community

Jean-Phi Baconnais for Zenika

Posted on • Updated on • Originally published at blog.zenika.com

Create and configure Your own GitLab Runner automatically on Gitpod

In this blog post, I will explain why and how I installed a GitLab Runner on a Gitpod workspace ๐Ÿ˜ƒ

๐Ÿ”Ž GitLab & Gitpod

I use GitLab all the time for my personal projects. I can save my code, get history and automate tasks like building or deploying my applications with GitLabCI. If this is your first time hearing about GitLab or GitLabCI, you can discover it by reading ๐Ÿ“– my series of Cheatsheets ๐Ÿ˜€.

Last year, I discovered by chance Gitpod, a Cloud IDE available on GitHub, BitBucket and GitLab. Going to one of my projects on GitLab, I saw an arrow near the โ€œWeb IDEโ€ button. After testing this tool, I quickly adopted it!

Open Gitpod

Since then, I use this Cloud IDE all the time for my personal or open-source projects to develop new features, fix bugs or simply create or update documentation. No more time wasted to install a lot of jdk versions, switch versions of maven, node, or anything else depending on your project.

If you havenโ€™t tried this tool yet, letโ€™s go! You can install the Gitpod chrome extension which allows you to have a Gitpod button when you are on a GitLab or GitHub project!

๐Ÿ‘ท My work

One month ago, I was working on a personal project and especially on my continuous integration pipeline that needed to be improved. I wanted to create a new job to test new GitLab features. To test my pipeline, I followed this process:

git add .gitlab-ci.yml
git commit -m โ€œfeat: create new job to [...]โ€
git push 
Enter fullscreen mode Exit fullscreen mode

After applying these simple commands, I looked at the pipeline generated in the GitLab interface and my job was validated, great news!

Next, I wanted to complexify my job. I added some elements in the .gitlab-ci.yml file and I repeated the previous Git commands. But this time, damned! There was an error on my pipeline. Not in the structure of the file, but in my commands written in the scripts tag. No worry, I added changes, I repeated the previous git commands andโ€ฆ I always had an error.

Please donโ€™t judge me, Iโ€™m sure your pipeline doesnโ€™t work on the first time (or second) ๐Ÿ˜….

Finally after some tries, I succeeded in having a pipeline which makes what I want.

But something was wrong. My different attempts, almost all errors, were wasted time. Currently, GitLab offers 400 minutes for your CI/CD. I would like it to be used to build, test, check security and deploy my application, not my tests! Itโ€™s a โ€œwasted timeโ€. So how do I resolve this?

๐Ÿ’ก A new opportunity?

Letโ€™s take a step back. Pipelines are executed by a GitLab Runner, thatโ€™s right. This is an application written in Go and itโ€™s easy to install on different infrastructures. That reminds me of this ๐Ÿ“– blog post Iโ€™ve written (in French ๐Ÿ‡ซ๐Ÿ‡ท) about the installation of a runner on my raspberry PI. To install a runner, you have to follow these steps:

  • download binaries
  • install them
  • register an executor

You can also use the available Docker image with this command :

docker container run -d --name gitlab-runner --restart always \
    -v /srv/gitlab-runner/config:/etc/gitlab-runner \
    -v /var/run/docker.sock:/var/run/docker.sock \
    gitlab/gitlab-runner:latest
Enter fullscreen mode Exit fullscreen mode

You can find more information in the ๐Ÿ“– GitLab documentation.

On my Gitpod workspace, I am in a container context. So I can install my GitLab Runner in my workspace ๐Ÿ’ก! Letโ€™s try it!

๐ŸฆŠ My new GitLab Runner

First, I get my registration token in the Setting > CI/CD > Runners on the specific part.

GitLab Runners

After opening a Gitpod workspace on my project, I can install a GitLab Runner with this Docker command. The default image of a workspace is gitpod/workspace-full which contains many developer tools.

docker container run -d --name gitlab-runner --restart always \
    -v /srv/gitlab-runner/config:/etc/gitlab-runner \
    -v /var/run/docker.sock:/var/run/docker.sock \
    gitlab/gitlab-runner:latest
Enter fullscreen mode Exit fullscreen mode

I registered a runner with this command. (I replaced the registration-token with mine).

docker container run --rm -it -v /srv/gitlab-runner/config:/etc/gitlab-runner gitlab/gitlab-runner register \
    --non-interactive \
    --executor "docker" \
    --docker-image ruby:2.7 \
    --url "https://gitlab.com/" \
    --registration-token "<gitlab runner token" \
    --description "gitpod-runner" \
    --tag-list "gitpod" \
    --access-level="not_protected"
Enter fullscreen mode Exit fullscreen mode

At this step, if I write a docker container ls command, I see one container gitlab-runner.

For the token, to avoid getting this one in the project, it can be exported on the Gitpod variables. First, go to my profile on gitpod.io and in the Settingsmenu.

Gitpod Variables

To create this variable, I added a name, a value and a scope representing my project.

Gitpod Variables

Now, my variable is created. In my .gitpod.yml file, I can get the value of this variable by writing $MY_CICD_REGISTRATION_TOKEN.

๐ŸŽฒ The .gitpod.yml file

The .gitpod.ymlfile contains all specifications to customize a workspace. For this experiment, all commands can be written in the tasks section. We can assign a name to task:

tasks:
  - name: install Gitlab runner
Enter fullscreen mode Exit fullscreen mode

In Gitpod, there are three types of tasks: before, init and command. For Docker instructions, heavy commands, I use the inittask. To write a sequence of commands on multiple lines, the | operator can be used:

tasks:
  - name: install Gitlab runner
    init: | 
      echo '๐ŸฆŠ Installation GitLab Runner'
Enter fullscreen mode Exit fullscreen mode

And then I just had to add Docker commands:

tasks:
  - name: install Gitlab runner
    init: |
      echo "๐ŸฆŠ Installation GitLab Runner"
      docker container run -d --name gitlab-runner --restart always \
        -v /srv/gitlab-runner/config:/etc/gitlab-runner \
        -v /var/run/docker.sock:/var/run/docker.sock \
        gitlab/gitlab-runner:latest

      docker container run --rm -it -v /srv/gitlab-runner/config:/etc/gitlab-runner gitlab/gitlab-runner register \
        --non-interactive \
        --executor "docker" \
        --docker-image ruby:2.7 \
        --url "https://gitlab.com/" \
        --registration-token $MY_CICD_REGISTRATION_TOKEN \
        --description "gitpod-runner" \
        --tag-list "gitpod" \
        --access-level="not_protected"
Enter fullscreen mode Exit fullscreen mode

After committing and pushing this file on my project, when I opened a new Gitpod workspace, tasks were executed and this good message appear:

Registered a runner

The GitLab Runner is installed and registered! ๐ŸŽ‰

As I registered my GitLab Runner with a tag-list property containing the value gitpod, jobs have to require this tag to be executed by this runner.

stages:
    - build
    - test
    - deploy

.gitpod:
  **tags:**
    - **gitpod**

my-job-1:
  stage: build 
  extends: [".gitpod"]
  script:
    - echo "my job 1"
Enter fullscreen mode Exit fullscreen mode

To verify that my pipeline was working, I ran a new one and checked the details:

Runner details

On my Gitpod workspace, I checked the Docker logs of the gitlab-runner container:

Runner logs

We could see the runner id โ€œz8crb8โ€ visible on the job and the Docker logs: my pipeline was executed in my Gitpod workspace !

๐Ÿ The result

To resume, my .gitpod.yml file looks like:

tasks:
  - name: install Gitlab runner
    init: | 
      echo '๐ŸฆŠ Installation GitLab Runner'

      docker container run -d --name gitlab-runner --restart always \
        -v /srv/gitlab-runner/config:/etc/gitlab-runner \
        -v /var/run/docker.sock:/var/run/docker.sock \
        gitlab/gitlab-runner:latest

      docker container run --rm -it -v /srv/gitlab-runner/config:/etc/gitlab-runner gitlab/gitlab-runner register \
        --non-interactive \
        --executor "docker" \
        --docker-image ruby:2.7 \
        --url "https://gitlab.com/" \
        --registration-token $MY_CICD_REGISTRATION_TOKEN \
        --description "gitpod-runner" \
        --tag-list "gitpod" \
        --access-level="not_protected"
Enter fullscreen mode Exit fullscreen mode

And all my jobs contain a new tag :

tags:
    - gitpod
Enter fullscreen mode Exit fullscreen mode

All sources are available on this GitLab repository.

๐Ÿ’ญThis is the beginning

This test is a beginning. I had this idea and I tested it quickly. I think this approach is interesting, because each person working on a project can use a dedicated and temporary GitLab runner and can take advantage of Gitpod infrastructure to execute pipelines. We can imagine, for example, executing a pipeline at the opening of a Gitpod workspace to launch some operations such as checking security or other tools to help developers.

In this test, the next thing to review is tags tag in the .gitlab-ci.yml file. Currently the tag is fixed but this should only be present for development mode. Maybe a script in the Gitpod tasks to add this to workspace initialization?

The good thing is that attempts of pipeline modification donโ€™t reduce the GitLab CI/CD time limit. We can imagine this can attract novices in GitLabCI or developers who hesitate, fearing of breaking something, to add changes in pipelines. For my personal case, I create a new runner on each my new Gitpod workspace when I want to test some features on GitLabCI ๐Ÿ˜

If you have any comment or suggestion about this experience, donโ€™t hesitate to send me a direct message on Twitter ๐Ÿค˜

Top comments (1)

Collapse
 
devarshishimpi profile image
Devarshi Shimpi

I was trying this since a long time!! Great Article!!