DEV Community

Vuong
Vuong

Posted on • Edited on

Dockerization: Varnish, Nginx & try to hit the first cache

#docker #varnish #nginx

Introduction

Varnish help to decreases directly request to the web server by cache response after first-time response, help your website perform better. You can make the configuration for caching-path, what you want to ignore, how to purge/ban cache.

I like Docker, I run my website on Docker, multiple services by Docker-Compose, I’m just a developer, no more knowledge about the system like a DevOps, I want to make it run by the simple way.

I would like to mention online NGINX and varnish. It’s mean NGINX will cover backend and connect to varnish to handle the response.

Requisites

  • Nginx has covered web and it’s still running before installing varnish
  • Nginx and varnish must be on the same internal network

Notes

  • Nginx will run out with port 8080
  • Varnish will run out with port 80
  • Varnish can’t handle SSL. If you need to handle this protocol, this post can’t help you more
  • Property build: ../nginx-server includes NGINX configuration, you could use the image directly. It should be controlled on your side Property build: ../varnish includes varnish configuration. I will explain only this part

Docker images

Varnish docker image: https://github.com/newsdev/docker-varnish (It has included the way to setting and run docker image, I just write more for docker-compose config)

Nginx: https://hub.docker.com/_/nginx/

Settings

  • Create ../varnish folder
  • Access to created folder and make Dockerfile 
FROM newsdev/varnish:4.1.0
ENV VARNISH_MEMORY 100m
Enter fullscreen mode Exit fullscreen mode
  • Create default.vcl in the same folder, it’s varnish configuration 
vcl 4.0;
backend default {
  .host = "nginx-server";
  .port = "80";
}

# If you don't include below, header Age in response to client always be 0

sub vcl_deliver {
  # Display hit/miss info
  if (obj.hits > 0) {
    set resp.http.V-Cache = "HIT";
  }
  else {
    set resp.http.V-Cache = "MISS";
  }
  set resp.http.Access-Control-Allow-Origin = "*";
  set resp.http.Access-Control-Allow-Headers = "Accept,Authorization,Cache-Control,Content-Type,DNT,If-Modified-Since,Keep-Alive,Origin,User-Agent,X-Mx-ReqToken,X-Requested-With";
  set resp.http.Allow = "GET, POST";
  set resp.http.Access-Control-Allow-Credentials = "true";
  set resp.http.Access-Control-Allow-Methods = "GET, POST, PUT, DELETE, OPTIONS, PATCH";
  set resp.http.Access-Control-Expose-Headers = "X-Pagination-Total, X-Pagination-Page, X-Pagination-Limit";
}
sub vcl_backend_response {
  if (beresp.status == 200) {
    unset beresp.http.Cache-Control;
    set beresp.http.Cache-Control = "public; max-age=200";
    set beresp.ttl = 200s;
  }
  set beresp.http.Served-By = beresp.backend.name;
  set beresp.http.V-Cache-TTL = beresp.ttl;
  set beresp.http.V-Cache-Grace = beresp.grace;
}
Enter fullscreen mode Exit fullscreen mode
  • Modify service’s configuration for docker-compose.yml 
version: '2'

networks:
  localnetwork:
    driver: bridge
    ipam:
      driver: default
      config:
        - subnet: 162.11.1.0/24
          gateway: 162.11.1.1
services:

  nginx-server:
    container_name: nginx-server
    build: ../nginx-server
    networks:
      - localnetwork
    ports:
      - "8080:80"
  varnish:
    build: ../varnish
    container_name: varnish
    networks:
      - localnetwork
    ports:
      - "80:80"
    depends_on:
      - nginx-server
Enter fullscreen mode Exit fullscreen mode
  • Build & run Docker 
docker-compose build
docker-compose up -d
Enter fullscreen mode Exit fullscreen mode
  • Access URLs and check the headers 
http://docker-host-ip:8080/users/{user_id} #Routing to your method, always no cache
http://docker-host-ip/users/{user_id} #Through Varnish first
Enter fullscreen mode Exit fullscreen mode
  • Hit varnish caching URL, and see the Age value in the response headers: 
Age = 0, Cache wasn’t HIT (known as MISS)
Age != 0, Cache was HIT (you’re successful)
Enter fullscreen mode Exit fullscreen mode

Helpful commands 

# View varnish cache his/miss
docker exec -it varnish bash
varnishncsa -F "%m %U%q ---- %{Varnish:handling}x"
Enter fullscreen mode Exit fullscreen mode

Top comments (3)

Collapse
 
rvanlaak profile image
Richard van Laak •

Great post! Unfortunately following it for us leads to the following Vagrant error log:

Error:
Message from VCC-compiler:
Expected an action, 'if', '{' or '}'
('input' Line 12 Pos 5)
    setresp.http.V-Cache = "HIT";

----####################----------

Running VCC-compiler failed, exited with 2
VCL compilation failed
Collapse
 
rvanlaak profile image
Richard van Laak •

Found out the typos; it should be:

  • set resp instead of setresp
  • unset beresp instead of unsetberesp
  • set beresp instead of setberesp
Collapse
 
vuong profile image
Vuong •

Thanks for catching 😂. I have updated the post 🤗.

Read next

goodylili profile image

How to Deploy Go Applications With Docker

Ukeje Chukwuemeriwo Goodness -

ken2026 profile image

Deploy a Docker Image to ECS with Auto Scaling Using AWS CDK in Minutes

Ken Yip -

code42cate profile image

How to Dockerize and Deploy Fastify APIs

Jonas Scholz -

shubhamku044 profile image

DevOps Fundamentals: Breaking Down the Culture, Tools, and Practices

Shubham Sharma -