DEV Community

Cover image for Install Docker on Windows (WSL) without Docker Desktop

Install Docker on Windows (WSL) without Docker Desktop

Jonathan Bowman on February 14, 2021

Updated April 10, 2022, with current Alpine instructions, Debian/Ubuntu package signing tweaks (no more apt-key), and better guidance for handling...
Collapse
 
tempcke profile image
Todd Empcke

I'll never understand why developers who write code to run in linux fight with windows. Just run linux native. This isn't the 90's anymore, it is really super easy to run linux on your local dev machine and every program you would want for dev that is worth running already runs on linux.

Collapse
 
patarapolw profile image
Pacharapol Withayasakpunt • Edited

Usually because I need

  • Proprietary software, not limited to MS Word and PowerPoint. I still need to work and discuss with non-dev people, you know.
  • Best possible hardware drivers by default
  • I love POSIX as well, but I don't have a choice. macOS is expensive to buy (yet mainstream), as well as forced obsolescence (via OS updates + requirement, and repair / replacement prevention); not to mention keyboard layout confusion (which is "cost to change").

But yes, I used WSL2 enough that moved to a second PC with native Linux.

Collapse
 
bowmanjd profile image
Jonathan Bowman

I am familiar with those circumstances.

For me, using WSL isn't a choice against Linux, but a choice to use Linux everywhere. A Linux dev machine is quite desirable. Even with that, I will still run WSL on any Windows machine I can. Because I do a lot from the command line, and I often want that command line to be Linux, no matter the location or network connectivity.

Collapse
 
arakwar profile image
Sebastien Lemieux

Corporate.

We tried. But I have other things to do than spend my time trying to argue with people that we should be allowed to get Linux machines on our corporate network.

The only option that we had is to run a corporate-managed VM on Azure, with their own "linux" which is a special build from oracle that I never heared of before they mentionned it, and where no open source tools seems to offer any kind of support.

WSL is the only option that I have. HyperV is not stable enough on Linux, and VirtualBox is blocked by corporate rules.

Collapse
 
bhayes profile image
b-hayes

Windows can do a lot of things linux cant and has a lot of cutting edge hardware support. Sometimes you need this simple as that.
However I agree developing linux apps with docker on windows can be a pain I'd recommend just installing linux on a dedicated machine for that purpose if you can.

Collapse
 
billybraga profile image
billybraga

Here are the problems I had on Ubuntu (note that I really wanted to work on linux since our servers run on linux) :

  • lack of proper bluetooth drivers (mSBC not supported, so headset sound was crap)
  • software support
    • Teams would not switch to headset mode automatically, nor detect when BT headset was connected after app was opened)
    • no edit and continue on .net core (and no, I won't change the language we write at work)
  • watching 4K videos on my 4K screen had tearing (and yes, watching videos on my break is a requirement)
  • regular system freeze
Collapse
 
sqlrob profile image
Robert Myers

I work on client/server software. The client is Windows; the server is not.

Collapse
 
h8f1z profile image
Ahmed Hafiz

I have tried with multiple laptops (and multiple distros) and even with so many customisations, laptops keep heating up on idle.
Not so ideal for development with that heat on my hand . I do wish it'd change some day. Been waiting for years now.

Collapse
 
bhayes profile image
b-hayes • Edited

That sounds odd. Ive been running WSL on potato laptops and now I high end one with no heat issues at all.

Collapse
 
bodhione profile image
John Tal

Todd, many people are provisioned corporate laptops. In many regions also you cannot get a linux or Mac from the company, only Windows. WSL2 is, generally, better than the old cygwin many of us used decades ago. So no, it's not an automatic that developers get to use the best OS ever made.

Collapse
 
chx profile image
Karoly Negyesi of House AstraZeneca

I will readily admit being a Linux newbie despite I installed Slackware with Linux 0.99pl15 for the first time from a stack of floppies early 1994. I am still running Linux on servers to this day. I ran Linux dual boot from 2000-2004 and then as a daily driver 2004-2017. It was a miserable experience. The choices are running Ubuntu where upgrading every six months shatters your OS so badly you can't work for days or Arch where upgrades often break one of your printer/scanner/Bluetooth. Connecting to any sort of enterprise-y VPN or WiFi just doesn't work. I don't care whether it's the fault of F5 or the community for not working -- if I can't VPN in, I can't work.

So the reason I use Windows is because that's where the driver support is. Plain and simple. And I use WSL2 because Linux excels at CLI and daemons.

Collapse
 
sarvasana profile image
Kris Kater

^^ This.

Stop running Windows unless you really have to.

Collapse
 
marzelin profile image
Marc Ziel

Fight? There's no fight between Windows and Linux since wsl2. It's a peaceful symbiosis.

Collapse
 
bodhione profile image
John Tal

somewhat peaceful, but following DOCKER0 from WSL2 out to the host network has issues in some configurations with Docker Desktop where installing docker directly into WSL works.

Collapse
 
russdan profile image
russdan

Hi Jonathan, great article, thank you!

A couple of updates when running in Windows 11H2 (and Ubuntu 22.04 in my case):

1) systemd is now native in Windows 11H2, BUT needs an updated WSL2 install (I was using WSL v0.63 and I believe native systemd support is in v0.68 onwards) - otherwise you get

System has not been booted with systemd as init system (PID 1). Can't operate
Enter fullscreen mode Exit fullscreen mode

Upgrading WSL to latest version means that updating /etc/wsl.conf with

[boot]
systemd=true
Enter fullscreen mode Exit fullscreen mode

then works as desired...

2) We also need containerd installed - I used the manual steps from here and that worked for me howtoforge.com/how-to-install-cont...

Those two steps joined the dots and now docker is running without docker desktop :)

Russ

Collapse
 
bowmanjd profile image
Jonathan Bowman • Edited

What!??? When did this happen? No one tells me these things. Except for you, of course, for which I am extremely grateful. Well, this is a game changer. I will work on updating the instructions for systemd, then!

Weird -- containerd is already installed on mine; I can update the instructions accordingly. Thank you so much!

Collapse
 
jsiegmund profile image
Jasper Siegmund

I'm running things with systemd now, I'm just struggling on how to launch that script which ensures the docker.sock is created before launching the actual docker service. So if you could include that in a rewrite that would be nice :)

Collapse
 
relin404 profile image
Ahmad Mash'aal • Edited

I have been pulling my hair for 8 days trying to run Docker on WSL2 without too many problems arising from nowhere with limited Linux experience. This article really helped me pull through it all. Kudos to you, Jonathan! Great detailed and crystal-clear article!

Collapse
 
bowmanjd profile image
Jonathan Bowman

So glad you found it helpful!

Collapse
 
dhirschfeld profile image
Dave Hirschfeld • Edited

Brilliant article - thanks for the thorough write up @bowmanjd!

I'm curious why you'd use a custom script to start dockerd rather than just using service docker start?

Is it just to control the shared docker socket location, or are there other reasons?

(I'm running Ubuntu-22.04)

xref: docs.microsoft.com/en-us/windows/w...

Collapse
 
bowmanjd profile image
Jonathan Bowman

Great point. If using only one distro, and that distro is Ubuntu, service docker start should work well. It could be embedded in a script, I suppose, and launched from other distros or Powershell. But I wanted something truly distro-agnostic.

Collapse
 
anpol profile image
Andrei Polushin

Also note that a boot command in /etc/wsl.conf is only available on Windows 11.

Collapse
 
thw0rted profile image
James Bromwell

It might be worth mentioning that as of a few months ago, the default WSL2 install (Ubuntu) can be configured to support systemd with a two-line config file. I only just finished the install so I can't confirm that everything works 100% out of the box, but after rebooting the VM, dockerd was running as expected.

Collapse
 
ackalker profile image
Alain Kalker • Edited

According to this article from Microsoft, systemd is now enabled by default for the default Ubuntu WSL distribution installed with WSL and installable from the Microsoft Store.
Installing the distribution-maintained version of Docker is now as simple as:

sudo apt update
sudo apt upgrade
sudo apt install docker.io
# Optionally, add your username to the docker group
sudo gpasswd -a <yourusername> docker
Enter fullscreen mode Exit fullscreen mode

Close the Ubuntu Terminal and re-open it (to make the group add take effect) and test that it works:

docker run --rm hello-world
Enter fullscreen mode Exit fullscreen mode

and Bob's your uncle. All done in less than a minute's work.

Collapse
 
bowmanjd profile image
Jonathan Bowman

Beautiful!

Collapse
 
kushakjafry profile image
Kushak Zohaad Jafry

Hi, followed everything but on doing sudo dockered getting this error.

WARN[2021-10-24T16:24:00.993150800+05:30] grpc: addrConn.createTransport failed to connect to {unix:///var/run/docker/containerd/containerd.sock 0 }. Err :connection error: desc = "transport: Error while dialing dial unix:///var/run/docker/containerd/containerd.sock: timeout". Reconnecting... module=grpc
failed to start daemon: Error initializing network controller: error obtaining controller instance: failed to create NAT chain DOCKER: iptables failed: iptables -t nat -N DOCKER: iptables v1.8.4 (legacy): can't initialize iptables table `nat': Table does not exist (do you need to insmod?)
Perhaps iptables or your kernel needs to be upgrade

Collapse
 
badsamaritan profile image
Michał Drzymała

What helped me in similar situation:

  • Add iptables false (as mentioned in the article),
  • Restart WSL engine (restart Lxssmanager service on Windows host),
  • Run WSL prompt as Admin (elevated) and there only run dockerd
Collapse
 
ajburley profile image
ajburley

I got this so I just added "iptables": false to my daemon.json and this error was averted. In the original post it says you only need to do this for Debian but not Ubuntu, and I'm using Ubuntu so I skipped that step originally. But in the end, turned out it was required.

Collapse
 
kushakjafry profile image
Kushak Zohaad Jafry • Edited

I did that but it did not work for me. Now I have started using docker desktop again.

Collapse
 
piotrrojek profile image
piotr-rojek

Hey, great stuff! It is actually possible to expose docker.sock from WSL so that it is accessible by Windows applications. In fact this is what Docker Desktop is doing, allowing all Windows native applications to use npipe docker context. It requires a small proxy application to make it work though. To make it easy to use I have packaged it into a container, so it is easy to deploy with a single docker run.

Read more about this here

Collapse
 
sw1tch73ch profile image
sw1tch73ch

So I wonder if Windows 10 wsl Debian changed - I can't use the update-alternatives --config iptables. I know I did before, I'm not sure what I left out - but the iptables-legacy isn't set-able now.

Collapse
 
bowmanjd profile image
Jonathan Bowman

Interesting; I just did this successfully last weekend. I wonder what is different. Do you have iptables installed?

Collapse
 
sw1tch73ch profile image
sw1tch73ch

I did. I even uninstalled and installed it back. Still had no "update-alternatives" for iptables which I believe is part of the problem I was having with Docker trying to run the "Computer Language Drag Racing" suite.

I removed the Debian WSL for now. Ubuntu works correctly, I think because they still use iptables and not the nftables in Debian that Docker apparently doesn't really understand unless you configure nftables just right.

Thread Thread
 
sw1tch73ch profile image
sw1tch73ch

I reinstalled the Debian WSL. Unless I missed a step above, when I got to "update-alternatives --config iptables" it's still broke on my system. Here is what I get:

$ update-alternatives --config iptables
update-alternatives: error: no alternatives for iptables

I'm pretty sure using the nftable subsystem is eventually what is making things not work - if I could get iptables-legacy it might be different.

Thread Thread
 
bowmanjd profile image
Jonathan Bowman

Just double-checking: are you sure you have iptables installed?

Thread Thread
 
sw1tch73ch profile image
sw1tch73ch

Yes. I did "sudo apt-get install iptables" to be sure. It seems like there is another package that adds the iptables-legacy links. I even removed and installed fresh wsl. Either Windows is remembering somewhere that it doesn't add the iptables-legacy rules, or I'm missing a package (or more than one) somewhere.

Thread Thread
 
bowmanjd profile image
Jonathan Bowman

Well, let's check. On your Debian install, what is the result of dpkg -S /usr/sbin/iptables-legacy?

Thread Thread
 
sw1tch73ch profile image
sw1tch73ch

dpkg shows:

$ dpkg -S /usr/sbin/iptables-legacy
dpkg-query: no path found matching pattern /usr/sbin/iptables-legacy

iptables is installed:
$ iptables --version
iptables v1.6.0

Thread Thread
 
sw1tch73ch profile image
sw1tch73ch

I'm not sure what happened to the previous reply:

$ dpkg -S /usr/sbin/iptables-legacy
dpkg-query: no path found matching pattern /usr/sbin/iptables-legacy
$ iptables --version
iptables v1.6.0

I think iptables installs when Debian itself is installed. It just isn't setting up the legacy rules. Searching around google, the answer that keeps popping up is to use the update-alternatives, which is the whole problem

Thread Thread
 
bowmanjd profile image
Jonathan Bowman

I probably sound like I am quite fixated on the iptables package, but would you try reinstalling it? Using apt install --reinstall iptables

Thread Thread
 
sw1tch73ch profile image
sw1tch73ch

So I looked in /usr/sbin... I only have one entry if I look for iptables:

$ ls /usr/sbin/iptable*
/usr/sbin/iptables-apply

I believe there should be nearly a dozen links to other objects there.

Thread Thread
 
sw1tch73ch profile image
sw1tch73ch

$ sudo apt install --reinstall iptables
Reading package lists... Done
Building dependency tree
Reading state information... Done
0 upgraded, 0 newly installed, 1 reinstalled, 0 to remove and 0 not upgraded.
Need to get 288 kB of archives.
After this operation, 0 B of additional disk space will be used.
Get:1 deb.debian.org/debian stretch/main amd64 iptables amd64 1.6.0+snapshot20161117-6 [288 kB]
Fetched 288 kB in 0s (2,349 kB/s)
(Reading database ... 36399 files and directories currently installed.)
Preparing to unpack .../iptables_1.6.0+snapshot20161117-6_amd64.deb ...
Unpacking iptables (1.6.0+snapshot20161117-6) over (1.6.0+snapshot20161117-6) ...
Setting up iptables (1.6.0+snapshot20161117-6) ...

$ update-alternatives --config iptables
update-alternatives: error: no alternatives for iptables

I agree it must be something in iptables too. It just doesn't set the default links in the install process to be able to switch to the legacy rules.

Thread Thread
 
bowmanjd profile image
Jonathan Bowman

Debian 9, I see. I honestly haven't tried this with older versions of Debian. Did 9 even use nftables? Pretty sure there is no legacy version because iptables wasn't legacy then. Does dockerd work?

Thread Thread
 
sw1tch73ch profile image
sw1tch73ch

I didn't notice the 9. It is the latest from Microsoft - or so I thought. Dockerd does work. Maybe the project I'm trying to compile doesn't like Debian 9! Here I thought it was because the iptables didn't follow the instructions. Strange my Debian is so far behind.

Collapse
 
nooz profile image
Michael Zheng

For some reason I can't get internet connection inside the container.

Collapse
 
salvatorepiccione profile image
Salvatore Piccione

Hi, I have exactly the same issue... @bowmanjd can you share any hint about how to get Internet connection working on docker containers running on WSL2?

Collapse
 
bowmanjd profile image
Jonathan Bowman

Interesting... What sort of errors are you seeing? Is it all internet connectivity, or just DNS?

Thread Thread
 
salvatorepiccione profile image
Salvatore Piccione

It is all internet connectivity: I cannot ping 1.1.1.1 but I can ping the docker host from a container.

Collapse
 
salvatorepiccione profile image
Salvatore Piccione

BTW I solved this issue switching from Debian to Ubuntu as WSL2 distro.

Thread Thread
 
timblaktu profile image
Tim Black

I'm having same issue, using Debian 11 on WSL2. With a Dockerfile containing only:

FROM centos:7
RUN yum -y install httpd

I was getting yum errors not resolving the name of the mirror server:

Determining fastest mirrors
Could not retrieve mirrorlist http://mirrorlist.centos.org/?release=7&arch=x86_64&repo=os&infra=container error was
14: curl#6 - "Could not resolve host: mirrorlist.centos.org; Unknown error"

Since I could resolve the name of the server from Debian WSL2 with no issue, I knew my DNS was working there. So I added some sleuthing to the Dockerfile:

FROM centos:7 RUN cat /etc/resolv.conf && ping -v -c2 host.docker.internal && ping -v -c2 1.1.1.1 && ping -v google.com && ping -v mirrorlist.centos.org RUN echo "timeout=30" >> /etc/yum.conf && cat /etc/yum.conf && yum -y install httpd

and run docker build with --add-host=host.docker.internal:host-gateway, I can see that I can ping the host from the container, but the container cannot seem to ping any external ip, even the cloudflare dns 1.1.1.1 or google's 8.8.8.8.

I've played around with setting DNS in the container explicitly using the /etc/docker/daemon.json with things like "dns": ["1.1.1.1", "8.8.8.8"], but if the container can't even get connectivity to these ips that's not going to work..

My Debian environment does not have any iptables configured. I'm flummoxed.

Thread Thread
 
timblaktu profile image
Tim Black • Edited

I found my debian environment is configured to use iptables-nft:

$> sudo update-alternatives --config iptables
There are 2 choices for the alternative iptables (providing /usr/sbin/iptables).

  Selection    Path                       Priority   Status
* 0            /usr/sbin/iptables-nft      20        auto mode
  1            /usr/sbin/iptables-legacy   10        manual mode
  2            /usr/sbin/iptables-nft      20        manual mode
Enter fullscreen mode Exit fullscreen mode

But I was getting no rules generated by iptables-nft-save, and several rules generated by iptables-legacy-save, so I explicitly update-alternatives to iptables-legacy and rebooted (host and wsl2/debian). (Will report back with results..)

Thread Thread
 
timblaktu profile image
Tim Black • Edited

Still same error after switching explicitly to iptables-legacy in debian 11. FWIW, I'm also passing the following dns servers to my containers via docker daemon.json:

# This one is the WSL net interface as seen by windows. It cannot be pinged from container.
nameserver 172.29.224.1
nameserver 1.1.1.1
nameserver 8.8.8.8
Enter fullscreen mode Exit fullscreen mode

I've tried putting the google and cloudflare dns first in this order, to no avail.

Thread Thread
 
timblaktu profile image
Tim Black

The issue is more easily reproduced on my system by just running ping commands inside the latest alpine image:

$> home/tim/src > docker run --rm -it alpine ping -c4 8.8.8.8
PING 8.8.8.8 (8.8.8.8): 56 data bytes

--- 8.8.8.8 ping statistics ---
4 packets transmitted, 0 packets received, 100% packet loss
Enter fullscreen mode Exit fullscreen mode
Thread Thread
 
timblaktu profile image
Tim Black

The problem was that even though I had reverted to iptables-legacy in Debian, I still had iptables: "false" in my docker daemon.json. On removing that, docker can use its default iptables impl and work with Debian Bullseye. Now, my containers can access "the internet".

I realize that your post indicated to use iptables: false as a way to get debian wsl2 instances to work with docker. But that never worked for me for some reason.

Thread Thread
 
bowmanjd profile image
Jonathan Bowman

Yeah, I have actually changed the instructions, removing the iptables:false, as using iptables-legacy seems like the right way to do it.

Thread Thread
 
philippthiele profile image
philippthiele • Edited

I had the same issue with Ubuntu in WSL2. Removing iptables: "false" from the daemon.json and switching to iptables-legacy did the trick. No full reboot was necessary, running "wsl --shutdown" in powershell + reopening the ubuntu shell did the trick. Thanks!

Collapse
 
alexlefranc profile image
Alexandre LEFRANC

Hi,
Thanks for this post, very useful previously. For information, we can now install Podman desktop (and podman with MSI file), experimental but interressing.

Collapse
 
bowmanjd profile image
Jonathan Bowman

I will definitely try that, and update the article. Thank you!

Collapse
 
ajburley profile image
ajburley • Edited

I got this error, I solved it by running WSL itself with admin privileges when opening the WSL window to run sudo dockerd.

EDIT: It turned out that the eventual root cause of my issue was that my distribution was still on WSL1. Even after upgrading WSL to 2 and running wsl --set-default-version 2, my distribution was still WSL1 as it was created before the upgrade. So I had to run wsl --set-version Ubuntu 2 (where my distribution was called "Ubuntu") and this converted the distro to WSL2. Then this issue just went away, regardless of whether I ran WSL as admin.

Collapse
 
dirtysoc profile image
Derek

What an excellent write-up. Thank you!

I do have one question though. My understanding of the inner-workings of WSL is still rudimentary. Why do we place the docker socket in the \mnt\wsl folder? What is the significance of \mnt\wsl?

Collapse
 
fonata profile image
Fonata

Hey Derek, I believe the \mnt\wsl location is chosen so multiple Linux installations can share the same docker daemon. If you only run one it doesn't hurt, but you could use Docker's default location, /var/run/docker/containerd/containerd.sock

Collapse
 
bowmanjd profile image
Jonathan Bowman

Exactly!

Collapse
 
kcelestinomaria profile image
Celestine Kariuki

Thanks so much for this @jonathan Bowman, was really helpful, don't forget to do another article on installing docker-compose on a WSL Distro without passing through Docker Desktop, might be minimal but it would be a decent supplement to this awesome article of yours

Collapse
 
bowmanjd profile image
Jonathan Bowman

Thank you for the encouragement!

Collapse
 
jtitus profile image
Jeff • Edited

Jonathan, thank you for the incredibly detailed description of setting up Docker for use in WSL2 without Desktop. I'm sure a lot more people will be visiting this page now that Docker has changed their license terms.

For anyone struggling with using this behind a proxy, I found the only configuration file that dockerd looks at is /etc/environment, so set the likes of HTTP_PROXY, HTTPS_PROXY, and NO_PROXY in there before starting Docker.

Additionally, I found this to be helpful for configuring dockerd to start when opening a new terminal (if it hasn't already been started).

Lastly, if you are working behind a proxy and need access to a private container registry, and get an x.509 certificate error with docker login, grab the root certificate of the proxy from your browser (export as base-64) and drop it into the docker certs directory related to your private registry/etc/docker/certs.d/{private_reg_name}:{private_reg_port}/ca.crt (private_reg_port is optional if you're using a standard port). The next time you do docker login, the auth section of ~/.docker/config.json will be updated.

Collapse
 
nparkes profile image
nparkes

I love you. WSL2 Ubuntu+Windows10.

Goodbye Docker Desktop.

Collapse
 
medinam profile image
Luis Medina

Awesome post! Thanks!

Collapse
 
voronin profile image
Igor Voronin

Oh my god.. I now get why I should definitely try a tutorial from the beginning. I simply dismissed the warning about having to ensure WSL 2 is used... instead WSL 1 was used - and docker did not want to work with Ubuntu 20.04 installed in WSL 1 (various errors regarding not having permissions for "bridge" or missing some "iptables").

After converting to WSL 2 (yes - converting), it finally seems to work. Thank you for this brilliant article!

Collapse
 
arm1 profile image
Armand Paghent

Thanks for the article. It really helps.
My need was to have a docker command recognized by the windows "system". Indeed, I run programs that run docker, etc... but sometimes they tell me something like "you don't have docker installed" because they don't manage to "find" and run your docker powershell "function".
So installing the windows docker-cli.exe is one of the solution but :
Is it possible to use the windows docker-cli (docker.exe) to connect to that dockerd using the socket things ?
I followed all your instructions but i just changed the path to the docker.sock to unix:///mnt/c/path/docker.sock. but dockerd doesn't start with this folder. Any thought ?

Collapse
 
bowmanjd profile image
Jonathan Bowman

Yes, it is indeed possible using TCP, but I have yet to work through that and add an article...

Collapse
 
arm1 profile image
Armand Paghent

I found after my question an article based on yours, on that topic at dev.to/_nicolas_louis_/how-to-run-.... And Indeed, it works (I also needed to disable my VPN, i don't know exactly why..).
Thanks !

Collapse
 
dfseagate profile image
df-seagate • Edited

Thanks for putting this together. After spending 20+ hours trying to get Docker Desktop to work with flakey results at best I thought I'd give this a try. The instructions are fantastic. However, when I execute, docker run I'm getting a toomanyrequests: error.
When I try this on a Linux machine, I have not problems.
I've tried both Docker Desktop and WSL2 Docker on another laptop and had no issues.
Time to reinstall windows I guess :)

Collapse
 
bowmanjd profile image
Jonathan Bowman

It sounds like you have a working docker setup; however, you have performed too many requests to the Docker Hub: docs.docker.com/docker-hub/downloa...

Collapse
 
haughki profile image
Hawkeye Parker

Incredibly detailed and helpful post: thank you!!

I stumbled on the same issue as df-seagate:
"$ docker -H unix:///mnt/wsl/shared-docker/docker.sock run hello-world
Unable to find image 'hello-world:latest' locally
docker: Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: docker.com/increase-rate-limit."

I have rarely used docker, and this is a clean install on a machine on which I've never done anything with docker.

Shutting down my corporate VPN fixed the issue. I have no idea why. Also worth noting that I'm running wsl-vpnkit: github.com/sakai135/wsl-vpnkit

Collapse
 
timblaktu profile image
Tim Black

What are some elegant ways to restart your WSL docker daemon (e.g. after changing your daemon.json)? I'm not interested in "reboot windows". I'm currently using a script to run dockerd as a shell command passed to wsl.exe, run on user login, as described in this (excellent) article. I'm pretty novice at powershell and managing windows processes, and have pulled out a lot of hair just trying to get the equivalent of ps aux | grep dockerd and kill <pid> in windows. The output of tasklist (and even things like sysinternals ProcessExplorer, amazingly) don't show the arguments passed to the command running in the process.

What I'm thinking now is, how about wrapping the dockerd wsl script in a windows service or scheduled task. Anyone doing this and have any recommendations?

Collapse
 
dove6 profile image
Dawid Sygocki

After setting up Docker on Debian WSL2, I couldn't connect to the Internet from inside containers.
Switching back to legacy iptables (and removing "iptables": false from daemon.json) solved the issue for me.
The commands are listed here: wiki.debian.org/nftables#Reverting...

Collapse
 
brycolem profile image
Bryan Patrick Coleman

I followed the instructions on your page, when I ran

# update-alternatives --set iptables /usr/sbin/iptables-legacy
# update-alternatives --set ip6tables /usr/sbin/ip6tables-legacy
# update-alternatives --set arptables /usr/sbin/arptables-legacy
# update-alternatives --set ebtables /usr/sbin/ebtables-legacy
Enter fullscreen mode Exit fullscreen mode

I got an error saying arp and eb were not registered and weren't going to be set.

I still don't have any communication from the container out to the internet which is an issue since I need them to run containers for vscode which installs stuff from special scripts during container creation.

Collapse
 
bowmanjd profile image
Jonathan Bowman

I don't know if arp works on wsl... github.com/Microsoft/WSL/issues/2279. Curious if you find any solutions, though

Thread Thread
 
brycolem profile image
Bryan Patrick Coleman

After I reboot Windows it started working. So no entry with iptables and setting the iptables and ip6tables to legacy worked. It just needed to restart everything.

Collapse
 
richardeschloss profile image
Richard Schloss

I just swapped out Docker Desktop for the native Docker engine on WSL2 and my only question to myself is why I didn't do this sooner. My guess is the way the Docker docs are structured influenced my original decisions (their section on "Get Docker" primarily focuses on "Docker Desktop", with a tiny sentence for "Docker Engine" pushed all the way to the bottom). Anyhoo, my life just got seriously upgraded.

Collapse
 
bowmanjd profile image
Jonathan Bowman

So glad you found a good path. Any tips for others, or was it fairly straightforward?

Collapse
 
richardeschloss profile image
Richard Schloss

It was pretty straightforward.

Collapse
 
medicmen profile image
MedicMen

I have done everything,

First It did not run, but when disabled VPN it started working but listen on something else.
Then I stopped dockerd and tried to restart but I failed, so after hour what is going on I simply run killall -9 docker and start dockerd again.
And it was working

BUT

When I started powershell and Ubunt in another cmd and run

docker -H unix:///mnt/wsl/shared-docker/docker.sock run --rm hello-world

I do have an error:

docker: Error response from daemon: OCI runtime create failed: container_linux.go:380: starting container process caused: process_linux.go:722: waiting for init preliminary setup caused: EOF: unknown

???

Collapse
 
miguelsantos500 profile image
Miguel

In my case this was because my linux distro was still on wsl version 1. you have to

  • upgrade your system-wide wsl version from 1 to 2
  • upgrade your distro version ( wsl --set-version 2 )
Collapse
 
ajburley profile image
ajburley

Yes! Worked for me too. I had upgraded my system-wide WSL to 2 and set the default version to 2, but what I hadn't done was set the version for my specific installed distribution using --set-version.

Collapse
 
dirtysoc profile image
Derek

After using this with my WSL for a few weeks, I would like to bring up that I found issues using the k3d tool to run k3s clusters in WSL. Unfortunately it looks like k3d does not support moving the docker socket to a custom location.

Just leaving this info here for anyone considering setting up a shared docker socket!

github.com/rancher/k3d/issues/762

Collapse
 
bhayes profile image
b-hayes

Ive looked this up a few times now and have to pick out what I want.
Here is the short version for those who only use the default Ubuntu distro.

Follow this: docs.docker.com/engine/install/ubu...
Then run this: sudo usermod -aG docker $USER
And then install docker compose: sudo apt install docker-compose

Run docker:
start service: sudo dockerd
Test it: docker run hello-world

Collapse
 
petermicuch profile image
petermicuch • Edited

Thanks for the effort you put into this article. In my case when I modified /etc/docker/daemon.json, docker service was unable to restart, because of the error I could find in the journal: "unable to configure the Docker daemon with file /etc/docker/daemon.json: the following directives are specified both as a flag and in the configuration file: hosts: (from flag: [fd://], from file: [unix:///mnt/wsl/shared-docker/docker.sock])"

The help here was this post that suggested to remove duplicate host flag from the start command.

Collapse
 
bowmanjd profile image
Jonathan Bowman

Thanks for asking! This is an interesting problem. Curious what is in your /etc/docker/daemon.json?

Collapse
 
malaclypse profile image
Deia Georgieva

Hey, thank you so much for writing this, it's been very helpful!

What I can't figure out at the moment is how to run docker-compose from Windows in the same way as docker, could anyone offer some direction?

Collapse
 
bowmanjd profile image
Jonathan Bowman

Good question. My hunch is that this would require sharing the docker daemon over TCP (or using named pipes in Windows, as one commenter pointed out).

Collapse
 
faisal6621 profile image
Mohammad Faisal

From the step " Set default user", I am still logged in as root user.
My OS build version is 19042.2486 and I tried the first step to add [user] section in /etc/wsl.conf.

Collapse
 
faisal6621 profile image
Mohammad Faisal

I tried another approach to change the registry key but got the error for the command:

Get-ItemProperty : Property DistributionName does not exist at path HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Lxss\TryStoreWSL.
At line:1 char:1
+ Get-ItemProperty Registry::HKEY_CURRENT_USER\Software\Microsoft\Windo ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo          : InvalidArgument: (DistributionName:String) [Get-ItemProperty], PSArgumentException
    + FullyQualifiedErrorId : System.Management.Automation.PSArgumentException,Microsoft.PowerShell.Commands.GetItemPropertyCommand
Enter fullscreen mode Exit fullscreen mode

Then I tried to see the registry key manually and found that DefaultUid is already present with correct value. But somehow after this I am able to login with mydefaultUser in WSL.

Collapse
 
bowmanjd profile image
Jonathan Bowman

Glad it is working for you now! It could be that WSL hadn't completely terminated and restarted when you tried it at first? Hard to tell, but good job working through it.

Collapse
 
gtusr profile image
gtusr

I found this document on github:

WSL2 distributions run as containers

It hasn't been updated in a while though, so I'm wondering if anyone knows whether or not Microsoft has published a technical document yet that describes the presumed implementation of WSL2 distributions as containers in more detail.

Collapse
 
haosmos profile image
haosmos • Edited

Thank you very much for the detailed instructions!
Let me ask you some questions.

  • Did I understand correctly that installing docker directly into wsl is not supposed to get any benefits or improvements, but just a way to avoid installing a heavy docker desktop application in windows that consumes a lot of RAM?

  • The Ubuntu development team recently announced the implementation of systemd support in Ubuntu 22.04 - bugs.launchpad.net/ubuntu/+source/....

Some enthusiasts have already tried this and it seems to work: github.com/microsoft/WSL/issues/51...

The developers of Fedora Remix for WSL also announced a new version of the distribution with systemd support a couple of weeks ago — whitewaterfoundry.com/blog/2022/4/...

Can you tell me, please, if activating this feature (wsl-systemd) - will it require changes to this tutorial of yours?

And in general, will it change anything in the way docker was used in wsl before? Would it be a game changer?

Collapse
 
bowmanjd profile image
Jonathan Bowman