Date: Tue, 11 Apr 2023 17:11:59 +1000 From: Tim Preston <tim@timpreston.net> To: Mario Marietto <marietto2008@gmail.com> Cc: FreeBSD Mailing List <freebsd-questions@freebsd.org> Subject: Re: Docker Message-ID: <06be3a1e-9319-1a21-88b9-4f87328ee127@timpreston.net> In-Reply-To: <CA%2B1FSij9j922Nvv1Vhn43HznwpyGT99UZsU674G9hHWzR=UhvQ@mail.gmail.com> References: <20230329053443.6ADA6B6AFED5@dhcp-8e64.meeting.ietf.org> <8E16D624-2655-4A10-844A-93E4F63E9859@gromit.dlib.vt.edu> <078a1cf8-7ae2-c593-615b-f5f37fa2b3eb@timpreston.net> <CA%2B1FSij9j922Nvv1Vhn43HznwpyGT99UZsU674G9hHWzR=UhvQ@mail.gmail.com>
next in thread | previous in thread | raw e-mail | index | archive | help
This is a multi-part message in MIME format. --------------HoX8A1ohXtJRxbaflXIMx3LT Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit The port mentioned in the first article doesn't work any more, if I remember correctly. The second link describes how Linux containers might be run via Linux binary compatibility. It's not Docker exactly, but could be used to run Docker images. But the question I'd ask is "why?". If you need to run Docker images you should probably run them on Linux, to ensure 100% kernel compatibility. After all, Docker is a Linux-only technology. There doesn't seem much point trying to shoehorn it into FreeBSD. On 10/4/23 00:04, Mario Marietto wrote: > It seems that docker now can run on FreeBSD natively,not with the > collaboration of bhyve. What do you think ? > > He says : "Yes, OCI Containers on FreeBSD. What was proposed ages ago > as Docker done right" <https://www.truenas.com/blog/docker-done-right/>; > > https://productionwithscissors.run/2022/09/04/containerd-linux-on-freebsd/ > > On Tue, Apr 4, 2023 at 4:23 AM Tim Preston <tim@timpreston.net> wrote: > > It can be done, with a bit of manual tinkering. > > Here is a gist which explains how to run Docker in a CentOS 8 VM > (under bhyve). > > https://gist.github.com/tehpeh/7e5329d295eca9539e6462f36b6ce9c0 > > It's a bit out of date but the general idea would be the same for > CentOS stream, Alpine etc: install Docker, enable the service, > open firewall/networking, nfs mount a local directory. This is > pretty much what Docker for Mac does. > > If you're looking for the Docker hub image repository equivalent > for FreeBSD, take a look at Bastille templates or Potluck > (https://potluck.honeyguide.net/). > > However, and this is only my personal opinion, a pre-baked > container image repository is a bad idea. Apart from the security > issues and recent drama around Docker shutting down free accounts, > container images are often set up with default parameters not > useful in a production environment (or even your specific dev > environment) and are built against a particular kernel version, so > may not run as expected on a different kernel version. > > Again, only my opinion, but you're much better off building your > own, private, images targeting the particular OS/Kernel version > you use in dev/staging/production. In summary, prefer Dockerfiles > over pre-built images. > > I think the conversation we really need to have is not about > copying Docker, but instead how do we consistently create, run, > and scale jails across multiple FreeBSD hosts easily. > > Tim > > > On 2/4/23 02:54, Paul Mather wrote: >> On Mar 29, 2023, at 1:34 AM, John Levine<johnl@iecc.com> <mailto:johnl@iecc.com> wrote: >> >>> It appears that Tomek CEDRO<tomek@cedro.info> <mailto:tomek@cedro.info> said: >>>> if there are lots of images for linux docker, and docker is linux only >>>> solution, there is no reason to talk about it on bsd or even offer some >>>> sort of images of bsd for linux right? >>> Docker runs on MacOS with a linux emulation layer. FreeBSD already has >>> some linux emulation so in principle one could do the same thing, but >>> it'd be a lot of work for dubious benefit. >> I disagree it would be of dubious benefit. MacOS is a Tier 1 platform in the Docker ecosystem. Using Docker Desktop on macOS makes using Docker and Kubernetes for development work very easy on that platform, meaning you can stay in the environment you prefer. MacOS is not Linux, but the implementation on there is to use a shim Linux VM via the built-in macOS hypervisor (which, IIRC, is a derivative of bhyve). >> >> It would be great if the same thing could be done on FreeBSD. It would be beneficial if there was a supported docker machine driver for bhyve on FreeBSD. Right now, I believe the road to running Linux containers on FreeBSD is to use the VirtualBox docker machine driver, which is a bit heavyweight (in terms of added dependencies) for my liking. It would be nice if bhyve could be used to run the shim Linux VM. >> >> Other than that, much of the tooling to run Docker and Kubernetes is already in ports. But, those (e.g., in the case of Kubernetes) need to point to non-FreeBSD systems that are running the actual containers, pods, etc. It would be nice to be able to do it all on FreeBSD, at least for development and kicking-the-tyres purposes. >> >> Cheers, >> >> Paul. >> > > > > -- > Mario. --------------HoX8A1ohXtJRxbaflXIMx3LT Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: 8bit <html> <head> <meta http-equiv="Content-Type" content="text/html; charset=UTF-8"> </head> <body> The port mentioned in the first article doesn't work any more, if I remember correctly.<br> <br> The second link describes how Linux containers might be run via Linux binary compatibility. It's not Docker exactly, but could be used to run Docker images.<br> <br> But the question I'd ask is "why?". If you need to run Docker images you should probably run them on Linux, to ensure 100% kernel compatibility.<br> <br> After all, Docker is a Linux-only technology. There doesn't seem much point trying to shoehorn it into FreeBSD.<br> <br> <br> <div class="moz-cite-prefix">On 10/4/23 00:04, Mario Marietto wrote:<br> </div> <blockquote type="cite" cite="mid:CA+1FSij9j922Nvv1Vhn43HznwpyGT99UZsU674G9hHWzR=UhvQ@mail.gmail.com"> <meta http-equiv="content-type" content="text/html; charset=UTF-8"> <div dir="ltr"> <div>It seems that docker now can run on FreeBSD natively,not with the collaboration of bhyve. What do you think ?<br> </div> <div> <div class="gmail-_3cjCphgls6DH-irkVaA0GM"> <div class="gmail-_292iotee39Lmt0MkQZ2hPV gmail-RichTextJSON-root"> <p class="gmail-_1qeIAgB0cPwnLhDF9XSiJM">He says : "Yes, OCI Containers on FreeBSD. What was proposed ages ago as <a href="https://www.truenas.com/blog/docker-done-right/" class="gmail-_3t5uN8xUmg0TOwRCOGQEcU" rel="noopener nofollow ugc" target="_blank" moz-do-not-send="true">Docker done right"</a></p> </div> </div> </div> <div><a href="https://productionwithscissors.run/2022/09/04/containerd-linux-on-freebsd/" moz-do-not-send="true" class="moz-txt-link-freetext">https://productionwithscissors.run/2022/09/04/containerd-linux-on-freebsd/</a></div>; </div> <br> <div class="gmail_quote"> <div dir="ltr" class="gmail_attr">On Tue, Apr 4, 2023 at 4:23 AM Tim Preston <<a href="mailto:tim@timpreston.net" moz-do-not-send="true" class="moz-txt-link-freetext">tim@timpreston.net</a>> wrote:<br> </div> <blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"> <div> It can be done, with a bit of manual tinkering.<br> <br> Here is a gist which explains how to run Docker in a CentOS 8 VM (under bhyve). <br> <br> <a href="https://gist.github.com/tehpeh/7e5329d295eca9539e6462f36b6ce9c0" target="_blank" moz-do-not-send="true" class="moz-txt-link-freetext">https://gist.github.com/tehpeh/7e5329d295eca9539e6462f36b6ce9c0</a><br>; <br> It's a bit out of date but the general idea would be the same for CentOS stream, Alpine etc: install Docker, enable the service, open firewall/networking, nfs mount a local directory. This is pretty much what Docker for Mac does.<br> <br> If you're looking for the Docker hub image repository equivalent for FreeBSD, take a look at Bastille templates or Potluck (<a href="https://potluck.honeyguide.net/" target="_blank" moz-do-not-send="true" class="moz-txt-link-freetext">https://potluck.honeyguide.net/</a>).<br>; <br> However, and this is only my personal opinion, a pre-baked container image repository is a bad idea. Apart from the security issues and recent drama around Docker shutting down free accounts, container images are often set up with default parameters not useful in a production environment (or even your specific dev environment) and are built against a particular kernel version, so may not run as expected on a different kernel version.<br> <br> Again, only my opinion, but you're much better off building your own, private, images targeting the particular OS/Kernel version you use in dev/staging/production. In summary, prefer Dockerfiles over pre-built images.<br> <br> I think the conversation we really need to have is not about copying Docker, but instead how do we consistently create, run, and scale jails across multiple FreeBSD hosts easily.<br> <br> Tim<br> <br> <br> <div>On 2/4/23 02:54, Paul Mather wrote:<br> </div> <blockquote type="cite"> <pre>On Mar 29, 2023, at 1:34 AM, John Levine <a href="mailto:johnl@iecc.com" target="_blank" moz-do-not-send="true"><johnl@iecc.com></a> wrote: </pre> <blockquote type="cite"> <pre>It appears that Tomek CEDRO <a href="mailto:tomek@cedro.info" target="_blank" moz-do-not-send="true"><tomek@cedro.info></a> said: </pre> <blockquote type="cite"> <pre>if there are lots of images for linux docker, and docker is linux only solution, there is no reason to talk about it on bsd or even offer some sort of images of bsd for linux right? </pre> </blockquote> <pre>Docker runs on MacOS with a linux emulation layer. FreeBSD already has some linux emulation so in principle one could do the same thing, but it'd be a lot of work for dubious benefit. </pre> </blockquote> <pre>I disagree it would be of dubious benefit. MacOS is a Tier 1 platform in the Docker ecosystem. Using Docker Desktop on macOS makes using Docker and Kubernetes for development work very easy on that platform, meaning you can stay in the environment you prefer. MacOS is not Linux, but the implementation on there is to use a shim Linux VM via the built-in macOS hypervisor (which, IIRC, is a derivative of bhyve). It would be great if the same thing could be done on FreeBSD. It would be beneficial if there was a supported docker machine driver for bhyve on FreeBSD. Right now, I believe the road to running Linux containers on FreeBSD is to use the VirtualBox docker machine driver, which is a bit heavyweight (in terms of added dependencies) for my liking. It would be nice if bhyve could be used to run the shim Linux VM. Other than that, much of the tooling to run Docker and Kubernetes is already in ports. But, those (e.g., in the case of Kubernetes) need to point to non-FreeBSD systems that are running the actual containers, pods, etc. It would be nice to be able to do it all on FreeBSD, at least for development and kicking-the-tyres purposes. Cheers, Paul. </pre> </blockquote> <br> </div> </blockquote> </div> <br clear="all"> <br> <span class="gmail_signature_prefix">-- </span><br> <div dir="ltr" class="gmail_signature">Mario.<br> </div> </blockquote> <br> </body> </html> --------------HoX8A1ohXtJRxbaflXIMx3LT--
Want to link to this message? Use this URL: <https://mail-archive.FreeBSD.org/cgi/mid.cgi?06be3a1e-9319-1a21-88b9-4f87328ee127>