I wonder if the adult kids of some Docker execs own Macs, and they make it. Why on Earth make this not for the larger installed OSes, you know, the ones running Docker in production?
(disclaimer: I'm leading the Docker Model Runner team at Docker)
We decided to start with Apple silicon Macs, because they provide one of the worst experiences of running LLMs in a containerized form, while at the same time having very capable hardware, so it felt like a very sad situation for Mac users (because of the lack of GPU access within containers).
And of course we understand who our users are, so believe me when I say, macOS users on Apple silicon make up a significant portion of our user case, else we would not have started with it.
In production environments on Docker CE, you can already mount the GPUs, so while the UX is not great, it is not a blocker.
However, we have first class support for Docker Model Runner within Docker CE on our roadmap and we hope it comes sooner rather than later ;)
It will also be purely OSS, so no worries there.
I wonder if the adult kids of some Docker execs own Macs, and they make it. Why on Earth make this not for the larger installed OSes, you know, the ones running Docker in production?
(disclaimer: I'm leading the Docker Model Runner team at Docker)
We decided to start with Apple silicon Macs, because they provide one of the worst experiences of running LLMs in a containerized form, while at the same time having very capable hardware, so it felt like a very sad situation for Mac users (because of the lack of GPU access within containers).
And of course we understand who our users are, so believe me when I say, macOS users on Apple silicon make up a significant portion of our user case, else we would not have started with it.
In production environments on Docker CE, you can already mount the GPUs, so while the UX is not great, it is not a blocker.
However, we have first class support for Docker Model Runner within Docker CE on our roadmap and we hope it comes sooner rather than later ;) It will also be purely OSS, so no worries there.
Because the ones running Docker in production aren’t paying the license fees they make you pay to use Docker Desktop.
I'm pretty sure that's in development, it's just more difficult.