Ollama in a container?
Uncategorized
2
Posts
2
Posters
0
Views
-
Ollama in a container? Yes, it's doable!
Setting Up Ollama With Docker [With NVIDIA GPU]
Step by step tutorial for running Ollama in Docker containers. Yes, Nvidia GPU can also be used in this setup. You can use Docker Compose as well, if you want.
It's FOSS (itsfoss.com)
-
Ollama in a container? Yes, it's doable!
Setting Up Ollama With Docker [With NVIDIA GPU]
Step by step tutorial for running Ollama in Docker containers. Yes, Nvidia GPU can also be used in this setup. You can use Docker Compose as well, if you want.
It's FOSS (itsfoss.com)
@itsfoss can you share recommendations for keeping AI locked up? I'd love to experiment but I dont have spare hardware that could be dedicated to an AI
