mirror of
https://github.com/Haxxnet/Compose-Examples.git
synced 2025-11-09 13:04:06 +01:00
31 lines
763 B
Markdown
31 lines
763 B
Markdown
# References
|
|
|
|
- https://github.com/ollama/ollama
|
|
- https://hub.docker.com/r/ollama/ollama
|
|
- https://github.com/open-webui/open-webui
|
|
|
|
# Notes
|
|
|
|
You should spawn ollama first and download the [respective LLM models](https://ollama.com/library):
|
|
|
|
````
|
|
# spawn ollama
|
|
docker compose up -d ollama
|
|
|
|
# download an llm model
|
|
docker exec ollama ollama run llama3:8b
|
|
````
|
|
|
|
Afterwards, we can spawn Open WebUI and register our first user account:
|
|
|
|
````
|
|
# spawn ui
|
|
docker compose up -d ui
|
|
````
|
|
|
|
Finally, we may want to disable open user registration for Open WebUI by uncommenting the env `ENABLE_SIGNUP` variable and restarting the container.
|
|
|
|
> [!TIP]
|
|
>
|
|
> You likely want to pass a GPU into the Ollama container. Please read [this](https://hub.docker.com/r/ollama/ollama).
|