Skip to content

Latest commit

 

History

History
43 lines (23 loc) · 1.32 KB

File metadata and controls

43 lines (23 loc) · 1.32 KB

Static Badge


Adding your local Ollama instance

Ollama is free software that allows you to host models local to your environment. In this lab, it is expected that you already have it install. There is another set of labs that walk you through this. Ollama Basics

With that installed, from the Open WebUI Admin settings, you can add it as a Connection.

image21

image22

Enable the Ollama API feature and click the + to add a the server details.

image23

Fill in the server details and click Save. Your Ollama endpoint is likely something like

http://nameorIPofollamaserver:11434

image24

Go to the Models listing. You should now see the models that are served by Ollama.

image25

You can alter the settings of the individual models.

image26

You can set the visibility of the model and click Save.

image27

You should now be able to see the model in your list.

image28

That is the end of this lab. Head back to the start of this lab to see if there are other options you want to try with Open WebUI.