{"id":11760,"date":"2025-08-25T20:40:43","date_gmt":"2025-08-25T20:40:43","guid":{"rendered":"https:\/\/putridparrot.com\/blog\/?p=11760"},"modified":"2025-08-25T21:05:45","modified_gmt":"2025-08-25T21:05:45","slug":"running-ollama-locally","status":"publish","type":"post","link":"https:\/\/putridparrot.com\/blog\/running-ollama-locally\/","title":{"rendered":"Running ollama locally"},"content":{"rendered":"<p>Installing ollama locally is easily done using docker, for example<\/p>\n<pre class=\"brush: plain; title: ; notranslate\" title=\"\">\r\ndocker run -d -v &quot;c:\\temp\\ollama:\/root\/.ollama&quot; -p 11434:11434 --name ollama ollama\/ollama\r\n<\/pre>\n<p>Next we&#8217;ll want to pull in a model, for example using <a href=\"https:\/\/azure.microsoft.com\/en-us\/blog\/introducing-phi-3-redefining-whats-possible-with-slms\/\" target=\"_blank\">phi3<\/a><\/p>\n<pre class=\"brush: plain; title: ; notranslate\" title=\"\">\r\ndocker exec -it ollama ollama run phi3 \r\n<\/pre>\n<p>We have several phi3 models, phi3:mini, phi3:medium and phi3:medium-128k (requires Ollama 0.1.39+).<\/p>\n<p>Other options include mistral, llama2 or openhermes. Just replace phi3 with your preferred model<\/p>\n<p>On running the <em>exec<\/em> command we get a &#8220;prompt&#8221; and can start a &#8220;chat&#8221; with the model.<\/p>\n<p>Use &#8220;\/bye&#8221; to exit the prompt.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Installing ollama locally is easily done using docker, for example docker run -d -v &quot;c:\\temp\\ollama:\/root\/.ollama&quot; -p 11434:11434 &#8211;name ollama ollama\/ollama Next we&#8217;ll want to pull in a model, for example using phi3 docker exec -it ollama ollama run phi3 We have several phi3 models, phi3:mini, phi3:medium and phi3:medium-128k (requires Ollama 0.1.39+). Other options include mistral, [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_memberships_contains_paid_content":false,"footnotes":""},"categories":[750,753],"tags":[],"class_list":["post-11760","post","type-post","status-publish","format-standard","hentry","category-llm","category-slm"],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/posts\/11760","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/comments?post=11760"}],"version-history":[{"count":4,"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/posts\/11760\/revisions"}],"predecessor-version":[{"id":11764,"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/posts\/11760\/revisions\/11764"}],"wp:attachment":[{"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/media?parent=11760"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/categories?post=11760"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/putridparrot.com\/blog\/wp-json\/wp\/v2\/tags?post=11760"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}