Wolfram Function Repository
Instant-use add-on functions for the Wolfram Language
Function Repository Resource:
Ollama
Interact with local AI/LLM models via an Ollama server
Contributed by:
Arnoud Buzing
ResourceFunction["OllamaSynthesize"][prompt] generates a response to the given prompt using an AI model. | |
ResourceFunction["OllamaSynthesize"][prompt,images] generates a response for the given prompt and list of images. | |
ResourceFunction["OllamaSynthesize"][list] generates a response for a list containing textual prompts and images. |
Details and Options
OllamaSynthesize requires the user to pre-install the Ollama software and the desired models. This function does not manage the installation of Ollama and its models and will not work without it.
The default model used by OllamaSynthesize is "Llava" and must be pre-installed by the user. The "Llava" model supports images.
Models that do not support images, such as "LLama3.2", will not work with images and a failure will be returned.
You can specify a desired model with the "OllamaModel" option. Examples of how to do this are under the "Options" example section below.
OllamaSynthesize launches a server process and uses API requests to get its responses. The server binary is chosen automatically for default installation locations, but for non-default installation locations you can give the "OllamaServerBinary" option to specify that non-default location on your machine.
Examples
Basic Examples (2)
After installing Ollama and downloading a model, try a basic question:
| In[1]:= | ![ResourceFunction["OllamaSynthesize", ResourceVersion->"1.0.0"]["Hello, who was Albert Einstein?"]](https://www.wolframcloud.com/obj/resourcesystem/images/27e/27e9ad43-068f-4033-b272-8b197d4fc98e/1-0-0/79c6dac77b154b36.png){kind=small} |
| Out[1]= |  |
Ask a question about an image:
| In[2]:= | ![(* Evaluate this cell to get the example input *) CloudGet["https://www.wolframcloud.com/obj/5f05305d-1c7d-41ca-8d22-f14c1aa16e0b"]](https://www.wolframcloud.com/obj/resourcesystem/images/27e/27e9ad43-068f-4033-b272-8b197d4fc98e/1-0-0/527b18e32a2b9c37.png) |
| Out[2]= |  |
Ask another question about a different image:
| In[3]:= | ![(* Evaluate this cell to get the example input *) CloudGet["https://www.wolframcloud.com/obj/2ec42760-c521-4076-a2fc-94bc5b21ca63"]](https://www.wolframcloud.com/obj/resourcesystem/images/27e/27e9ad43-068f-4033-b272-8b197d4fc98e/1-0-0/6701d904fc84cc1b.png) |
| Out[3]= |  |
Mix the question and image(s) in a single list:
| In[4]:= | ![ResourceFunction["OllamaSynthesize"][{\!\(\*
GraphicsBox[
TagBox[RasterBox[CompressedData["
1:eJztXT2PFEcQRbYDR+gScizxAxCRQxyhyxDWxXwZEEjm+DjJOhIQhCBBQIog
IgRCMiCEBImUgIQUkZGu761VuHj7unu652OnZ/dJbe5u1rszXV1Vrz6697cz
2yfO/7Rv377rv+7958Tpf/64du307p8be79sXb5+8cLlc39tXt45d+Hctd/P
/Lz3x/N74++98cvemK0x+/Tp0+zWrVuzgwcPzjAlGxsbs1OnTs3/vsb4AFlB
RpAVD8hwLbfxALI4fPiwlJUfR48eXfatrjH7T15mB5uMr1+/LvuWVxoheeFv
r169mssHuuWv4e9rLAcheZ08efIHXQL/8NefPHmyxLtebSj/dfPmzYXXrfVs
HAA/bCIvgHnk+/fvh73ZNeZ6wvI6fvy4fC3sJ792jeHBPiwWdz1+/HjpXB9r
7MGDB3O/igEbsUpxorKJsednXwYZDgFwoFh8j4HrU4fiiSEfZq8PyRf/wq9B
BzDwc1dxG3QqJqtV4kNXrlxZsImxeWaOj3lM5UrwGvhGxAO59guvZ71e5bwM
ZMM6FrNzSsdKRtPcMvQllIvBOsB6w/3ev39/4dpUwVwC8xMD61ifsoMtDMkK
tpttAdvNqYJtWkzHFE9RNtJ4HAbsYcpuYp1wbBf6LNg8JWPIbxX0TNk5zBXW
N/61Yb/H7JPlIEPANayHmF/C5wChz4L9C+HFixcr4c/YLuaO7e3tIk6ItRKy
sUqmWBcpHsjvh3U0NcR8e2pgDruIx/AeKe6O66mcmLIXU8qjlfDmPucD9xOS
G/7ehFuyjk3JLqZiUuMP8BvQAePQ8C+YB/CJPmJVrIHStaF0bKicTN/guNmv
ZcWbhwbzDtxXk3tSOdIpIOTvSzlEH8B9sA1I6XRujrQWKP2y/oCxgWWA+4Q9
V3JQnBdrsHaoPAJ81ljXYiwv5vMlirekcqQ1QD0/5DX250pxWsiOfVhTfjl2
sA+rpW8U9wh+mhN7xPIjtUD1CNQgLw/Yg+fPnydz0rE6X03g58TvNSOU65qK
TYzVkGsHdEr56NrBHLiJjllvQQ0+T8mty/6PL1++zN68eTN7+vTp/OchwP4b
PiEFHxPUIDeOOdvayG/fvs3l9PDhw9nVq1e/j5cvX3Z30xEwD27C7TneqSEm
4Ocsrb1ALjdu3Pgup93d3bmOvX37di7LvsG12pzcG3PNUC/qWMD32zQ/afj4
8ePszp0732UFHfvw4cMgcvJg/pFbk+A+mLHXDTn+tjp3CrCDJqvbt2/P5bcs
tJEZ6h5Ncq7WI4DX+r4P/A7fOWStkXNzTWwD7tHkhZ+H1isGy6wJD8Z9h/JF
PocHW9S0Vor/b4h91rl9O/BT5rPevXu3cB3ygx+Dj4txRswFbBDWCAbWa+la
zfVnTWpqGLm5JI41+pQd93SFPsv0C/L6/PnzwnXYS89F4NvUe8T6MTBPJc/K
7xl7D1WT9zWa0N5BvM56QW1greGeVR0c79Ek5igBP4Na79CbkLygT57j4+fX
r18vvEeqT9Cv99xn5WeI+WXIBHMP7qE4F8srVCPleQrZ0T72PrCt4Log+EVI
dyAv444xLlLSn5az5xUybsMdDbyuQj0WxjXNd5o9tWdluTfhdsZz8NoUf+f7
5LkymXB8DN9l1+7evRvkIsrWmO+wvSShXGhTH6dq9E05sIe/z1itw8+Zfa7n
LuqsClUjx+tNP/39p+KNmJ6BZ5gOMYyP4FqMO3L8E8oTQVfa1GFVP0yOb/Tx
quIxPjep1gj7UbzGy43fM7afLJUvZX7kZWZ+ClzQAzbR7GUqp5iz/4RtXI6d
U71nOb7Exz28zr2M8DysQ5hjpUecHzMbFvIVeNYm/WAx3ggeqPTIOCR0LQaO
nZrklVgvm9g5tTcJI4fLeD1VslbrycvY9g2ybvv3tfXHcTFz19Szsj3xAEdU
vOLRo0dzmaXyH6X5PBVDxZ5J+cPcWq6fR2Wb/LMY51frhOfQz7FdY7uZ47tL
91XAHqoYza5BlrjONqCpreJnivnBnHMiYvAyUbkFmyt/TfErNYf+Nb6Pyv+9
aT0oJ65JAXwF/NHXYo4dO1bsX1RvGNdLVH26TU+B/zzWa7++1bk8sTlXMlPP
mMq7dVmPt5ibB8ssN2eufLVfx6rPqk0NzOssy8DbOPNf3obHuJW/R74/9h8x
G9nVvoqQvDC2traK/JmHqqvjfVTvadscH3N47mUN5SpxJlYIft2F9Mh8Y0wG
SsdK+qI95/e1GXAs/Hv27NkFPSgB5kTNVVc20YPXvdc3yNSvdcg3Fnuzzyrd
u6J4cWl91tdlLNfo4wJwEfZJJbZLcZKudcwj1TOD+7HYOgTen9hm74p69tLn
vXfv3g8yU/E1x+ylZ+fF6iN99DKqONFqZCGfY7kodZZISa1JnReJ0aYn1csL
nFGB/U7b+VU60FfNI1SXMTlg/WNOMWKvK60NqjXadh8M20UF9p25fScKXdjb
HITi59QInRHRFCr/2ha+xokcfwis3230gnM3Q+4jNrsX862YVzuHoi3U+U5t
wf4slN/nXEWbeR5Tf5s/lyzFSUpQsg80BeaNqkek689mmdW+lyIFXu9tn9fX
sGM+DWA9L9W1VZNZH+cjeZ8Wy/V3FceX9MbVDuYDbWNRzl2FOD+Qe2ZiCEPz
xmWD563t+fDgHaxrIV6o/FpJrzWvu6mf68q58jb1FwN64zjvGLKRKr+QayPb
7jWoDVzn7GpPAe9jgu6FekVYT0psJMe4Yzz7oyv0xbtgI5HL93JDnK3kpuqZ
uWsn1Sc1JfTJldFPwL4tJLcubCRkD1s/ZbsI9B3fcMwWk5uykWPfI7sMlPbV
5AD9kCw36B/3jisbOaVzCLsC50K64I0KSm6qh1z1fEydu+diyO+Cgl6xf7Mc
l7eVqs9i/b1i/2PoHAJkw3zSbKXpnOodmMp5M23B/GMo3wG52Z4MxU/AW5Rv
W3OS5X2vkAH5EmUrrff/2bNnCzYydG4H/LDVF6cK5euXsYahc9bvr8bm5ubC
fXI8ws/SVz/IMqF6UZZddwKvVH4O48iRIwtyM33K/X6eWqHONhzD2oTOhfqQ
Dx06JGMAdX7vFPMgqgYyplqh4iiXLl2aHThwYEFuPKaoYwala33F06Vg2UFu
+/fvD8pr6rlhQO05HiO87NDzH5Lb2NZcH+ij96pPQHbwuzs7O1JuqxK7sa7V
Et/wHvdVsIsGfvYxcZEYxtSLugzU+B2Q3BMx5dw/fBh0C37BztZqei7ZmMD7
a6bEPyAjPE/ovDM1apBZ6oynGgFdKv0uvRqef2oya3rOXs1ym4rMQns3mRPb
9x+C12OE9k+NOVabisxC+4shR3COWO5UfX/rmGOeIXqP+oaqh0F/cnQFPpDl
Ntb1y1x/2bWkEqjzIkpqEl3uwewTJWfUjQm85trUkFQOcqz1KL7PGmIUA/eW
ta0hsV8c6/eJd3mm2tBgrth2jnkuxsof2YeP1Y4rxM6jHcP79YXaakkeXfIG
1d8zVn8GdLWXfmio85JLz3ypbQ64JlNLLQkIfde5nQfZBCrnVUNPjD/zqqbv
kE2djwd9Aa/CumRbh9+VzMeuYx7qjO0awGdApoad6x+6VuMc1IrSc8/W8lo+
7NyzHPm1Pa9uje4A+WGfOWIv+D0f1+DnJt+d8C83sSxf
"], {{0, 102.}, {109., 0}}, {0, 255},
ColorFunction->RGBColor,
ImageResolution->{72, 72}],
BoxForm`ImageTag["Byte", ColorSpace -> "RGB", Interleaving -> True],
Selectable->False],
DefaultBaseStyle->"ImageGraphics",
ImageSizeRaw->{109., 102.},
PlotRange->{{0, 109.}, {0, 102.}}]\), "What is in this image?"}]](https://www.wolframcloud.com/obj/resourcesystem/images/27e/27e9ad43-068f-4033-b272-8b197d4fc98e/1-0-0/7fa8fc3159b00962.png) |
| Out[4]= |  |
Options (2)
The default model is "Llava". Use the "OllamaModel" option to specify another one:
| In[5]:= | ![ResourceFunction["OllamaSynthesize"]["Hello, who are what are you?", "OllamaModel" -> "llama3.2"]](https://www.wolframcloud.com/obj/resourcesystem/images/27e/27e9ad43-068f-4033-b272-8b197d4fc98e/1-0-0/129d170c2e6d6a88.png){kind=small} |
| Out[5]= |  |
If you specify a model that does not exist or a model that you did not download locally, then an error is raised:
| In[6]:= | ![ResourceFunction["OllamaSynthesize"]["Hello, who are what are you?", "OllamaModel" -> "xxx"]](https://www.wolframcloud.com/obj/resourcesystem/images/27e/27e9ad43-068f-4033-b272-8b197d4fc98e/1-0-0/73bddccdb0c7d623.png){kind=small} |
| Out[6]= |  |
Publisher
Requirements
Wolfram Language 14.0 (January 2024) or above
Version History
- 1.0.1 – 15 January 2025
- 1.0.0 – 13 November 2024
Related Resources
Related Symbols
License Information
This work is licensed under a Creative Commons Attribution 4.0 International License