Description
Hi all,
I just installed jupyter-ai and wanted to configure any LLM (like in older versions). I do have API key for various providers and I run ollama locally. However the installation instructions only speak about setting up agents. Is there a way to connect to LLM-servers or ollama instead? I could not find it in the documentation.
Reproduce
Install jupyter-ai as explained here: https://jupyter-ai.readthedocs.io/en/stable/getting-started.html
Start a new chat. The window will look like this:
Expected behavior
In earlier versions, there was Jupyternaut installed. And there were configuration dialogs to setup something. I cannot find anything like in earlier version and do not know how to proceed.
After typing anything, I would expect at least an error message with some hints how to continue installation.
Context
This is mostyl about updating documentation and/or adding useful error messages. At the moment, users find a non-functional jupyter-ai after installation.
I work on Windows 11 with Python 3.12 and these packages installed:
pip list
Details
Package Version Editable project location
---------------------------------- ----------------- ----------------------------------
absl-py 2.5.0
accelerate 1.14.0
accessible-pygments 0.0.5
agent-client-protocol 0.11.0
aiofile 3.11.1
aiohappyeyeballs 2.6.2
aiohttp 3.14.1
aiosignal 1.4.0
aiosqlite 0.22.1
alabaster 0.7.16
annotated-doc 0.0.4
annotated-glass 0.1.0 C:\structure\code\annotated-glass
annotated-types 0.7.0
anthropic 0.111.0
anyio 4.14.0
anywidget 0.11.0
argon2-cffi 25.1.0
argon2-cffi-bindings 25.1.0
arrow 1.4.0
asttokens 3.0.1
async-lru 2.3.0
attrs 26.1.0
Authlib 1.7.2
azure-ai-contentunderstanding 1.2.0b2
azure-ai-documentintelligence 1.0.2
azure-ai-inference 1.0.0b9
azure-core 1.41.0
azure-identity 1.25.3
babel 2.18.0
banks 2.4.3
beartype 0.22.9
beautifulsoup4 4.15.0
bia-bob 0.34.3
bleach 6.4.0
blessings 1.7
blinker 1.9.0
bqplot 0.13.1
bqscales 0.3.7
branca 0.8.2
cachetools 7.1.6
caio 0.9.25
cellpose 4.2.1.1
certifi 2026.6.17
cffi 2.0.0
charset-normalizer 3.4.7
click 8.4.2
cobble 0.1.4
colorama 0.4.6
coloredlogs 15.0.1
comm 0.2.3
contourpy 1.3.3
cramjam 2.11.0
cryptography 49.0.0
cycler 0.12.1
cyclopts 4.22.1
dataclasses-json 0.6.7
datasets 5.0.0
debugpy 1.8.21
decorator 5.3.1
defusedxml 0.7.1
Deprecated 1.3.1
dill 0.4.1
dirtyjson 1.0.8
distro 1.9.0
dnspython 2.8.0
docker 7.1.0
docstring_parser 0.18.0
docutils 0.20.1
earthengine-api 1.7.33
editor 0.1.0 C:\structure\code\editor
ee 0.2
eerepr 0.1.2
email-validator 2.3.0
embeddoor 0.1.0
et_xmlfile 2.0.0
eval_type_backport 0.4.0
exceptiongroup 1.3.1
executing 2.2.1
fastapi 0.138.1
fastjsonschema 2.21.2
fastmcp 3.4.4
fastmcp-slim 3.4.4
fastparquet 2026.5.0
fastremap 1.20.0
filelock 3.29.4
filetype 1.2.0
fill_voids 2.1.2
Flask 3.1.3
flatbuffers 25.12.19
folium 0.20.0
fonttools 4.63.0
fqdn 1.5.1
frozenlist 1.8.0
fsspec 2026.4.0
future 1.0.0
geemap 0.38.3
geocoder 1.38.1
geopandas 1.1.4
google-api-core 2.31.0
google-api-python-client 2.198.0
google-auth 2.55.1
google-auth-httplib2 0.4.0
google-cloud-core 2.6.0
google-cloud-storage 3.12.0
google-crc32c 1.8.0
google-resumable-media 2.10.0
googleapis-common-protos 1.75.0
greenlet 3.5.2
griffe 2.1.0
griffecli 2.1.0
griffelib 2.1.0
grpcio 1.82.1
h11 0.16.0
hf-xet 1.5.1
httpcore 1.0.9
httplib2 0.32.0
httpx 0.28.1
httpx-sse 0.4.3
huggingface_hub 1.24.0
humanfriendly 10.0
idna 3.18
imagecodecs 2026.6.26
ImageIO 2.37.3
imagesize 2.0.0
importlib_metadata 8.7.1
ipycanvas 0.14.3
ipyevents 2.0.4
ipyfilechooser 0.6.0
ipykernel 7.3.0
ipyleaflet 0.20.0
ipympl 0.10.0
ipynbname 2025.8.0.0
ipython 9.14.1
ipython_pygments_lexers 1.1.1
ipywidgets 8.1.8
isodate 0.7.2
isoduration 20.11.0
isumap 0.1.0 C:\structure\code\IsUMap
itsdangerous 2.2.0
jaraco.classes 3.4.0
jaraco.context 6.1.2
jaraco.functools 4.6.0
jedi 0.20.0
Jinja2 3.1.6
jiter 0.15.0
joblib 1.5.3
joserfc 1.7.4
json5 0.15.0
jsonpath-python 1.1.6
jsonpointer 3.1.1
jsonref 1.1.0
jsonschema 4.26.0
jsonschema-path 0.5.0
jsonschema-specifications 2025.9.1
jupyter_ai 3.1.0
jupyter_ai_acp_client 0.2.0
jupyter_ai_chat_commands 0.0.4
jupyter_ai_persona_manager 0.1.2
jupyter_ai_router 0.0.5
jupyter_ai_tools 0.6.1
jupyter-book 1.0.3
jupyter_builder 1.0.2
jupyter-cache 1.0.1
jupyter_client 8.9.1
jupyter-collaboration 4.4.1
jupyter-collaboration-ui 2.4.1
jupyter_core 5.9.1
jupyter-docprovider 2.4.1
jupyter-events 0.12.1
jupyter-leaflet 0.20.0
jupyter-lsp 2.3.1
jupyter_server 2.20.0
jupyter_server_documents 0.3.1
jupyter_server_fileid 0.9.3
jupyter_server_mcp 0.2.1
jupyter_server_terminals 0.5.4
jupyter-server-ydoc 2.4.1
jupyter-vibe-coding 0.1.4
jupyter-ydoc 3.5.0
jupyterlab 4.6.0
jupyterlab_chat 0.23.0
jupyterlab_commands_toolkit 0.1.6
jupyterlab_eventlistener 0.4.0
jupyterlab_notebook_awareness 0.2.0
jupyterlab_pygments 0.3.0
jupyterlab_server 2.28.0
jupyterlab_widgets 3.0.16
jupytext 1.19.4
kagglehub 1.0.2
kagglesdk 0.1.30
keyring 25.7.0
kiwisolver 1.5.0
lark 1.3.1
latexcodec 3.0.1
lazy-loader 0.5
linkify-it-py 2.1.0
llama-index 0.14.22
llama-index-core 0.14.22
llama-index-embeddings-huggingface 0.7.0
llama-index-embeddings-openai 0.6.0
llama-index-instrumentation 0.5.0
llama-index-llms-ollama 0.10.1
llama-index-llms-openai 0.7.9
llama-index-llms-openai-like 0.7.2
llama-index-workflows 2.22.1
llvmlite 0.47.0
lunr 0.8.0
lxml 6.1.1
magika 0.6.3
mammoth 1.11.0
Markdown 3.10.2
markdown-it-py 3.0.0
markdownify 1.2.3
markitdown 0.1.6
MarkupSafe 3.0.3
marshmallow 3.26.2
matplotlib 3.11.0
matplotlib-inline 0.2.2
mcp 1.28.1
mdit-py-plugins 0.6.1
mdurl 0.1.2
metakernel 1.0.0
mistralai 2.4.13
mistune 3.3.1
more-itertools 11.1.0
mpmath 1.3.0
msal 1.37.0
msal-extensions 1.3.1
multidict 6.7.1
multiprocess 0.70.19
mypy_extensions 1.1.0
myst-nb 1.4.0
myst-parser 2.0.0
narwhals 2.22.1
natsort 8.4.0
nbclient 0.11.0
nbconvert 7.17.1
nbformat 5.10.4
nest-asyncio 1.6.0
nest-asyncio2 1.7.2
networkx 3.6.1
nltk 3.9.4
notebook_shim 0.2.4
numba 0.65.1
numpy 2.4.6
olefile 0.47
ollama 0.6.2
onnxruntime 1.20.1
openai 2.43.0
openapi-pydantic 0.5.1
opencv-python 5.0.0.93
opencv-python-headless 5.0.0.93
openpyxl 3.1.5
opentelemetry-api 1.39.1
opentelemetry-semantic-conventions 0.60b1
osmnx 2.1.0
packaging 26.2
pandas 3.0.3
pandocfilters 1.5.1
parso 0.8.7
pathable 0.6.0
pdf2gif 0.1.0
pdf2image 1.17.0
pdfminer.six 20260107
pdfplumber 0.11.10
peft 0.19.1
pexpect 4.9.0
pillow 12.3.0
pip 26.1.2
platformdirs 4.10.0
plotly 6.8.0
prometheus_client 0.25.0
prompt_toolkit 3.0.52
propcache 0.5.2
proto-plus 1.28.0
protobuf 7.35.1
psutil 7.2.2
psygnal 0.15.1
ptyprocess 0.7.0
pure_eval 0.2.3
py-key-value-aio 0.4.5
pyarrow 24.0.0
pyasn1 0.6.3
pyasn1_modules 0.4.2
pybind11 3.0.4
pybtex 0.26.1
pybtex-docutils 1.0.3
pyclesperanto 0.22.0
pyclesperanto-opencl 0.22.0
pycparser 3.0
pycrdt 0.13.1
pycrdt-store 0.1.4
pycrdt-websocket 0.16.2
pydantic 2.13.4
pydantic_core 2.46.4
pydantic-settings 2.14.2
pydata-sphinx-theme 0.16.1
pydub 0.25.1
PyGithub 2.9.1
Pygments 2.20.0
PyJWT 2.13.0
pylanczos 2.1.2
pymupdf 1.28.0
PyNaCl 1.6.2
pynndescent 0.6.0
pyogrio 0.13.0
pyparsing 3.3.2
pypdfium2 5.11.0
pyperclip 1.11.0
pyproj 3.7.2
pyreadline3 3.5.6
pyshp 3.1.4
PySide6 6.11.1
PySide6_Addons 6.11.1
PySide6_Essentials 6.11.1
python-box 7.4.1
python-dateutil 2.9.0.post0
python-dotenv 1.2.2
python-json-logger 4.1.0
python-multipart 0.0.32
python-pptx 1.0.2
pywin32 312
pywin32-ctypes 0.2.3
pywinpty 3.0.5
PyYAML 6.0.3
pyzmq 27.1.0
ratelim 0.1.6
referencing 0.37.0
regex 2026.5.9
requests 2.34.2
rfc3339-validator 0.1.4
rfc3986-validator 0.1.1
rfc3987-syntax 1.1.0
rich 15.0.0
rich-rst 2.1.0
rocm 7.14.0
rocm-bootstrap 0.1.0
rocm-sdk-core 7.14.0
rocm-sdk-libraries 7.14.0
roifile 2026.2.10
rpds-py 2026.5.1
safetensors 0.8.0
sand-bob 0.2.0 C:\structure\code\sand-bob
scikit-image 0.26.0
scikit-learn 1.9.0
scipy 1.18.0
scooby 0.11.2
seaborn 0.13.2
segment-anything 1.0
Send2Trash 2.1.0
sentence-transformers 5.6.0
setuptools 81.0.0
shapely 2.1.2
shellingham 1.5.4
shiboken6 6.11.1
siphash24 1.8
six 1.17.0
sniffio 1.3.1
snowballstemmer 3.1.1
soupsieve 2.8.4
SpeechRecognition 3.17.0
Sphinx 7.4.7
sphinx-book-theme 1.2.0
sphinx-comments 0.0.3
sphinx-copybutton 0.5.2
sphinx_design 0.7.0
sphinx_external_toc 1.1.0
sphinx-jupyterbook-latex 1.0.0
sphinx-multitoc-numbering 0.1.3
sphinx-thebe 0.3.1
sphinx-togglebutton 0.4.5
sphinxcontrib-applehelp 2.0.0
sphinxcontrib-bibtex 2.7.0
sphinxcontrib-devhelp 2.0.0
sphinxcontrib-htmlhelp 2.1.0
sphinxcontrib-jsmath 1.0.1
sphinxcontrib-lunrsearch 0.4
sphinxcontrib-qthelp 2.0.0
sphinxcontrib-serializinghtml 2.0.0
SQLAlchemy 2.0.51
sqlite-anyio 0.2.10
sse-starlette 3.4.6
stack-data 0.6.3
stackview 0.19.1
starlette 1.3.1
sympy 1.14.0
tabulate 0.10.0
tenacity 9.1.4
tensorboard 2.21.0
tensorboard-data-server 0.7.2
terminado 0.18.1
threadpoolctl 3.6.0
tifffile 2026.6.1
tiktoken 0.13.0
tinycss2 1.5.1
tinytag 2.2.1
tokenizers 0.22.2
toolz 1.1.0
torch 2.12.0+rocm7.14.0
torchaudio 2.11.0+rocm7.14.0
torchvision 0.27.0+rocm7.14.0
tornado 6.5.7
tqdm 4.68.3
traitlets 5.15.1
traittypes 0.2.3
transformers 5.14.1
trl 1.8.0
typer 0.25.1
typing_extensions 4.15.0
typing-inspect 0.9.0
typing-inspection 0.4.2
tzdata 2026.2
uc-micro-py 2.0.0
umap-learn 0.5.12
uncalled-for 0.3.2
uri-template 1.3.0
uritemplate 4.2.0
urllib3 2.7.0
uvicorn 0.49.0
vision-embedding-space-travelling 0.2.2
voila 0.5.12
watchfiles 1.2.0
wcwidth 0.8.1
webcolors 25.10.0
webencodings 0.5.1
websocket-client 1.9.0
websockets 16.0
Werkzeug 3.1.8
wheel 0.47.0
widgetsnbextension 4.0.15
wordcloud 1.9.6
wrapt 2.2.2
xarray 2026.4.0
xlrd 2.0.2
xlsxwriter 3.2.9
xxhash 3.8.0
xyzservices 2026.3.0
yarl 1.24.2
youtube-transcript-api 1.0.3
zenodo-auto-meta 0.1.0 C:\structure\code\zenodo-auto-meta
zipp 4.1.0
Description
Hi all,
I just installed jupyter-ai and wanted to configure any LLM (like in older versions). I do have API key for various providers and I run ollama locally. However the installation instructions only speak about setting up agents. Is there a way to connect to LLM-servers or ollama instead? I could not find it in the documentation.
Reproduce
Install jupyter-ai as explained here: https://jupyter-ai.readthedocs.io/en/stable/getting-started.html
Start a new chat. The window will look like this:
Expected behavior
In earlier versions, there was Jupyternaut installed. And there were configuration dialogs to setup something. I cannot find anything like in earlier version and do not know how to proceed.
After typing anything, I would expect at least an error message with some hints how to continue installation.
Context
This is mostyl about updating documentation and/or adding useful error messages. At the moment, users find a non-functional jupyter-ai after installation.
I work on Windows 11 with Python 3.12 and these packages installed:
Details