Google-Colab

Ollama is a great tool for testing LLMs and Embedding models locally. It’s possible to use this tool in Google Colab, but when you run ollama serve, your script will get stuck in that cell, and you won’t be able to run the following cells. Luckily, the solution is simple and can be done with code.

Google Colab’s UI from its file browser allows you to download files individually, but does not have an option to download entire directories; the solution is simple and can be done with code.