Ollama

‘Gabo’ is a RAG (Retrieval-Augmented Generation) system designed to enhance the capabilities of LLMs (Large Language Models) such as ‘Llama 3.2’ or ‘Phi 3.5’. This project honors Colombian author Gabriel García Márquez by marking the tenth anniversary of his death.

Ollama is a great tool for testing LLMs and Embedding models locally. It’s possible to use this tool in Google Colab, but when you run ollama serve, your script will get stuck in that cell, and you won’t be able to run the following cells. Luckily, the solution is simple and can be done with code.