Category: Tutorial
-
3 different ways to change system prompt in the Cat
The system prompt in LLM based agents is the prompt main part, the one defining who the bot is, its main task and tone of voice.In the Cheshire Cat we call it prompt_prefix, with this… Read more
-
Cheshire Cat in the Cloud – Simply deploy to AWS with CDK
Explore the step-by-step process of deploying Cat on an AWS environment using the AWS CDK framework in this detailed guide.From configuring the environment to releasing your own version of the cat on the cloud. CAUTION… Read more
-
Voicing the Cheshire Cat
A multi-container application that allows the Cheshire Cat to talk! Giving voice to your favorite chatbot can increase the quality of the interaction by introducing a high degree of personalization to it.In this tutorial we… Read more
-
How to use Cheshire Cat behind NGINX
Startup guide with a basic setup to deploy the Cheshire Cat behind a reverse proxy with Nginx. In a production environment you would use Nginx in order to manage access to a specific resource, like… Read more
-
How to Install Cheshire Cat on Raspberry Pi 4
Greetings! In this whimsical guide, we’re about to embark on a journey to make the enigmatic Cheshire Cat come to life on your Raspberry Pi. Brace yourself as we go through the magical steps of… Read more
-
How to Setup a Local Embedder with Fastembed
Easy-to-use setup to run a local embedder model with FastEmbed Commonly, language models (i.e. chat and completion models) like GPTs, LLaMa, Mistral and so on get most of the attention. However, the so-called embedder models… Read more
-
How to Run a Local Model with Ollama
Easy-to-use setup to extend the Cheshire Cat Docker configuration and run a local model with Ollama. If you’re interested in having the Cheshire Cat running a local Large Language Model (LLM), there are a handful… Read more
-
Serving a Custom Large Language Model
How to setup the Cheshire Cat to run a custom Large Language Model (LLM). The Cheshire Cat offers two ways to setup a custom LLM, different from the Option number 1 will be treated in… Read more
-
Creating a plugin repository
Use the ready-made repository template to organize and automate the development of an official Cheshire Cat plugin. You can easily structure a project to develop a plugin for the Cheshire Cat exploiting the plugin-template repository.… Read more
-
Write Your First Plugin
This tutorial aims to guide you through the process of creating a plugin for the Cheshire Cat. It comprehensively addresses the fundamental aspects required to develop a plugin from the ground up. The tutorial provides… Read more