DevOps

13 September 2024
Running Cheshire Cat AI behind a reverse Proxy
Cheshire Cat AI is a robust framework that enables the development of AI agents proficient in advanced conversational interactions. It supports training agents with various document formats and integrating them with external APIs and applications. The framework accommodates both commercial and open-source large language models (LLMs) and embedding models, providing flexibility in model selection. Developers can enhance agent functionalities through a plugin system, allowing the addition of custom features and tools. In its default configuration, Cheshire Cat AI operates on a standard port without SSL support. However, SSL is essential for web-based services to ensure data encryption and privacy protection. To address this, a specific Docker Compose file was created to deploy Cheshire Cat AI behind a Traefik-powered reverse proxy, which manages SSL termination and secures the service. This setup is detailed in an article on the Cheshire Cat AI official blog.