Onyx

Onyx is an open-source web app and server that provides a comprehensive application layer for Large Language Models. It functions as a search and AI assistance platform that connects to over 50 indexing connectors and Model Context Protocol (MCP) sources to aggregate company information into a single interface. The software is deployed as a server and accessed via a web application, allowing organizations to maintain control over their data and AI infrastructure.

Users can deploy the platform in two distinct modes depending on their resource availability and needs. The Lite version serves as a lightweight chat interface requiring less than 1GB of memory, making it suitable for quick testing or teams only requiring basic agent functionalities. The Standard version provides the full feature set, including vector and keyword indexing for Retrieval-Augmented Generation (RAG), background containers for job queues, and AI model inference servers. This version also integrates with Redis for in-memory caching and MinIO for blob storage to optimize performance for large scale use.

Key features

• Agentic RAG using hybrid indexing and AI agents for information retrieval
• Deep research capabilities for generating multi-step reports
• Custom agent creation with specific instructions and knowledge bases
• Web search integration with support for Serper, Google PSE, and Brave
• Sandboxed code execution for data analysis and graph rendering
• Artifact generation for creating downloadable documents and graphics
• Voice mode utilizing text-to-speech and speech-to-text
• Support for both proprietary LLMs and self-hosted providers like Ollama
• Enterprise tools including SSO, RBAC, and SCIM user provisioning

The system architecture supports Docker, Kubernetes, and Helm deployments, with specific guides provided for major cloud providers. It is designed for a wide range of users, from individual developers to large global organizations requiring audit logs, query history, and analytics broken down by team or model. The platform allows for the implementation of custom code to handle PII removal, reject sensitive queries, or perform specialized data analysis.

Onyx is available in a Community Edition under the MIT license and a separate Enterprise Edition for larger organizations requiring advanced administrative controls.