CactusOpen-Source Edge AI Engine for Multi-Model Inference with OpenAI-Compatible APIs

Project Overview

Cactus is an open-source edge AI engine designed to run artificial intelligence models on phones, wearables, and IoT devices. It supports multiple modalities including language, vision, and speech, and offers a unified interface through OpenAI-compatible APIs for easy integration.

Core Features

• Local inference for language, vision, and speech models.
• OpenAI-compatible APIs to reduce migration overhead.
• Optimized for edge devices to handle resource-constrained environments.

Tech Stack and License

The project is primarily written in C++, and its license is listed as Other (specific details can be found in the repository). As of collection time, it has 5365 stars on GitHub.

Getting Started

Please refer to the README document in the repository for installation and usage instructions.