Project Overview
mistral.rs is a Rust-based LLM inference engine focused on running Hugging Face models efficiently across various hardware.
Core Features
- Supports inference on CPU, GPU, and Apple Silicon
- Zero-config loading of Hugging Face models
- Provides OpenAI-compatible endpoints
Tech Stack and License
The primary language is Rust, and the license is MIT.
Project Status
As of collection time, it has 7347 GitHub stars.










Comments
No comments yet
Be the first to comment