CompactAI Studio
Run AI models locally on your machine
Deprecation Notice: This utility is deprecated and only operates correctly up to Glint-1. It is advised to use the updated interface at https://huggingface.co/spaces/CompactAI-O/CompactAIModelRunner.
Run the browser version
Pull checkpoints from huggingface.co/CompactAI and chat locally without installing anything. Install dependencies with pip install -r requirements.txt before launching.
python3 interactive.py
Note: The launcher downloads model files from Hugging Face and caches them locally.