Soup CLI

Soup is a command-line tool that simplifies LLM fine-tuning and post-training workflows. It automates configuration generation, data validation, method selection, and evaluation setup from a single YAML file. The tool supports 23 training methods, 167 recipes, and 17 quantization formats, with integrations across HuggingFace, Ollama, vLLM, DeepSpeed, and other ML infrastructure.

A standout feature is layer streaming, which enables fine-tuning of Llama-3.1-8B on 4 GB GPUs by feeding frozen model layers one at a time. Soup includes a migration tool to convert configs from LLaMA-Factory, Axolotl, and Unsloth. The project is open-source under Apache-2.0 and requires Python 3.10–3.12. Soup Zero, a desktop workbench combining playground, data, evals, and monitoring, is in development.