Run large language models on-device with a single Rust core compiled for macOS, iOS, Android, Linux, Windows, and Web. Exposes a C ABI to a full TypeScript agent framework.
Compute lives exclusively in L0 — every layer above is thin orchestration over the same highly-optimized engine.
Svelte 5 UI template · Android (JNI/Kotlin) · iOS (Swift) · Web Worker transport
@combs/core · @combs/graph · @combs/agents · @combs/runtime · @combs/flows
combs_engine_create · combs_chat_completion_stream · OpenAI-compatible server
Burn 0.21 · CubeCL · wgpu (Metal/Vulkan/DX12/WebGPU) · Paged KV cache · full sampler · GGUF/SafeTensors
Engineered for minimal overhead. Features a custom paged KV cache (page-16 arenas, LIFO free-list, prefix-safe popn), chunked prefill, and quantized linear layers with weights packed directly in VRAM.
Llama-family architectures validated with SmolLM2. Load SafeTensors (HF layout) or GGUF v3 directly via a single ModelSource adapter trait. combs run --model anything.gguf just works.
A complete Deno ecosystem built on top of the Combs C ABI, abstracting infrastructure while keeping native performance.
Combs.init("smollm2-135m") — presets, model cache, device planner, FFI / Remote / Worker engines.
LangGraph-equivalent: StateGraph, channels, Pregel runner, checkpointers (Deno KV/SQLite), human-in-the-loop.
Tools & ToolNode, ReAct agents, structured output, memory, MCP client, skills loader.
Agent HTTP/WS servers, orchestrator, agent pool, KV task queue, session stores.
createWorkflow (steps/loops/checks), createRoleplayChat, addMemory.
Scoped logging, OpenTelemetry-shaped spans, metrics observability.
Interactive CLI tool that stamps out a ready-to-build Svelte 5 app complete with Ed25519 auth, fine-grained network/storage permissions, and realtime network monitors.
$ combs chew chat-ui my-app --yes
Measured on Apple Silicon (wgpu → Metal) running SmolLM2-135M-Instruct.
cargo xtask bundle produces dist artifacts for every target.
| Target | Artifact | Status |
|---|---|---|
| macOS (arm64 / x86_64) | dylib | ✓ Built & tested |
| iOS (arm64) | .a | ✓ Builds |
| Android (arm64) | .so | ✓ Builds (NDK) |
| Linux / Windows | — | ✓ cargo check clean |
| Web (wasm32) | — | 🚧 skeleton |