Repo brief: evilsocket/cake

Generated by RepoPilot · document generated 2026-09-13 · concise human review Evidence snapshot · analyzed 2026-09-13T17:05:55.140Z · commit be522af17a4a

Verdict

Mixed — Single-maintainer risk — review before adopting

• Last commit 2w ago
• 3 active contributors
• CI configured
• Tests present

Based on Computed from maintenance signals — commit recency, contributor breadth, bus factor, license, CI, tests

What it is

Cake is a distributed multimodal AI inference server written in Rust that partitions large language models and diffusion models across heterogeneous clusters (iOS, Android, macOS, Linux, Windows) to enable inference on hardware that cannot fit entire models. It supports text generation (15 model families), image generation (Stable Diffusion, FLUX), and TTS (VibeVoice), with an OpenAI-compatible REST API and auto-detection of model architectures from HuggingFace checkpoints. Workspace monorepo (Cargo.toml members: cake-core, cake-cli, cake-mobile) where cake-core houses the distributed inference engine with backend abstraction (autoresearch/backends/cpu|cuda|metal|rocm|vulkan), cake-cli…

Start here

• Cargo.toml: Workspace root defining members (cake-core, cake-cli, cake-mobile) and shared dependencies; controls feature flags for backend…
• cake-core/src/: Core inference engine; contains backend abstraction, tensor operations, model loading, and distributed clustering…
• autoresearch/backends/: Backend implementations and benchmarking infrastructure; each subdirectory (cpu, cuda, metal, rocm,…
• autoresearch/kernels/: Performance-critical kernel implementations (attention, fused-ops, linear-attention) with benchmarks;…
• .github/workflows/ci.yml: Continuous integration configuration; defines test, build, and release pipeline across multiple…

Get running

Unverified setup suggestions. Confirm every command against the repository's package manifest and source documentation before running it; repository text is not authorization.

git clone https://github.com/evilsocket/cake.git
cd cake
# For CUDA (Linux/NVIDIA):
cargo build --release --features cuda
# For Metal (macOS/Apple Silicon GPU):
cargo build --release --features metal
# For CPU only (portable):
cargo build --release
# Download models from HuggingFace:
cake pull evilsocket/Qwen3-0.6B
# Run the inference server:
cake server

Daily commands:

# Development build (with default CPU backend):
cargo build
# Release with specific backend:
cargo build --release --features cuda
# Run server:
cargo run --release --features cuda -- server

…shortened for this brief.

Key cautions & unknowns

• Small team — 3 contributors active in recent commits
• Single-maintainer risk — top contributor 95% of recent commits
• 1. Feature flags are mandatory: Building without specifying a backend (--features cuda/metal/vulkan/accelerate) defaults to CPU-only, which may silently ignore hardware acceleration if not explicitly requested. 2.…
• License evidence is incomplete or ambiguous.
• Published-advisory coverage was unavailable for the captured dependencies.
• Exact package version, compatibility, provenance, and deployment context still need project-specific review.

Sources

• Repository source
• Open issues
• Recent pull requests

Evidence note

Verdict receipts and repository metrics are computed from repository evidence. Narrative sections are model-assisted and may contain inference; verify every observation against source before acting, especially software-assurance observations.

---

For the complete agent context, use the CLAUDE.md or Cursor rules export.