berriai / litellm

GitHub

Code

How berriai/litellm is laid out, and where to start for common changes.

Architecture grade

score 66/100

Import cycles

lower is better

400

Files mapped

991 imports between them

89%

Layering

of imports point one way

From the map of which files import which. It shows what depends on what, not a reading order.

Module map

Shade by

66 modules, 195 links. A link means one module imports another; thicker lines mean more imports. Links come from 400 of 5,473 source files, so the real counts are higher. Select a module to trace it: blue lines go to what it uses, orange lines come from what uses it.

Where to start reading

Repository root
Repository root
Likely public API
Likely public API
Likely start-up file
Likely start-up file
Suggested starting pointAI
Suggested starting pointAI

Find files for a task

Add support for a new LLM provider

Create a new provider module under litellm/llms/ with format provider_name.py following the adapter pattern used by existing providers
Register the provider in the dispatcher by adding a conditional branch in dispatch.py to route requests to your provider

Add a new caching backend

Create a new cache class implementing the cache interface in litellm/caching/__init__.py

Add a new proxy authentication method

Create a new auth handler class implementing the base credentials interface
Wire the new auth handler into the proxy middleware stack in litellm/proxy/__init__.py

Add a new observability integration

Change the public API

Trace runtime behavior

Add or update tests

Change build or automation

RepoPilot lists up to 500 files, so a file missing here may still exist.

Files marked “likely” are guessed from their names.

Code quality and hotspots

Largest source files

Branch points93 per file on average
Code issues1 error, 22 warnings
Largest file4,988 lines
Hotspot load10 high-risk files

Static checks on the 15 largest source files.

Tests, CI and tooling

CICircleCI · GitHub Actions40 workflows
Tests6,805 test filesPytest · 1.2 test files per source file (file count, not coverage)
Dependency updatesCodeQL
CI pass rate84%last 50 runs

Test folders: helm/litellm-helm/tests · helm/litellm/tests · cookbook/litellm_router_load_test

Hotspots

litellm/router_strategy/complexity_router/complexity_router.py100 commits in 180 days · 167 branch points
litellm/proxy/_experimental/mcp_server/auth/user_api_key_auth_mcp.py100 commits in 180 days · 146 branch points
litellm/responses/litellm_completion_transformation/transformation.py100 commits in 180 days · 129 branch points
litellm/cost_calculator.py100 commits in 180 days · 150 branch points
litellm/proxy/_experimental/mcp_server/discoverable_endpoints.py100 commits in 180 days · 59 branch points
litellm/responses/streaming_iterator.py100 commits in 180 days · 165 branch points
litellm/responses/main.py80 commits in 180 days · 41 branch points
litellm/proxy/_experimental/mcp_server/db.py64 commits in 180 days · 72 branch points

Files that change often and branch heavily, highest first. Branch points count if, loop, case, catch, ternary, && and || in the file.