hugo bdfbd14577 fix: trying to do kv prefix caching

2026-03-17 10:04:14 +01:00

mlx_server

fix: trying to do kv prefix caching

2026-03-17 10:04:14 +01:00

.gitignore

initial commit

2026-03-17 09:14:27 +01:00

CLAUDE.md

initial commit

2026-03-17 09:14:27 +01:00

pyproject.toml

initial commit

2026-03-17 09:14:27 +01:00

run.sh

initial commit

2026-03-17 09:14:27 +01:00

test_server.py

initial commit

2026-03-17 09:14:27 +01:00

S

Description

a simple MLX based server for small models to run locally

MIT

3.3 MiB

0 Stars 1 Watchers 0 Forks

Languages

Swift 99.6%

Shell 0.4%