7 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
hugo	cc4f937d9a	feat: proper support for context size	2026-03-17 12:34:11 +01:00
hugo	540b187593	chore: added README	2026-03-17 12:07:45 +01:00
hugo	ef83c24b0b	feat: hot swapping of models	2026-03-17 11:58:24 +01:00
hugo	cc6e761ed4	feat: qwen now works, too	2026-03-17 11:44:24 +01:00
hugo	bdfbd14577	fix: trying to do kv prefix caching	2026-03-17 10:04:14 +01:00
hugo	5bf170cedb	removed kv quantization due to incompatibility with gemma3	2026-03-17 09:20:35 +01:00
hugo	df81afe8d7	initial commit	2026-03-17 09:14:27 +01:00