11 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
hugo	033443589c	fea: added a proper icon	2026-03-17 19:57:39 +01:00
hugo	1a67311874	feat: inference visualisation	2026-03-17 19:30:09 +01:00
hugo	5313b7175e	feat: complete rewrite to swift	2026-03-17 19:12:54 +01:00
hugo	c80fe97f41	feat: added gemma 3n E4B as another model for fast response	2026-03-17 13:24:43 +01:00
hugo	cc4f937d9a	feat: proper support for context size	2026-03-17 12:34:11 +01:00
hugo	540b187593	chore: added README	2026-03-17 12:07:45 +01:00
hugo	ef83c24b0b	feat: hot swapping of models	2026-03-17 11:58:24 +01:00
hugo	cc6e761ed4	feat: qwen now works, too	2026-03-17 11:44:24 +01:00
hugo	bdfbd14577	fix: trying to do kv prefix caching	2026-03-17 10:04:14 +01:00
hugo	5bf170cedb	removed kv quantization due to incompatibility with gemma3	2026-03-17 09:20:35 +01:00
hugo	df81afe8d7	initial commit	2026-03-17 09:14:27 +01:00