|
|
c80fe97f41
|
feat: added gemma 3n E4B as another model for fast response
|
2026-03-17 13:24:43 +01:00 |
|
|
|
cc4f937d9a
|
feat: proper support for context size
|
2026-03-17 12:34:11 +01:00 |
|
|
|
ef83c24b0b
|
feat: hot swapping of models
|
2026-03-17 11:58:24 +01:00 |
|
|
|
cc6e761ed4
|
feat: qwen now works, too
|
2026-03-17 11:44:24 +01:00 |
|
|
|
bdfbd14577
|
fix: trying to do kv prefix caching
|
2026-03-17 10:04:14 +01:00 |
|
|
|
5bf170cedb
|
removed kv quantization due to incompatibility with gemma3
|
2026-03-17 09:20:35 +01:00 |
|
|
|
df81afe8d7
|
initial commit
|
2026-03-17 09:14:27 +01:00 |
|
