Georg Bauer bd6353804b Optimize Qwen3.8 inference on Apple silicon

2026-09-04 23:27:09 +02:00

..

argsort.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

bin.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

concat.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

cpy.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

dense.metal

Support DeepSeek V4 Flash 0731

2026-08-29 20:28:50 +02:00

dsv4_hc.metal

Support DeepSeek V4 Flash 0731

2026-08-29 20:28:50 +02:00

dsv4_kv.metal

Support DeepSeek V4 Flash 0731

2026-08-29 20:28:50 +02:00

dsv4_misc.metal

Add GLM 5.3 Flash support

2026-09-01 19:06:20 +02:00

dsv4_rope.metal

Support DeepSeek V4 Flash 0731

2026-08-29 20:28:50 +02:00

flash_attn.metal

Support DeepSeek V4 Flash 0731

2026-08-29 20:28:50 +02:00

get_rows.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

glm53_bf16.metal

Add GLM 5.3 Flash support

2026-09-01 19:06:20 +02:00

glm53_kda.metal

Add GLM 5.3 Flash support

2026-09-01 19:06:20 +02:00

glm53_vision.metal

Add GLM 5.3 Flash support

2026-09-01 19:06:20 +02:00

glu.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

moe.metal

Add GLM 5.3 Flash support

2026-09-01 19:06:20 +02:00

norm.metal

Support DeepSeek V4 Flash 0731

2026-08-29 20:28:50 +02:00

qwen38.metal

Optimize Qwen3.8 inference on Apple silicon

2026-09-04 23:27:09 +02:00

repeat.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

set_rows.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

softmax.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

sum_rows.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00

unary.metal

feat: first cut at actual token generation and model loading

2026-07-24 17:44:41 +02:00