support deepseek v4 flash vision experimental #100
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
support for ds4 flash vision exp is available and https://github.com/antirez/ds4/blob/main/docs/MODELS.md talks about what model to download. we should check that it runs with our app, too, and is available. It needs a different dspark drafter https://github.com/antirez/ds4/blob/main/docs/SPECULATIVE_DECODING.md to support speculative decoding. The antirez/ds4 reference should have all the needed code already for it, so we should be able to just use it and it might be reduced to just having one more model in the catalog.