statistics for prefill seem not to properly update #2
Reference in New Issue
Block a user
Delete Branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
when something is running, I see the token generation in the stats panel, but I don't see prefill and I don't see kvcache activities in the graphs. These need to be checked to see why I don't see them. The status does change to prefilling, just the graph stays empty.