/benchmark

Run the Permafrost cache benchmark (offline emulator, no API key)

BOOST

jianzhichun@jianzhichun

GitHub

From plugin

permafrost

244 skills4 commands1 hook

> /plugin marketplace add jianzhichun/permafrost
> /plugin install permafrost@permafrost

Command definition

benchmark.md

description: Run the Permafrost cache benchmark (offline emulator, no API key)
argument-hint: "[turns]"
allowed-tools: Bash(python3:*)

Run the offline DeepSeek cache benchmark and report the result.

!`python3 "${CLAUDE_PLUGIN_ROOT}/benchmarks/bench.py" --turns ${ARGUMENTS:-12}`

Present the table to the user and call out the headline: in the realistic "both" scenario, how the hit rate and cost change between `off` and `aggressive` mode, and how many anchor resets each mode incurs. Note that this uses a faithful emulator of DeepSeek's prefix cache — to measure the live API instead, add `--real` with a `DEEPSEEK_API_KEY` set.

Read it on GitHub ↗

Stats

Python Bash Git GitHub Anthropic MCP

Stars

Forks

Maintained

Maintenance

Python

Language

MIT

License

4mo ago

Last commit

5mo ago

Created

Repo: jianzhichun/permafrost

In this plugin

4 commands 1 hook

commands

See everything inside

Ships withpermafrost

Freeze Claude Code's prompt prefix so DeepSeek's automatic cache always hits — alignment proxy + coalescing + keepalive, installable as a CC plugin. Measured 64% cheaper on real Claude Code traffic.

Get the whole plugin

Stars on GitHub