OMeter
→A Rich-powered Python CLI to list, benchmark, and compare Ollama models across local and cloud endpoints. Measures time-to-first-token (TTFT) and tokens-per-second (TPS) with multi-prompt averaging, persists runs to a local SQLite database, and shows inline trend arrows when historical data exists. Results are exportable to JSON/CSV and auto-published to a live GitHub Pages dashboard via scheduled GitHub Actions, with filtering, sorting, and time-series charts. Clean six-module architecture; installable as a uv tool or via pip.
17 stars on GitHub; MIT licensed; live auto-updating dashboard at EndoTheDev.github.io/OMeter
Active — v0.4.0