Release-to-release CLI lint comparison · 5 November 2026 · public fixtures
Seconds, including CLI startup, linting and JSON output. Each cell has five measured runs; ranges retain every observation.
| Dialect | Processes | 4.4.0 median | 4.5.0 median | Less time | 4.4.0 range | 4.5.0 range |
|---|---|---|---|---|---|---|
| ANSI | 1 | 2.591 | 2.059 | 20.5% | 2.399–10.969 | 1.947–3.277 |
| ANSI | 4 | 2.990 | 2.807 | 6.1% | 2.843–3.476 | 2.527–3.310 |
| SNOWFLAKE | 1 | 4.965 | 3.349 | 32.5% | 3.929–5.757 | 2.608–3.782 |
| SNOWFLAKE | 4 | 3.249 | 2.601 | 19.9% | 3.232–3.273 | 2.574–2.632 |
| TSQL | 1 | 3.580 | 2.325 | 35.1% | 3.388–3.946 | 2.311–2.405 |
| TSQL | 4 | 2.735 | 2.247 | 17.9% | 2.641–2.785 | 2.246–2.275 |
This is a reproducible fixture sample, not a representative customer project, and not a universal speedup claim. Size-stratified grammar fixtures include both tiny and large statements. Results include all release changes, not only performance PRs. Different diagnostic wording and legitimate rule fixes may change findings; counts and source-position comparisons are recorded in quality.json. Timing instrumentation and JSON output are enabled equally in both versions.
The small ANSI four-worker difference is within the observed run-to-run variability; repeat on a quiet machine before treating it as a robust improvement. The real-project comparison is deferred. Rust, dbt/Jinja rendering, autofix throughput, cold-cache behaviour and CI/Linux performance have not been measured.
Use Python 3.13.15 on Windows. Unzip the evidence bundle, then run from its directory. Dependencies are pinned in the two requirements files.
uv venv --python 3.13.15 env-4.4.0 uv venv --python 3.13.15 env-4.5.0 uv pip install --python env-4.4.0/Scripts/python.exe -r requirements-4.4.0.txt uv pip install --python env-4.5.0/Scripts/python.exe -r requirements-4.5.0.txt python benchmark.py
The included corpus and manifest suffice for a rerun. To regenerate the corpus, remove the manifest and set SQLFLUFF_REPO to a local SQLFluff checkout containing tag 4.4.0. The runner uses the Windows virtual-environment layout.
Summary CSV · All measured observations · Corpus manifest · Environment · PNG chart · SVG chart