How we verify
The standard every figure on this site has to meet before it is published.
Most information about AI is undated, unsourced, and quietly wrong within weeks. This page states what we actually do about that.
The rules
Every figure has a source and a date. Prices, model sizes, context windows, licence terms, star counts, commit dates. If it cannot be traced to something you can open, it does not go on the page.
Data is fetched, not typed. Prices come from a public API on a schedule. Repository figures come from the GitHub API. Hand-entered numbers drift; fetched ones cannot.
Arithmetic is labelled as arithmetic. Memory requirements on this site are calculated — parameters multiplied by bytes per weight, plus context and overhead — not measured on every machine. The pages say so, because a calculated estimate presented as a measurement is exactly the kind of thing this site exists to correct.
Dated means dated. Every page that carries facts shows when they were checked, and states plainly when that was more than 90 days ago. A stale page that admits it is more useful than a fresh-looking one that does not.
Licences are reported as published. Where a model described as open forbids commercial use, the table says so. We do not soften the term "open source" to mean "downloadable".
Nothing is sponsored. No provider pays for a recommendation, and there are no affiliate links. Where the honest answer is "use a hosted model and do not bother with this", that is the answer given.
How to check us
You should not take any of the above on trust, which is the whole point of the list.
- Prices: compare the table against the provider's own pricing page. If they disagree, we are wrong and we want to know.
- Repository figures: the scripts that produce them are in the project. Re-run them and see.
- Anything else: ask for the source. If we cannot produce it, the claim should come out.
Where we get things wrong
Two ways, mostly.
Staleness. A price changes the day after a page is checked. This is why every page carries its check date, and why the changelog records what moved.
Arithmetic presented as fact. Calculated memory figures are estimates with assumptions behind them. They are labelled, but a label is easy to skim past.
Corrections are welcome and are made in public. The changelog records what changed and when.