Scoring and review process text for the sign-up page#
Evaluation method#
Final reviews will be performed by three independent AI reviewers. Each submission will be scored using the same weighted scoring matrix. Scores will be combined to determine category winners.
- Per‑AI scoring: Each AI assigns a score from 0–10 for each rubric dimension.
- Weighted total: Each dimension score is multiplied by its weight.
- Final score: The three weighted totals are averaged.
Note: AI scoring is an approximation tool for consistency and scale—not a claim of objective truth.
Weighted scoring matrix#
Weights#
| Dimension | Weight |
|---|---|
| Coherence and internal consistency | 0.22 |
| Evidence and scientific ingredients | 0.18 |
| Reproducibility and auditability | 0.14 |
| Novelty and insight | 0.14 |
| Cross-domain synthesis | 0.10 |
| Documentation quality and navigation | 0.10 |
| Responsible AI use and attribution | 0.07 |
| Craft and completeness | 0.05 |
Dimension definitions#
- Coherence and internal consistency: Clear thesis, stable definitions, no contradictions, strong through-line.
- Evidence and scientific ingredients: Uses standard ingredients where applicable (claims, references, methods, assumptions, limitations).
- Reproducibility and auditability: Others can follow the steps, verify claims, and trace sources/decisions.
- Novelty and insight: Non-obvious contributions, useful reframing, original synthesis, or new structure.
- Cross-domain synthesis: Bridges domains without hand-waving; preserves meaning across translations.
- Documentation quality and navigation: Readable, well-indexed, clear entry points, good information architecture.
- Responsible AI use and attribution: Transparent use of AI, citations where relevant, no deceptive authorship.
- Craft and completeness: Feels finished; scope matches execution; minimal broken links/holes.
Winner determination#
Overall placements#
- 🥇 Best Overall Canon
- 🥈 Second Overall
- 🥉 Third Overall
Category awards#
Category winners are selected using either:
- Highest score on a relevant subset of dimensions, or
- Highest overall score among submissions that clearly qualify.
Suggested category mappings:
- 🌐 Best Cross‑Domain: Cross-domain synthesis (primary), coherence, evidence
- 🤝 Best Crowdsourced Effort: documentation, auditability, craft, coherence
- 💥 Most Mind‑Blowing: novelty (primary), coherence
- 🧩 Best Structural Coherence: coherence (primary), documentation
- 🚀 Best Use of AI Assistance: responsible AI use (primary), auditability, documentation