Skip to content

Criteria & Scoring

Each category is scored out of 10. Total: 60 points.


RequirementNotes
README with working setup instructionsMust get someone from clone to running in under 5 minutes
Architecture overviewComponents, data flow, and rationale for key choices
API documentationEndpoints, request/response format
Decision logWhat was descoped, trade-offs made, key technical choices and why
Known issuesHonest account of what’s broken and what you’d do with more time

Scored from the automated scan output compiled at code freeze. Scan results are shared with judges before demos begin.

Critical issues are weighted heavily:

  • Security vulnerabilities (hardcoded secrets, injection, missing validation)
  • Transaction integrity failures (race conditions, data consistency issues)

Also scanned:

  • Code quality (linting, dead code, complexity)
  • Architecture (file structure, separation of concerns, circular dependencies)
  • Test coverage (presence, quality, critical path coverage)
  • Documentation completeness
  • Dependency health (outdated packages, known vulnerabilities)

See the AI Agent Scan page for the full list of what gets checked.


RequirementNotes
Clean, consistent, readable codeConsistent style, sensible naming, no dead code
Sensible project structureSeparation of concerns, logical file organisation
Core business logic isolationLogic is well-isolated and independently testable
Database schema designWell-normalised, appropriate indexes, sensible relationships
Error handling and loggingErrors are caught, logged, and surfaced gracefully

RequirementNotes
Meaningful commit historyCommits throughout the day, not one push at 16:55
Docker Compose works first trydocker compose up brings the whole stack up
CI/CD pipelineEven a basic GitHub Actions workflow counts
Environment config.env.example present, no hardcoded secrets
App is live and accessibleLive URL in README, accessible during demo

RequirementNotes
Core business logic test coverageCritical paths, transaction integrity, edge cases
Edge cases handledInvalid states, concurrent operations, error conditions
App stabilityDoesn’t crash under normal usage
Input validationThroughout the app, including core business logic
Graceful error responsesAPI returns sensible error messages and status codes

RequirementNotes
End-to-end functionalityThe app actually works — full user journey from start to finish
Usable UXSomeone unfamiliar can navigate and use it
Clear and engaging demo5 minutes, shows the full flow
Explains decisions confidentlyTeam can articulate architectural choices and trade-offs
Bonus: live audience interactionLet audience members interact with your app during the demo

CategoryPoints
Documentation/10
AI Agent Scan Results/10
Code Quality & Architecture/10
DevOps & Deployment/10
Testing & Reliability/10
Product & Demo/10
Total/60