Submission by AWS Quick team: https://aws.amazon.com/quicksuite/

Contributors: Ravi Shankar, Leah Riley, Adi Kalyanpur, QuickScience team


BIRD leaderboard: https://bird-bench.github.io/

bird_rank_1_updated.png


To be updated

Citation

If you find our work helpful, feel free to give us a cite.

@techreport{qsql2025aws,
  title={Q-SQL: AWS, Memory with RL for Structured Data },
  author={Shankar, Ravi and Riley, Leah and Kalyanpur, Adi},
  institution={AWS Quick Team},
  year={2025},
  month={December},
  url={<https://aws.amazon.com/quicksuite/>},
  note={BIRD Benchmark Submission}
}

Appendix

✅ Consensus @K Results (Execution-Based)

Version Correct / Total Accuracy Δ vs Gemini
Spektr-SQL(Amazon Ads) 1104 / 1532 72.06 % -0.56 pts
Gemini-2.5 Pro 1113 / 1533 72.63 % N/A
Q-SQL(AWS: Quick Science) 1119 / 1533 72.99 % +0.36 pts

📊 Accuracy based on Count of Candidates(Higher is better):