by Adarsh Patil on Mar 21, 2025 |

ArchReasoning Challenge @ ISCA 2025

June 21, 2025 in Tokyo, Japan
URL: https://sites.google.com/corp/view/mlarchsys/isca-2025/archreasoning-competition

Abstract or Paper Registration Deadline
April 25, 2025
Final Submission Deadline
April 25, 2025

ArchReasoning Challenge
co-located w/ MLArchSys 2025 @ ISCA 2025
Tokyo, Japan
https://sites.google.com/corp/view/mlarchsys/isca-2025/archreasoning-competition

Testing the Limits of LLM Reasoning in Computer Architecture and Systems

Objective:
The goal of this competition is to evaluate the reasoning capabilities of modern large language models (LLMs) in computer architecture and systems. Participants will submit challenging, reasoning-based questions, and the best questions will be tested against top AI reasoning models. The objective is to identify questions where AI fails, revealing the limits of LLM reasoning in computer architecture and systems.

  • Submission Deadline: May 2, 2025 (no extensions)