Mind the Query: A Benchmark Dataset towards Text2Cypher Task

We present a high-quality, multi-domain dataset for the Text2Cypher task which is enabling the translation of natural language (NL) questions into executable Cypher queries over graph databases. The dataset comprises 27,529 NL queries and corresponding Cyphers spanning across 11 real-world graph datasets, each accompanied by its corresponding Neo4j graph for grounded query execution. To ensure correctness, the queries are validated through a rigorous pipeline combining automated schema, runtime and value checks, along with manual review for logical correctness. Queries are further categorized by complexity to support fine-grained evaluation. In addition to the dataset, we plan to release the code to replicate our LLM-based data synthesis pipeline on new graph datasets, supporting extensibility and future research for the task of Text2Cypher.