# Researchers release Build2SPARQL benchmark for text-to-SPARQL in building KGs

Digest AI · Research · published 2026-10-02T04:00:00Z

Canonical: https://digestai.news/story/researchers-release-build2sparql-benchmark-for-text-to-sparql-in-build

## Summary

Researchers introduced **Build2SPARQL**, a new benchmark dataset for converting natural language into SPARQL queries on building knowledge graphs. The dataset includes 6,136 executable SPARQL queries and 30,680 questions derived from 201 building KGs (180 Brick, 21 ASHRAE 223P). The queries cover six pattern families—linear chains, branching, UNION, aggregation, OPTIONAL, and attribute-filtered—phrased across five vocabulary registers.

Human validation rated 98.8% semantic fidelity and naturalness in 300 sampled questions, with 84% judged operationally plausible. Testing three open-weight language models showed zero-shot accuracy ranged from 0.2% to 20%, but retrieval-augmented prompts improved it to 56–65%. The dataset aims to advance AI-driven query generation for building automation systems.

## Key points

- Build2SPARQL dataset includes 6,136 SPARQL queries and 30,680 natural-language questions for building KGs
- Queries generated via code, questions by LLMs, ensuring correctness independent of model behavior
- Three open-weight models achieved 56–65% accuracy with retrieval-augmented prompts, up from 0.2–20% zero-shot

## Why it matters

The dataset accelerates AI research in natural-language querying for building automation, enabling smarter language agents to interact with semantic knowledge graphs. It fills a critical gap in benchmarking for real-world applications like HVAC or energy systems.

## Sources

1. [Build2SPARQL: A Large-Scale Text-to-SPARQL Benchmark Dataset for Building Knowledge Graph Querying](https://arxiv.org/abs/2610.00224) (arXiv cs.AI, 2026-10-02, primary source)

## Cite

Digest AI, "Researchers release Build2SPARQL benchmark for text-to-SPARQL in building KGs", 2 October 2026, https://digestai.news/story/researchers-release-build2sparql-benchmark-for-text-to-sparql-in-build

---

Written by Digest AI's editorial model from the linked sources; the sources are the record. Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse
JSON: https://digestai.news/story/researchers-release-build2sparql-benchmark-for-text-to-sparql-in-build.json