{"version":1,"type":"story","url":"https://digestai.news/story/ibm-research-releases-clariedge-dataset-and-fine-tuned-lora-for-query","json":"https://digestai.news/story/ibm-research-releases-clariedge-dataset-and-fine-tuned-lora-for-query.json","markdown":"https://digestai.news/story/ibm-research-releases-clariedge-dataset-and-fine-tuned-lora-for-query.md","slug":"ibm-research-releases-clariedge-dataset-and-fine-tuned-lora-for-query","headline":"IBM Research releases ClariEdge dataset and fine-tuned LoRA for query clarification","summary":"IBM Research introduced ClariEdge, a new dataset of roughly 3,900 examples that capture ambiguous user queries and negative cases that do not need clarification in retrieval‑augmented generation (RAG) pipelines. The data cover both ill‑formed queries and well‑formed queries that become ambiguous after document retrieval, enabling models to detect when a clarification request is required.\n\nThe authors fine‑tuned a lightweight LoRA adapter on the dataset and reported 96.6% classification accuracy, surpassing prompted baselines of larger language models on both classification and the quality of generated clarification prompts. They highlight that hard negative examples are crucial for distinguishing truly ambiguous queries from those that appear ambiguous but can be resolved from context. The same LoRA can be deployed both before retrieval and after retrieval, acting as a checkpoint in two stages of a RAG system. The ClariEdge dataset is publicly available on Hugging Face at https://huggingface.co/datasets/ibm-research/ClariEdge.","keyPoints":["ClariEdge dataset contains about 3,900 ambiguous and non‑ambiguous query examples for RAG clarification.","A lightweight LoRA fine‑tuned model reaches 96.6% classification accuracy, beating prompted larger‑model baselines.","The same LoRA can be applied before retrieval and after retrieval to filter queries needing clarification."],"whyItMatters":"Better query clarification reduces hallucinations and irrelevant answers in RAG systems, and the low‑cost LoRA solution makes it accessible for many developers.","category":{"slug":"research","name":"Research","url":"https://digestai.news/category/research"},"entities":{"companies":["IBM Research"],"models":[],"people":[]},"firstPublishedAt":"2026-10-22T04:00:00Z","updatedAt":"2026-10-22T04:00:00Z","sourceCount":1,"hasPrimarySource":true,"sources":[{"outlet":"arXiv cs.AI","title":"A Small Model Asks Better: Fine-Tuning Query Clarification for Retrieval-Augmented Generation","url":"https://arxiv.org/abs/2610.28686","publishedAt":"2026-10-22T04:00:00Z","type":"primary","primary":true,"lead":true}],"sourceNotes":null,"discussions":[],"thread":null,"cite":{"text":"Digest AI, \"IBM Research releases ClariEdge dataset and fine-tuned LoRA for query clarification\", 22 October 2026, https://digestai.news/story/ibm-research-releases-clariedge-dataset-and-fine-tuned-lora-for-query","publisher":"Digest AI","title":"IBM Research releases ClariEdge dataset and fine-tuned LoRA for query clarification","datePublished":"2026-10-22T04:00:00Z","url":"https://digestai.news/story/ibm-research-releases-clariedge-dataset-and-fine-tuned-lora-for-query"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}