{"version":1,"type":"story","url":"https://digestai.news/story/arxiv-paper-introduces-boa-compressor-for-linear-time-context-compress","json":"https://digestai.news/story/arxiv-paper-introduces-boa-compressor-for-linear-time-context-compress.json","markdown":"https://digestai.news/story/arxiv-paper-introduces-boa-compressor-for-linear-time-context-compress.md","slug":"arxiv-paper-introduces-boa-compressor-for-linear-time-context-compress","headline":"Arxiv paper introduces Boa Compressor for Linear-Time context compression","summary":"The paper proposes Boa Compressor, a plug‑and‑play online context compressor built on a Mamba state‑space model. It encodes arbitrary‑length context in a single linear‑time pass and produces a compressed representation that a frozen LLM can condition on.\n\nThe compressor is trained by distillation, matching the next‑token logits of a teacher LLM that sees the full context with a student LLM that sees the compressed representation. At equal compression ratios, Boa matches or surpasses state‑of‑the‑art offline baselines while being an order of magnitude faster than Transformer‑based implementations, reducing end‑to‑end latency.","keyPoints":["Boa Compressor encodes arbitrary‑length context in linear time using a Mamba state‑space model.","It matches or outperforms offline baselines while being ten times faster than Transformer‑based compressors."],"whyItMatters":"By compressing long contexts in linear time, Boa reduces inference latency and memory usage for large language models. This can lower compute costs and enable real‑time applications that require extended context, such as conversational agents or document‑analysis tools, improving scalability and user experience.","category":{"slug":"research","name":"Research","url":"https://digestai.news/category/research"},"entities":{"companies":[],"models":["Boa Compressor","Mamba state-space model (SSM)"],"people":[]},"firstPublishedAt":"2026-10-27T04:00:00Z","updatedAt":"2026-10-27T04:00:00Z","sourceCount":1,"hasPrimarySource":true,"sources":[{"outlet":"arXiv cs.CL","title":"Linear-Time Context Compression with State-Space Encoding","url":"https://arxiv.org/abs/2610.33006","publishedAt":"2026-10-27T04:00:00Z","type":"primary","primary":true,"lead":true}],"sourceNotes":null,"discussions":[],"thread":null,"cite":{"text":"Digest AI, \"Arxiv paper introduces Boa Compressor for Linear-Time context compression\", 27 October 2026, https://digestai.news/story/arxiv-paper-introduces-boa-compressor-for-linear-time-context-compress","publisher":"Digest AI","title":"Arxiv paper introduces Boa Compressor for Linear-Time context compression","datePublished":"2026-10-27T04:00:00Z","url":"https://digestai.news/story/arxiv-paper-introduces-boa-compressor-for-linear-time-context-compress"},"generatedBy":"Written by Digest AI's editorial model from the linked sources; the sources are the record.","license":"Headlines, digests and key points are written by Digest AI and may be quoted with a link to the story page. Linked articles belong to their publishers. Terms: https://digestai.news/terms#reuse"}