Researchers propose LoL architecture for dynamic transformer layer ordering

A new paper titled Library of Layers (LoL) introduces an architecture that reorders transformer layers at runtime to adapt to specific tasks. Unlike fixed-layer models, LoL dynamically sequences blocks during inference, balancing parameter reuse and sparsity. The authors claim it matches performance benchmarks of dense, depth-recurrent, and mixture-of-experts models while offering a unified…