Bolmo in Nature: How Ai2 Converts Subword LLMs Into Byte-Level Models, and When That Matters
Ai2's Bolmo paper in Nature shows how to retrofit existing language models to read raw bytes instead of tokens. What byteification is, how Bolmo, Bwen and Blama perform, what the two-stage process costs, and which tasks benefit.