Skip to content

NerdlystTech · Markets · Code

Topic

arXiv

Discrete Diffusion Trust Fix Catches 96% of Garbage Tokens
Science

Discrete Diffusion Trust Fix Catches 96% of Garbage Tokens

A new NeurIPS workshop paper teaches discrete diffusion models to doubt their context, catching 96% of random corrupted tokens. Here's…

Glowing letters in the dark representing how language models learn action nominal constructions
Science

Action Nominal Constructions: What 96 Fake Languages Taught GPT-2

How do language models learn action nominal constructions? A UW study trained GPT-2 on 96 synthetic languages and found where…