Customer-obsessed science
Research areas
-
October 12, 202614 min read“Priming” reuses pretrained Transformer weights to build models with more efficient architectures at less than 1% of the original training cost and with throughputs up to twice as high.
-
-
-
August 21, 20269 min read
-
July 30, 20268 min read
Featured news
-
2026Human annotation cost and time remain significant bottlenecks in Natural Language Processing (NLP), with test data annotation being particularly expensive due to the stringent requirement for low-error and high-quality labels necessary for reliable model evaluation. Traditional approaches require annotating entire test sets, leading to substantial resource requirements. Active Testing is a framework that
-
2026Learning from experience is critical for developing capable, self-improving large language model (LLM) agents. Existing methods typically extract knowledge from accumulated trajectories via reflection, memory, rules, or skills. However, agents in realistic environments continuously encounter novel tasks, often offering only a one-shot opportunity to improve. These executions yield rich but highly noisy
-
2026When we fine-tune an LLM on code in a new programming language, what actually changes inside the model? Does it learn new algorithms, new syntax, or does it develop the ability to faithfully implement known algorithms in an unfamiliar language? This question is hard to answer with existing languages because we cannot disentangle what the model learned from fine-tuning versus what it already knew from pretraining
-
2026Group relative policy optimization for reinforcement learning with verifiable rewards (RLVR) typically uses a fixed importance-sampling (IS) ratio clipping boundary across all rollouts. We identify a key limitation: rare correct rollouts on harder problems and abundant correct rollouts on easier problems are clipped at comparable rates, despite contributing very different learning signals. Rollouts with
-
2026Synthetic dialogue corpora are increasingly used as proxies for target data, yet personagrounded generators optimize individual conversations rather than corpus composition, yielding plausible dialogues with distorted population-level behavior mixes. We introduce GroupPersona, a framework that aligns synthetic corpora with a reference behavior distribution. GroupPersona turns population statistics into
Collaborations
View allWhether you're a faculty member or student, there are number of ways you can engage with Amazon.
View all