Puneet Mathur

I am a Research Scientist at Adobe Research (AIR Lab) in San Jose, CA. My research spans agentic AI evaluations, benchmarking, and reinforcement learning environments, as well as audio language modeling and full-duplex speech systems. I completed my Ph.D. in Computer Science at the University of Maryland, College Park, advised by Dr. Dinesh Manocha, and an M.S. in Computer Science from UMD (2021).

My work on agentic AI evaluations and reinforcement learning focuses on building realistic benchmarks, interactive environments, and evaluation frameworks for multimodal agents. I am particularly interested in assessing complex, multi-step workflows involving reasoning, tool use, and decision-making, and developing environments that support reinforcement learning-based post-training and continuous improvement of agent capabilities.

My research in audio language modeling and full-duplex speech systems focuses on enabling natural, real-time spoken interactions. I study models that can listen, reason, and speak simultaneously, handle interruptions, backchannels, and conversational turn-taking, and operate beyond conventional turn-based speech pipelines. This builds on my earlier work in speech recognition personalization and neural speech synthesis.

I maintain a full list of my publications on the Research page. I’m always happy to hear about potential research collaborations — feel free to reach out!

Email / CV / Google Scholar / LinkedIn / GitHub

Updates

Oct 2026: New blog post: The Paradox of Perfection: Why LLMs Need Randomness to Sound Human.
Sep 2026: New blog post: TurnBench: Grading Turn-Taking Like a Linguist, Not a Timer.
Aug 2026: New blog post: Your eval is a measuring instrument.
Aug 2026: New blog post: Where Does a System Prompt Go? Taking PersonaPlex Apart.
Aug 2026: New blog post: The User Is Not a Turn: Omni-Flow and MiniCPM-o 4.5.
Oct 2026: New paper: MultiPartyTurnBench: Multi-Party Turn-Taking and Interruption Detection — in submission. [Dataset]
Sep 2026: New paper: APEX-Voice: Can Voice Agents Complete Professional Workflows Through Full-Duplex Interaction — in submission. [Project Page]
Sep 2026: New paper: FD-VAD: Semantic Endpoint Detection for Streaming Full-Duplex Speech — in submission. [Project Page]
2026: New paper: Duplex-R1: Full-Duplex Audio LMs that Reason, Retrieve, and Speak While Searching — in submission. [Coming soon]
2026: New paper: DuplexSpeechBench–IFEval: Evaluating Implicit Instruction Following in Full-Duplex Voice Agents — in submission. [Project Page]
2026: New paper: DuplexSpeechBench–Document Grounding: Benchmarking Document Grounding and Hallucinations in Full-Duplex Voice Agents — in submission. [Project Page]
Aug 2026: New paper: Omni2LoRA: Coherence-Preserving Parametric Memory for Efficient Omni Language Models — in submission. [Project Page]
2026: New paper: DRAGON: A Benchmark for Evidence-Grounded Visual Reasoning over Diagrams — NeurIPS 2026.
Mar 2026: New paper: Partial Policy Gradients for RL in LLMs — in submission.
Mar 2026: New paper: Cluster-R1: Large Reasoning Models Are Instruction-following Clustering Agents — in submission.
2026: ARGUS: Structured Uncertainty Guided Clarification for LLM Agents accepted to ACL 2026.