KN
Karthik R. Narasimhan
cs.CLcs.AIcs.LGcs.CVcs.SEstat.MLcs.HCcs.ROcs.IRcs.CR
On Valency
published · living versionsW_472urbcs·v1 · currentpublished
FrontierCS 2: A Benchmark for Computer Science R&D
with Qiuyang Mang, Wenhao Chai, Runyuan He, Dongruixuan Li +56
1 version
Preprints & journals
106 papers in the corpus · 2015–2026FrontierCS 2: A Benchmark for Computer Science R&D2610.29932v1 · Qiuyang Mang, Wenhao Chai, Runyuan He et al.2026 · 0 citationsarXivon Valency
The Wealth of Agents: Scaling Agentic AI Across Developers2610.20518v1 · Austin W. Hanjie, Carlos E. Jimenez, Zirui Wang et al.2026 · 0 citationsarXiv
SWEeper-Bench: Can Agents Discover Bugs in Interactive Software?2610.14096v1 · Yang Yao, Haozhe Chen, Bingyi Kang et al.2026 · 0 citationsarXiv
Adapter Thickets: Splitting an RLVR Budget Beats Concentrating It2610.00991v2 · Jonathan Williams, Esin Tureci, Karthik R. Narasimhan2026 · 0 citationsarXiv
EasyPPO: Stabilizing the Critic Is Key2609.36802v1 · Xuanyi Zhou, Qiuyang Mang, Huanzhi Mao et al.2026 · 0 citationsarXiv
Up and Down the Abstraction Ladder: Code-Based Skills for Language Agents2609.31076v1 · Bart\lomiej Cupiał, Jens Tuyls, Maciej Wo\lczyk et al.2026 · 0 citationsarXiv
How does Adversarial Influence Scale in Multi-Agent Systems?2609.30028v2 · Addison J. Wu, Jasin Cekinmez, Michel Liao et al.2026 · 0 citationsarXiv
-Multilingual: Benchmarking Voice Agents Across Languages2609.35820v1 · Soham Ray, Edgard dos Santos Paiva, Ruben Valenzuela et al.2026 · 0 citationsarXiv
-Bench: An Environment for End-To-End, Realistic Agent Construction2609.04611v1 · Quan Shi, Keshav Dhandhania, Karthik Narasimhan et al.2026 · 0 citationsarXiv
LeAct: Learning to Reason from Expert Actions2607.21856v1 · Ziran Yang, Chengshuai Shi, Raj Ghugare et al.2026 · 0 citationsarXiv
Humans are Missing from AI Coding Agent Research2608.12355v1 · Zora Z. Wang, John Yang, Kilian Lieret et al.2026 · 0 citationsarXiv
CEO-Bench: Can Agents Play the Long Game?2606.18543v2 · Haozhe Chen, Karthik Narasimhan, Zhuang Liu2026 · 0 citationsarXiv
Context-Aware RL for Agentic and Multimodal LLMs2606.17053v1 · Peiyang Xu, Bangzheng Li, Sijia Liu et al.2026 · 0 citationsarXiv
-Rec: A Verifiable Benchmark for Agentic Recommender Systems2606.10156v3 · Bharath Sivaram Narasimhan, Karthik R Narasimhan2026 · 0 citationsProceedings of the 20th ACM Conference on Recommender Systems (RecSys '26), pp. 915-919, 2026
Odysseus: Scaling VLMs to 100+ Turn Decision-Making in Games via Reinforcement Learning2605.00347v1 · Chengshuai Shi, Wenzhe Li, Xinran Liang et al.2026 · 0 citationsarXiv
-Voice: Benchmarking Full-Duplex Voice Agents on Real-World Domains2603.13686v1 · Soham Ray, Keshav Dhandhania, Victor Barres et al.2026 · 0 citationsarXiv
-Knowledge: Evaluating Conversational Agents over Unstructured Knowledge2603.04370v1 · Quan Shi, Alexandra Zytek, Pedram Razavi et al.2026 · 0 citationsarXiv
Retaining by Doing: The Role of On-Policy Data in Mitigating Forgetting2510.18874v3 · Howard Chen, Noam Razin, Karthik Narasimhan et al.2025 · 0 citationsProceedings of the 43rd International Conference on Machine Learning (ICML), 2026
Training a high accuracy model to visualize blood clots during mechanical thrombectomy for the treatment of Acute Ischemic Stroke.41541866 · Kashyap, Varun, Zhu, Richard, Narasimhan, Karthik2026 · 1 citationFrontiers in stroke. 2025;4:1610399
BuilderBench: The Building Blocks of Intelligent Agents2510.06288v4 · Raj Ghugare, Roger Creus Castanyer, Catherine Ji et al.2025 · 0 citationsarXiv
Probing AI Safety with Source Code2506.20471v1 · Ujwal Narayan, Shreyas Chaudhari, Ashwin Kalyan et al.2025 · 0 citationsarXiv
-Bench: Evaluating Conversational Agents in a Dual-Control Environment2506.07982v1 · Victor Barres, Honghua Dong, Soham Ray et al.2025 · 1 citationarXiv
Contextual Experience Replay for Self-Improvement of Language Agents2506.06698v1 · Yitao Liu, Chenglei Si, Karthik Narasimhan et al.2025 · 3 citationsarXiv
When Models Know More Than They Can Explain: Quantifying Knowledge Transfer in Human-AI Collaboration2506.05579v2 · Quan Shi, Carlos E. Jimenez, Shunyu Yao et al.2025 · 0 citationsarXiv
VideoGameBench: Can Vision-Language Models complete popular video games?2505.18134v3 · Alex L. Zhang, Thomas L. Griffiths, Karthik R. Narasimhan et al.2025 · 0 citationsarXiv
Agent Context Protocols Enhance Collective Inference2505.14569v1 · Devansh Bhardwaj, Arjun Beniwal, Shreyas Chaudhari et al.2025 · 0 citationsarXiv
IMPersona: Evaluating Individual Level LM Impersonation2504.04332v2 · Quan Shi, Carlos E. Jimenez, Stephen Dong et al.2025 · 0 citationsarXiv
LoRA Soups: Merging LoRAs for Practical Skill Composition Tasks2410.13025v2 · Akshara Prabhakar, Yuanzhi Li, Karthik Narasimhan et al.2024 · 0 citationsarXiv
An Annotated Dataset of Errors in Premodern Greek and Baselines for Detecting Them2410.11071v2 · Creston Brooks, Johannes Haubold, Charlie Cowen-Breen et al.2024 · 0 citationsarXiv
SWE-bench Multimodal: Do AI Systems Generalize to Visual Software Domains?2410.03859v1 · John Yang, Carlos E. Jimenez, Alex L. Zhang et al.2024 · 3 citationsarXiv
EnIGMA: Interactive Tools Substantially Assist LM Agents in Finding Security Vulnerabilities2409.16165v3 · Talor Abramovich, Meet Udeshi, Minghao Shao et al.2024 · 1 citationarXiv
LLMs are Superior Feedback Providers: Bootstrapping Reasoning for Lie Detection with Self-Generated Feedback2408.13915v1 · Tanushree Banerjee, Richard Zhu, Runzhe Yang et al.2024 · 0 citationsarXiv
ShieldGemma: Generative AI Content Moderation Based on Gemma2407.21772v2 · Wenjun Zeng, Yuchi Liu, Ryan Mullins et al.2024 · 3 citationsarXiv
PersonaGym: Evaluating Persona Agents and LLMs2407.18416v5 · Vinay Samuel, Henry Peng Zou, Yue Zhou et al.2024 · 16 citationsarXiv
-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains2406.12045v1 · Shunyu Yao, Noah Shinn, Pedram Razavi et al.2024 · 7 citationsarXiv
SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineering2405.15793v3 · John Yang, Carlos E. Jimenez, Alexander Wettig et al.2024 · 260 citationsarXiv
Can Language Models Solve Olympiad Programming?2404.10952v1 · Quan Shi, Michael Tang, Karthik Narasimhan et al.2024 · 3 citationsarXiv
RLHF Deciphered: A Critical Analysis of Reinforcement Learning from Human Feedback for LLMs2404.08555v2 · Shreyas Chaudhari, Pranjal Aggarwal, Vishvak Murahari et al.2024 · 91 citationsarXiv
Language-Guided World Models: A Model-Based Approach to AI Control2402.01695v3 · Alex Zhang, Khanh Nguyen, Jens Tuyls et al.2024 · 1 citationarXiv
GEO: Generative Engine Optimization2311.09735v3 · Pranjal Aggarwal, Vishvak Murahari, Tanmay Rajpurohit et al.2023 · 5 citationsarXiv
QualEval: Qualitative Evaluation for Model Improvement2311.02807v2 · Vishvak Murahari, Ameet Deshpande, Peter Clark et al.2023 · 0 citationsarXiv
Progressively Efficient Learning2310.13004v1 · Ruijie Zheng, Khanh Nguyen, Hal Daum'e III et al.2023 · 0 citationsarXiv
SWE-bench: Can Language Models Resolve Real-World GitHub Issues?2310.06770v3 · Carlos E. Jimenez, John Yang, Alexander Wettig et al.2023 · 69 citationsarXiv
FireAct: Toward Language Agent Fine-tuning2310.05915v1 · Baian Chen, Chang Shu, Ehsan Shareghi et al.2023 · 9 citationsarXiv
Cognitive Architectures for Language Agents2309.02427v3 · Theodore R. Sumers, Shunyu Yao, Karthik Narasimhan et al.2023 · 73 citationsarXiv
Scaling Laws for Imitation Learning in Single-Agent Games2307.09423v3 · Jens Tuyls, Dhruv Madeka, Kari Torkkola et al.2023 · 0 citationsarXiv
COLLIE: Systematic Construction of Constrained Text Generation Tasks2307.08689v1 · Shunyu Yao, Howard Chen, Austin W. Hanjie et al.2023 · 2 citationsarXiv
InstructEval: Systematic Evaluation of Instruction Selection Methods2307.00259v2 · Anirudh Ajith, Chris Pan, Mengzhou Xia et al.2023 · 6 citationsarXiv
InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedback2306.14898v3 · John Yang, Akshara Prabhakar, Karthik Narasimhan et al.2023 · 26 citationsarXiv
PruMUX: Augmenting Data Multiplexing with Model Compression2305.14706v2 · Yushan Su, Vishvak Murahari, Karthik Narasimhan et al.2023 · 0 citationsarXiv
Career total: 149 works. 106 are in this corpus.Showing the 50 most recent.
Profile built from the corpus for this byline.
Author records are still filling in while the Hub is in alpha. If this is your page, you'll be able to claim it soon. Spot a mistake? Tell us.