NS
Nihar B. Shah
cs.LGcs.AIcs.DLcs.ITmath.ITcs.GTstat.MLcs.CRcs.HCcs.CL
On Valency
published · living versionsW_azdgxx9g·v1 · currentpublished
When is it Better to Compare than to Score?
with Sivaraman Balakrishnan, Joseph Bradley, Abhay Parekh, Kannan Ramchandran +1
1 version
Preprints & journals
93 papers in the corpus · 2009–2026Use and Effects of LLMs in Peer Review: A Randomized Experiment and Survey at ICML 20262609.19420v1 · Sunnie S. Y. Kim, Wesley Hanwen Deng, Jennifer Wortman Vaughan et al.2026 · 0 citationsarXiv
greCAPTCHA: Assessing Understanding as Evidence of Research Authorship Under Generative AI2609.20481v1 · Justin Payan, B'alint Gyevn'ar, Atoosa Kasirzadeh et al.2026 · 0 citationsarXiv
ReproRepo: Scaling Reproducibility Audits with GitHub Repository Issues2606.18237v2 · Shanda Li, Qiuhong Anna Wei, Jingwu Tang et al.2026 · 0 citationsarXiv
Learning What Evaluators Value: A Reliable Approach to Modeling Evaluator Preferences2605.16615v2 · Madeline Celi Kitch, Nihar B. Shah2026 · 0 citationsarXiv
Distributed Denial of Science: How Indirect Data Poisoning of AI Systems Can Industrialize Scientific Fraud2607.10712v1 · B'alint Gyevn'ar, Atoosa Kasirzadeh, Nihar B. Shah2026 · 0 citationsarXiv
Mitigating LLM-based p-Hacking by Preregistering for the Next LLM2606.27687v1 · Maria Thomas, Kristina Gligoric, Nihar B. Shah2026 · 0 citationsarXiv
Policies Permitting LLM Use for Polishing Peer Reviews Are Currently Not Enforceable2603.20450v2 · Rounak Saha, Gurusha Juneja, Dayita Chaudhuri et al.2026 · 0 citationsarXiv
How Many Submissions May an Author Make? A Harmonic Quota for Submissions under Coauthorship2606.10293v1 · Nihar B. Shah2026 · 0 citationsarXiv
Smooth Partial Lotteries for Stable Randomized Selection2605.20069v2 · Alexander Goldberg, Giulia Fanti, Nihar B. Shah2026 · 0 citationsarXiv
To ArXiv or not to ArXiv: A Study Quantifying Pros and Cons of Posting Preprints Online2203.17259v4 · Charvi Rastogi, Ivan Stelmakh, Xinwei Shen et al.2022 · 3 citationsarXiv
The More You Automate, the Less You See: Hidden Pitfalls of AI Scientist Systems2509.08713v2 · Ziming Luo, Atoosa Kasirzadeh, Nihar B. Shah2025 · 3 citationsarXiv
FLAWS: A Benchmark for Error Identification and Localization in Scientific Papers2511.21843v1 · Sarina Xi, Vishisht Rao, Justin Payan et al.2025 · 0 citationsarXiv
ML Researchers Support Openness in Peer Review But Are Concerned About Resubmission Bias2511.23439v1 · Vishisht Rao, Justin Payan, Andrew McCallum et al.2025 · 0 citationsarXiv
A Principled Approach to Randomized Selection under Uncertainty: Applications to Peer Review and Grant Funding2506.19083v3 · Alexander Goldberg, Giulia Fanti, Nihar B. Shah2025 · 1 citationarXiv
Who is a Better Matchmaker? Human vs. Algorithmic Judge Assignment in a High-Stakes Startup Competition2510.12692v1 · Sarina Xi, Orelia Pi, Miaomiao Zhang et al.2025 · 0 citationsarXiv
Detecting LLM-generated peer reviews.40982562 · Rao, Vishisht Srihari, Kumar, Aounon, Lakkaraju, Himabindu et al.2025 · 14 citationsPloS one. 2025;20(9):e0331871
Vulnerability of Text-Matching in ML/AI Conference Reviewer Assignments to Collusions2412.06606v2 · Jhih-Yi Hsieh, Aditi Raghunathan, Nihar B. Shah2024 · 0 citationsarXiv
Identity Theft in AI Conference Peer Review2508.04024v1 · Nihar B. Shah, Melisa Bok, Xukun Liu et al.2025 · 0 citationsarXiv
Benchmarking Fraud Detectors on Private Graph Data2507.22347v1 · Alexander Goldberg, Giulia Fanti, Nihar Shah et al.2025 · 0 citationsarXiv
A Gold Standard Dataset for the Reviewer Assignment Problem2303.16750v2 · Ivan Stelmakh, John Wieting, Sarina Xi et al.2023 · 0 citationsarXiv
Detecting LLM-Generated Peer Reviews2503.15772v2 · Vishisht Rao, Aounon Kumar, Himabindu Lakkaraju et al.2025 · 14 citationsarXiv
Peer reviews of peer reviews: A randomized controlled trial and other experiments.40173178 · Goldberg, Alexander, Stelmakh, Ivan, Cho, Kyunghyun et al.2025 · 18 citationsPloS one. 2025;20(4):e0320444
Enhancing Peer Review in Astronomy: A Machine Learning and Optimization Approach to Reviewer Assignments for ALMA2410.10009v2 · John M. Carpenter, Andrea Corvill'on, Nihar B. Shah2024 · 2 citationsarXiv
A randomized controlled trial on anonymizing reviewers to each other in peer review discussions.39729478 · Rastogi, Charvi, Song, Xiangchen, Jin, Zhijing et al.2024 · 2 citationsPloS one. 2024;19(12):e0315674
Causal Effect of Group Diversity on Redundancy and Coverage in Peer-Reviewing2411.11437v1 · Navita Goyal, Ivan Stelmakh, Nihar Shah et al.2024 · 0 citationsarXiv
Testing for reviewer anchoring in peer review: A randomized controlled trial.39556577 · Liu, Ryan, Jecmen, Steven, Conitzer, Vincent et al.2024 · 2 citationsPloS one. 2024;19(11):e0301111
Usefulness of LLMs as an Author Checklist Assistant for Scientific Papers: NeurIPS'24 Experiment2411.03417v2 · Alexander Goldberg, Ihsan Ullah, Thanh Gia Hieu Khuong et al.2024 · 4 citationsarXiv
Peer Reviews of Peer Reviews: A Randomized Controlled Trial and Other Experiments2311.09497v2 · Alexander Goldberg, Ivan Stelmakh, Kyunghyun Cho et al.2023 · 18 citationsarXiv
What Can Natural Language Processing Do for Peer Review?2405.06563v1 · Ilia Kuznetsov, Osama Mohammed Afzal, Koen Dercksen et al.2024 · 5 citationsarXiv
How do authors' perceptions of their papers compare with co-authors' perceptions and peer-review decisions?38598482 · Rastogi, Charvi, Stelmakh, Ivan, Beygelzimer, Alina et al.2024 · 6 citationsPloS one. 2024;19(4):e0300710
On the Detection of Reviewer-Author Collusion Rings From Paper Bidding2402.07860v2 · Steven Jecmen, Nihar B. Shah, Fei Fang et al.2024 · 0 citationsarXiv
A Randomized Controlled Trial on Anonymizing Reviewers to Each Other in Peer Review Discussions2403.01015v1 · Charvi Rastogi, Xiangchen Song, Zhijing Jin et al.2024 · 2 citationsarXiv
A large scale randomized controlled trial on herding in peer-review discussions.37437010 · Stelmakh, Ivan, Rastogi, Charvi, Shah, Nihar B et al.2023 · 15 citationsPloS one. 2023;18(7):e0287443
Batching of Tasks by Users of Pseudonymous Forums: Anonymity Compromise and Protection2211.12686v2 · Alexander Goldberg, Giulia Fanti, Nihar B. Shah2022 · 0 citationsarXiv
Cite-seeing and Reviewing: A Study on Citation Bias in Peer Review2203.17239v1 · Ivan Stelmakh, Charvi Rastogi, Ryan Liu et al.2022 · 20 citationsarXiv
The Role of Author Identities in Peer Review2301.00221v2 · Nihar B. Shah2022 · 3 citationsarXiv
Testing for Reviewer Anchoring in Peer Review: A Randomized Controlled Trial2307.05443v1 · Ryan Liu, Steven Jecmen, Vincent Conitzer et al.2023 · 2 citationsarXiv
ReviewerGPT? An Exploratory Study on Using Large Language Models for Paper Reviewing2306.00622v1 · Ryan Liu, Nihar B. Shah2023 · 27 citationsarXiv
Counterfactual Evaluation of Peer-Review Assignment Policies2305.17339v1 · Martin Saveski, Steven Jecmen, Nihar B. Shah et al.2023 · 0 citationsarXiv
A Dataset on Malicious Paper Bidding in Peer Review2207.02303v2 · Steven Jecmen, Minji Yoon, Vincent Conitzer et al.2022 · 9 citationsarXiv
Assisting Human Decisions in Document Matching2302.08450v1 · Joon Sik Kim, Valerie Chen, Danish Pruthi et al.2023 · 2 citationsarXiv
How do Authors' Perceptions of their Papers Compare with Co-authors' Perceptions and Peer-review Decisions?2211.12966v1 · Charvi Rastogi, Ivan Stelmakh, Alina Beygelzimer et al.2022 · 6 citationsarXiv
Allocation Schemes in Analytic Evaluation: Applicant-Centric Holistic or Attribute-Centric Segmented?2209.08665v1 · Jingyan Wang, Carmel Baharav, Nihar B. Shah et al.2022 · 1 citationarXiv
Strategyproofing Peer Assessment via Partitioning: The Price in Terms of Evaluators' Expertise2201.10631v3 · Komal Dhull, Steven Jecmen, Pravesh Kothari et al.2022 · 10 citationsarXiv
Tradeoffs in Preventing Manipulation in Paper Bidding for Reviewer Assignment2207.11315v1 · Steven Jecmen, Nihar B. Shah, Fei Fang et al.2022 · 3 citationsarXiv
Integrating Rankings into Quantized Scores in Peer Review2204.03505v1 · Yusha Liu, Yichong Xu, Nihar B. Shah et al.2022 · 2 citationsarXiv
The Square Root Agreement Rule for Incentivizing Truthful Feedback on Online Platforms1507.07045v5 · Vijay Kamble, Nihar Shah, David Marn et al.2015 · 9 citationsarXiv
Calibration with Privacy in Peer Review2201.11308v1 · Wenxin Ding, Gautam Kamath, Weina Wang et al.2022 · 4 citationsarXiv
Near-Optimal Reviewer Splitting in Two-Phase Paper Reviewing and Conference Experiment Design2108.06371v1 · Steven Jecmen, Hanrui Zhang, Ryan Liu et al.2021 · 3 citationsarXiv
A Permutation-based Model for Crowd Labeling: Optimal Estimation and Robustness1606.09632v3 · Nihar B. Shah, Sivaraman Balakrishnan, Martin J. Wainwright2016 · 45 citationsarXiv
Career total: 172 works. 93 are in this corpus.Showing the 50 most recent.
Profile built from the corpus for this byline.
Author records are still filling in while the Hub is in alpha. If this is your page, you'll be able to claim it soon. Spot a mistake? Tell us.