SS
Simeng Sun
cs.CLcs.CVAlzheimer’s diseasecs.LGcs.MMeess.IVAlzheimer Diseasecs.AIcs.PLDiabetes Mellitus, Type 2
On Valency
published · living versionsW_f2a7whhj·v1 · currentpublished
Dory1.0-4B: A Looped Normalized-GPT
with Maxim Fishman, Shantanu Acharya, Faisal Ladhak, Brian Chmiel +4
1 version
Preprints & journals
26 papers in the corpus · 2020–2026Mortality trends and projections for type 2 diabetes with concomitant Parkinson's versus Alzheimer's disease among older United States adults, 1999-2023: A retrospective cohort study.42411944 · Zhang, Ting, Ma, Guoliang, Wang, Weiwei et al.2026 · 1 citationMedicine. 2026;105(27):e49321
An empirical study on the limitation of Transformers in program trace generation2509.25073v1 · Simeng Sun2025 · 0 citationsarXiv
SWAN-GPT: An Efficient and Scalable Approach for Long-Context Language Modeling2504.08719v1 · Krishna C. Puvvada, Faisal Ladhak, Santiago Akle Serrano et al.2025 · 0 citationsarXiv
L0-Reasoning Bench: Evaluating Procedural Correctness in Language Models via Simple Program Execution2503.22832v2 · Simeng Sun, Cheng-Ping Hsieh, Faisal Ladhak et al.2025 · 0 citationsarXiv
How much do contextualized representations encode long-range context?2410.12292v2 · Simeng Sun, Cheng-Ping Hsieh2024 · 0 citationsarXiv
nGPT: Normalized Transformer with Representation Learning on the Hypersphere2410.01131v2 · Ilya Loshchilov, Cheng-Ping Hsieh, Simeng Sun et al.2024 · 0 citationsarXiv
Time trends in Alzheimer's disease mortality attributable to metabolic risks and smoking in China from 1990 to 2019: an age-period-cohort analysis.39026988 · Sun, Simeng, Zhang, Ting, Yu, Hao et al.2024 · 14 citationsFrontiers in aging neuroscience. 2024;16:1425577
Suri: Multi-constraint Instruction Following for Long-form Text Generation2406.19371v2 · Chau Minh Pham, Simeng Sun, Mohit Iyyer2024 · 0 citationsarXiv
RULER: What's the Real Context Size of Your Long-Context Language Models?2404.06654v3 · Cheng-Ping Hsieh, Simeng Sun, Samuel Kriman et al.2024 · 13 citationsarXiv
TopicGPT: A Prompt-based Topic Modeling Framework2311.01449v2 · Chau Minh Pham, Alexander Hoyle, Simeng Sun et al.2023 · 116 citationsarXiv
Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHF2309.09055v1 · Simeng Sun, Dhawal Gupta, Mohit Iyyer2023 · 0 citationsarXiv
PEARL: Prompting Large Language Models to Plan and Execute Actions Over Long Documents2305.14564v1 · Simeng Sun, Yang Liu, Shuohang Wang et al.2023 · 20 citationsarXiv
How Does In-Context Learning Help Prompt Tuning?2302.11521v1 · Simeng Sun, Yang Liu, Dan Iter et al.2023 · 14 citationsarXiv
Efficiently Upgrading Multilingual Machine Translation Models to Support More Languages2302.03528v1 · Simeng Sun, Maha Elbayad, Anna Sun et al.2023 · 1 citationarXiv
Image Coding for Machines with Omnipotent Feature Learning2207.01932v2 · Ruoyu Feng, Xin Jin, Zongyu Guo et al.2022 · 54 citationsarXiv
ChapterBreak: A Challenge Dataset for Long-Range Language Models2204.10878v1 · Simeng Sun, Katherine Thai, Mohit Iyyer2022 · 6 citationsarXiv
Semantically Video Coding: Instill Static-Dynamic Clues into Structured Bitstream for AI Tasks2201.10162v2 · Xin Jin, Ruoyu Feng, Simeng Sun et al.2022 · 0 citationsarXiv
Alternative Input Signals Ease Transfer in Multilingual Machine Translation2110.07804v1 · Simeng Sun, Angela Fan, James Cross et al.2021 · 10 citationsarXiv
Do Long-Range Language Models Actually Use Long-Range Context?2109.09115v1 · Simeng Sun, Kalpesh Krishna, Andrew Mattarella-Micke et al.2021 · 43 citationsarXiv
IGA : An Intent-Guided Authoring Assistant2104.07000v2 · Simeng Sun, Wenlong Zhao, Varun Manjunatha et al.2021 · 14 citationsarXiv
Revisiting Simple Neural Probabilistic Language Models2104.03474v1 · Simeng Sun, Mohit Iyyer2021 · 9 citationsarXiv
GraphIQA: Learning Distortion Graph Representations for Blind Image Quality Assessment2103.07666v4 · Simeng Sun, Tao Yu, Jiahua Xu et al.2021 · 188 citationsarXiv
Learning Omni-frequency Region-adaptive Representations for Real Image Super-Resolution2012.06131v2 · Xin Li, Xin Jin, Tao Yu et al.2020 · 43 citationsarXiv
Energy-Based Reranking: Improving Neural Machine Translation Using Energy-Based Models2009.13267v4 · Sumanta Bhattacharyya, Amirmohammad Rooshenas, Subhajit Naskar et al.2020 · 33 citationsProceedings of the 59th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 4528-4537, 2021
Multi-scale Grouped Dense Network for VVC Intra Coding2005.07896v1 · Xin Li, Simeng Sun, Zhizheng Zhang et al.2020 · 23 citationsarXiv
Hard-Coded Gaussian Attention for Neural Machine Translation2005.00742v1 · Weiqiu You, Simeng Sun, Mohit Iyyer2020 · 60 citationsarXiv
Career total: 41 works. 26 are in this corpus.
Profile built from the corpus for this byline.
Author records are still filling in while the Hub is in alpha. If this is your page, you'll be able to claim it soon. Spot a mistake? Tell us.