SL
Simon Lucey
cs.CVcs.LGcs.AIcs.ROstat.MLcs.GRcs.NEAlgorithmsComputerscs.CL
On Valency
published · living versionsW_chmx6z4e·v1 · currentpublished
Language Models Can Benefit from Domain-Specific Inductive Biases
with Damien Teney, Liangze Jiang, Zachary Shinnick, Hemanth Saratchandran
1 version
Preprints & journals
147 papers in the corpus · 1983–2026Should We Skip Diffusion?2610.07002v1 · Yiping Ji, James Martens, Simon Lucey2026 · 0 citationsarXiv
Optimizer Geometry Sets the Pace: Spectral Learning Dynamics in Matrix Factorization2610.04249v1 · Mahalakshmi Sabanayagam, Simon Lucey2026 · 0 citationsarXiv
Conditioned Initialization for Attention2609.07086v1 · Hemanth Saratchandran, Simon Lucey2026 · 0 citationsarXiv
Making Transformers Logical2608.00418v2 · Mingze Ma, Hemanth Saratchandran, Cameron Gordon et al.2026 · 0 citationsarXiv
Memory Efficient Tabular Foundation Models2607.27546v1 · Shuting Luo, Monika Mikhail Kanaan, Cameron Gordon et al.2026 · 0 citationsFMSD @ ICML 2026
Can Transformers Really Do It All? On the Compatibility of Inductive Biases Across Tasks2607.17624v1 · Damien Teney, Liangze Jiang, Hemanth Saratchandran et al.2026 · 0 citationsarXiv
Machine unlearning as a governance imperative for clinical AI.42471427 · Porter, Anthony, Kirkpatrick, Emily, Garg, Arpit et al.2026 · 0 citationsNPJ digital medicine. 2026
Parameter-Efficient Fine-Tuning with Learnable Rank2606.04325v1 · Arpit Garg, Simon Lucey, Hemanth Saratchandran2026 · 0 citationsarXiv
Mask the Target: A Plug-and-Play Regularizer Against LoRA Forgetting2605.29498v1 · Runze Xu, Arpit Garg, Hemanth Saratchandran et al.2026 · 0 citationsarXiv
The Quantization Benefits of Residual-Free Transformers2605.25880v1 · Yiping Ji, Mahalakshmi Sabanayagam, Peyman Moghadam et al.2026 · 0 citationsarXiv
Spectral Conditioning of Attention Improves Transformer Performance2603.07162v1 · Hemanth Saratchandran, Simon Lucey2026 · 0 citationsarXiv
The Inlet Rank Collapse in Implicit Neural Representations: Diagnosis and Unified Remedy2602.01526v1 · Jianqiao Zheng, Hemanth Saratchandran, Simon Lucey2026 · 0 citationsarXiv
G3Splat: Geometrically Consistent Generalizable Gaussian Splatting2512.17547v2 · Mehdi Hosseinzadeh, Shin-Fang Chng, Yi Xu et al.2025 · 0 citationsarXiv
3D Gaussian Point Encoders2511.04797v1 · Jim James, Ben Wilson, Simon Lucey et al.2025 · 0 citationsarXiv
Cutting the Skip: Training Residual-Free Transformers2510.00345v1 · Yiping Ji, James Martens, Jianqiao Zheng et al.2025 · 0 citationsarXiv
Stable Forgetting: Bounded Parameter-Efficient Unlearning in Foundation Models2509.24166v2 · Arpit Garg, Hemanth Saratchandran, Ravi Garg et al.2025 · 0 citationsarXiv
SineLoRA: Sine-Activated Delta Compression2505.21895v2 · Cameron Gordon, Yiping Ji, Hemanth Saratchandran et al.2025 · 0 citationsarXiv
Leaner Transformers: More Heads, Less Depth2505.20802v1 · Hemanth Saratchandran, Damien Teney, Simon Lucey2025 · 0 citationsarXiv
Structured Initialization for Vision Transformers2505.19985v2 · Jianqiao Zheng, Xueqian Li, Hemanth Saratchandran et al.2025 · 0 citationsarXiv
Enhancing Transformers Through Conditioned Embedded Tokens2505.12789v2 · Hemanth Saratchandran, Simon Lucey2025 · 0 citationsarXiv
Always Skip Attention2505.01996v3 · Yiping Ji, Hemanth Saratchandran, Peyman Moghadam et al.2025 · 0 citationsarXiv
Gradient Descent as a Shrinkage Operator for Spectral Bias2504.18207v1 · Simon Lucey2025 · 0 citationsarXiv
Rethinking the Role of Spatial Mixing2503.16760v1 · George Cazenavette, Joel Julin, Simon Lucey2025 · 0 citationsarXiv
DARB-Splatting: Generalizing Splatting with Decaying Anisotropic Radial Basis Functions2501.12369v3 · Hashiru Pramuditha, Vinasirajan Viruthshaan, Vishagar Arunan et al.2025 · 0 citationsarXiv
Object Agnostic 3D Lifting in Space and Time2412.01166v2 · Christopher Fusco, Shin-Fang Ch'ng, Mosam Dabhi et al.2024 · 0 citationsarXiv
Rethinking Attention: Polynomial Alternatives to Softmax in Transformers2410.18613v3 · Hemanth Saratchandran, Jianqiao Zheng, Yiping Ji et al.2024 · 0 citationsarXiv
Weight Conditioning for Smooth Optimization of Neural Networks2409.03424v2 · Hemanth Saratchandran, Thomas X. Wang, Simon Lucey2024 · 0 citationsarXiv
Invertible Neural Warp for NeRF2407.12354v1 · Shin-Fang Chng, Ravi Garg, Hemanth Saratchandran et al.2024 · 1 citationarXiv
SMORE: Simultaneous Map and Object REconstruction2406.13896v4 · Nathaniel Chodosh, Anish Madan, Simon Lucey et al.2024 · 1 citationarXiv
Structured Initialization for Attention in Vision Transformers2404.01139v1 · Jianqiao Zheng, Xueqian Li, Simon Lucey2024 · 2 citationsarXiv
D'OH: Decoder-Only Random Hypernetworks for Implicit Neural Representations2403.19163v2 · Cameron Gordon, Lachlan Ewen MacDonald, Hemanth Saratchandran et al.2024 · 2 citationsarXiv
From Activation to Initialization: Scaling Insights for Optimizing Neural Fields2403.19205v2 · Hemanth Saratchandran, Sameera Ramasinghe, Simon Lucey2024 · 0 citationsarXiv
Efficient Learning With Sine-Activated Low-rank Matrices2403.19243v5 · Yiping Ji, Hemanth Saratchandran, Cameron Gordon et al.2024 · 2 citationsarXiv
Fast Kernel Scene Flow2403.05896v1 · Xueqian Li, Simon Lucey2024 · 1 citationarXiv
SeMoLi: What Moves Together Belongs Together2402.19463v2 · Jenny Seidenschwarz, Aljosa Osep, Francesco Ferroni et al.2024 · 8 citationsarXiv
Preconditioners for the Stochastic Training of Neural Fields2402.08784v2 · Shin-Fang Chng, Hemanth Saratchandran, Simon Lucey2024 · 1 citationarXiv
A Sampling Theory Perspective on Activations for Implicit Neural Representations2402.05427v1 · Hemanth Saratchandran, Sameera Ramasinghe, Violetta Shevchenko et al.2024 · 1 citationarXiv
Analyzing the Neural Tangent Kernel of Periodically Activated Coordinate Networks2402.04783v1 · Hemanth Saratchandran, Shin-Fang Chng, Simon Lucey2024 · 1 citationarXiv
Architectural Strategies for the optimization of Physics-Informed Neural Networks2402.02711v1 · Hemanth Saratchandran, Shin-Fang Chng, Simon Lucey2024 · 0 citationsarXiv
Convolutional Initialization for Data-Efficient Vision Transformers2401.12511v1 · Jianqiao Zheng, Xueqian Li, Simon Lucey2024 · 0 citationsarXiv
3D-LFM: Lifting Foundation Model2312.11894v3 · Mosam Dabhi, Laszlo A. Jeni, Simon Lucey2023 · 9 citationsarXiv
Multi-Body Neural Scene Flow2310.10301v2 · Kavisha Vidanapathirana, Shin-Fang Chng, Xueqian Li et al.2023 · 7 citationsarXiv
Robust Point Cloud Processing through Positional Embedding2309.00339v1 · Jianqiao Zheng, Xueqian Li, Sameera Ramasinghe et al.2023 · 3 citationsarXiv
On progressive sharpening, flat minima and generalisation2305.14683v4 · Lachlan Ewen MacDonald, Jack Valmadre, Simon Lucey2023 · 0 citationsarXiv
Curvature-Aware Training for Coordinate Networks2305.08552v1 · Hemanth Saratchandran, Shin-Fang Chng, Sameera Ramasinghe et al.2023 · 2 citationsarXiv
Fast Neural Scene Flow2304.09121v3 · Xueqian Li, Jianqiao Zheng, Francesco Ferroni et al.2023 · 22 citationsarXiv
Re-Evaluating LiDAR Scene Flow for Autonomous Driving2304.02150v2 · Nathaniel Chodosh, Deva Ramanan, Simon Lucey2023 · 4 citationsarXiv
Flow supervision for Deformable NeRF2303.16333v1 · Chaoyang Wang, Lachlan Ewen MacDonald, Laszlo A. Jeni et al.2023 · 34 citationsarXiv
On the effectiveness of neural priors in modeling dynamical systems2303.05728v1 · Sameera Ramasinghe, Hemanth Saratchandran, Violetta Shevchenko et al.2023 · 1 citationarXiv
Reframing Neural Networks: Deep Structure in Overcomplete Representations.35133959 · Murdock, Calvin, Cazenavette, George, Lucey, Simon2023 · 3 citationsIEEE transactions on pattern analysis and machine intelligence. 2023;45(1):964-979
Career total: 295 works. 147 are in this corpus.Showing the 50 most recent.
Profile built from the corpus for this byline.
Author records are still filling in while the Hub is in alpha. If this is your page, you'll be able to claim it soon. Spot a mistake? Tell us.