ZS
Zachary Shinnick
cs.LGcs.AIcs.CLcs.CV
On Valency
published · living versionsW_chmx6z4e·v1 · currentpublished
Language Models Can Benefit from Domain-Specific Inductive Biases
with Damien Teney, Liangze Jiang, Hemanth Saratchandran, Simon Lucey
1 version
Preprints & journals
6 papers in the corpus · 2025–2026Lasting Effects of Abstract Pretraining Beyond Perplexity2609.38764v1 · Zachary Shinnick, Hemanth Saratchandran, Damien Teney et al.2026 · 0 citationsarXiv
Procedural Core: A Compact Recurrent Initialization for Vision Transformers2609.37631v1 · Zachary Shinnick, Christian Interno, Hemanth Saratchandran et al.2026 · 0 citationsarXiv
Procedural Pretraining for Molecular Property Prediction2609.17831v1 · Moritz Friedemann, Zachary Shinnick, Philip Torr et al.2026 · 0 citationsarXiv
A Language Model from 1913: Pretraining on Historical Text2606.02991v2 · Xiaoxi Luo, Zachary Shinnick, Niclas Griesshaber et al.2026 · 0 citationsarXiv
Procedural Pretraining: Warming Up Language Models with Abstract Data2601.21725v2 · Liangze Jiang, Zachary Shinnick, Anton van den Hengel et al.2026 · 0 citationsarXiv
Transformers Pretrained on Procedural Data Contain Modular Structures for Algorithmic Reasoning2505.22308v1 · Zachary Shinnick, Liangze Jiang, Hemanth Saratchandran et al.2025 · 0 citationsarXiv
Career total: 6 works. 6 are in this corpus.
Profile built from the corpus for this byline.
Author records are still filling in while the Hub is in alpha. If this is your page, you'll be able to claim it soon. Spot a mistake? Tell us.