OV
Oriol Vinyals
cs.LGstat.MLcs.CLcs.CVcs.AIcs.NEcs.SDeess.AScs.RONeural Networks, Computer
On Valency
published · living versionsW_39gz77fp·v1 · currentpublished
Exploring the Limits of Language Modeling
with Rafal Jozefowicz, Mike Schuster, Noam Shazeer, Yonghui Wu
1 version
Preprints & journals
122 papers in the corpus · 2011–2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfer2510.03342v3 · Gemini Robotics Team, Abbas Abdolmaleki, Saminda Abeyruwan et al.2025 · 1 citationarXiv
Gemini: A Family of Highly Capable Multimodal Models2312.11805v5 · Gemini Team Google: Rohan Anil, Sebastian Borgeaud, Jean-Baptiste Alayrac et al.2023 · 838 citationsarXiv
Gemini Robotics: Bringing AI into the Physical World2503.20020v1 · Gemini Robotics Team, Saminda Abeyruwan, Joshua Ainslie et al.2025 · 8 citationsarXiv
Imagen 32408.07009v3 · Imagen-Team-Google: Jason Baldridge, Jakob Bauer, Mukul Bhutani et al.2024 · 4 citationsarXiv
Gemini 1.5: Unlocking multimodal understanding across millions of tokens of context2403.05530v5 · Gemini Team Google: Petko Georgiev, Ving Ian Lei, Ryan Burnell et al.2024 · 296 citationsarXiv
A Practitioner's Guide to Continual Multimodal Pretraining2408.14471v2 · Karsten Roth, Vishaal Udandarao, Sebastian Dziadzio et al.2024 · 0 citationsarXiv
Gemma 2: Improving Open Language Models at a Practical Size2408.00118v3 · Gemma Team: Morgane Riviere, Shreya Pathak, Pier Giuseppe Sessa et al.2024 · 146 citationsarXiv
Capabilities of Gemini Models in Medicine2404.18416v2 · Khaled Saab, Tao Tu, Wei-Hung Weng et al.2024 · 98 citationsarXiv
Gemma: Open Models Based on Gemini Research and Technology2403.08295v4 · Gemma Team: Thomas Mesnard, Cassidy Hardin, Robert Dadashi et al.2024 · 240 citationsarXiv
Fantastic Gains and Where to Find Them: On the Existence and Prospect of General Knowledge Transfer between Any Pretrained Model2310.17653v2 · Karsten Roth, Lukas Thede, Almut Sophia Koepke et al.2023 · 0 citationsarXiv
Learning skillful medium-range global weather forecasting.37962497 · Lam, Remi, Sanchez-Gonzalez, Alvaro, Willson, Matthew et al.2023 · 1,409 citationsScience (New York, N.Y.). 2023;382(6677):1416-1421
Optimizing Memory Mapping Using Deep Reinforcement Learning2305.07440v2 · Pengming Wang, Mikita Sazanovich, Berkin Ilbeyi et al.2023 · 1 citationarXiv
Waffling around for Performance: Visual Classification with Random Words and Broad Concepts2306.07282v2 · Karsten Roth, Jae Myung Kim, A. Sophia Koepke et al.2023 · 63 citationsarXiv
AlphaStar Unplugged: Large-Scale Offline Reinforcement Learning2308.03526v1 · Michael Mathieu, Sherjil Ozair, Srivatsan Srinivasan et al.2023 · 5 citationsarXiv
GraphCast: Learning skillful medium-range global weather forecasting2212.12794v2 · Remi Lam, Alvaro Sanchez-Gonzalez, Matthew Willson et al.2022 · 169 citationsarXiv
Faster sorting algorithms discovered using deep reinforcement learning.37286649 · Mankowitz, Daniel J, Michi, Andrea, Zhernov, Anton et al.2023 · 177 citationsNature. 2023;618(7964):257-263
Competition-Level Code Generation with AlphaCode2203.07814v1 · Yujia Li, David Choi, Junyoung Chung et al.2022 · 1,002 citationsarXiv
Training Compute-Optimal Large Language Models2203.15556v1 · Jordan Hoffmann, Sebastian Borgeaud, Arthur Mensch et al.2022 · 845 citationsarXiv
Flamingo: a Visual Language Model for Few-Shot Learning2204.14198v2 · Jean-Baptiste Alayrac, Jeff Donahue, Pauline Luc et al.2022 · 1,238 citationsarXiv
A Generalist Agent2205.06175v3 · Scott Reed, Konrad Zolna, Emilio Parisotto et al.2022 · 64 citationsTransactions on Machine Learning Research, 11/2022, https://openreview.net/forum?id=1ikK0kHjvj
Metacontrol for Adaptive Imagination-Based Optimization1705.02670v1 · Jessica B. Hamrick, Andrew J. Ballard, Razvan Pascanu et al.2017 · 42 citationsarXiv
HiP: Hierarchical Perceiver2202.10890v2 · Joao Carreira, Skanda Koppula, Daniel Zoran et al.2022 · 3 citationsarXiv
Emergent Abilities of Large Language Models2206.07682v2 · Jason Wei, Yi Tay, Rishi Bommasani et al.2022 · 1,047 citationsarXiv
General-purpose, long-context autoregressive modeling with Perceiver AR2202.07765v2 · Curtis Hawthorne, Andrew Jaegle, Catalina Cangea et al.2022 · 34 citationsarXiv
Perceiver IO: A General Architecture for Structured Inputs & Outputs2107.14795v3 · Andrew Jaegle, Sebastian Borgeaud, Jean-Baptiste Alayrac et al.2021 · 226 citationsarXiv
Integrating Language Guidance into Vision-based Deep Metric Learning2203.08543v1 · Karsten Roth, Oriol Vinyals, Zeynep Akata2022 · 30 citationsarXiv
Non-isotropy Regularization for Proxy-based Deep Metric Learning2203.08547v1 · Karsten Roth, Oriol Vinyals, Zeynep Akata2022 · 45 citationsarXiv
Applying and improving AlphaFold at CASP14.34599769 · Jumper, John, Evans, Richard, Pritzel, Alexander et al.2022 · 434 citationsProteins. 2021;89(12):1711-1721
MuZero with Self-competition for Rate Control in VP9 Video Compression2202.06626v1 · Amol Mandhane, Anton Zhernov, Maribeth Rauh et al.2022 · 13 citationsarXiv
Highly accurate protein structure prediction with AlphaFold.34265844 · Jumper, John, Evans, Richard, Pritzel, Alexander et al.2022 · 47,662 citationsNature. 2021;596(7873):583-589
Unified Scaling Laws for Routed Language Models2202.01169v2 · Aidan Clark, Diego de las Casas, Aurelia Guy et al.2022 · 22 citationsarXiv
Improving language models by retrieving from trillions of tokens2112.04426v3 · Sebastian Borgeaud, Arthur Mensch, Jordan Hoffmann et al.2021 · 298 citationsarXiv
Scaling Language Models: Methods, Analysis & Insights from Training Gopher2112.11446v2 · Jack W. Rae, Sebastian Borgeaud, Trevor Cai et al.2021 · 245 citationsarXiv
Efficient Visual Pretraining with Contrastive Detection2103.10957v2 · Olivier J. H'enaff, Skanda Koppula, Jean-Baptiste Alayrac et al.2021 · 129 citationsarXiv
Solving Mixed Integer Programs Using Neural Networks2012.13349v3 · Vinod Nair, Sergey Bartunov, Felix Gimeno et al.2020 · 42 citationsarXiv
WikiGraphs: A Wikipedia Text - Knowledge Graph Paired Dataset2107.09556v1 · Luyu Wang, Yujia Li, Ozlem Aslan et al.2021 · 14 citationsarXiv
The Benchmark Lottery2107.07002v1 · Mostafa Dehghani, Yi Tay, Alexey A. Gritsenko et al.2021 · 8 citationsarXiv
Multimodal Few-Shot Learning with Frozen Language Models2106.13884v2 · Maria Tsimpoukelli, Jacob Menick, Serkan Cabi et al.2021 · 86 citationsarXiv
Perceiver: General Perception with Iterative Attention2103.03206v2 · Andrew Jaegle, Felix Gimeno, Andrew Brock et al.2021 · 125 citationsarXiv
Vector Quantized Models for Planning2106.04615v2 · Sherjil Ozair, Yazhe Li, Ali Razavi et al.2021 · 0 citationsarXiv
Machine Translation Decoding beyond Beam Search2104.05336v1 · R'emi Leblond, Jean-Baptiste Alayrac, Laurent Sifre et al.2021 · 28 citationsarXiv
Pointer Graph Networks2006.06380v2 · Petar Velickovi'c, Lars Buesing, Matthew C. Overlan et al.2020 · 20 citationsarXiv
AlignNet: Unsupervised Entity Alignment2007.08973v2 · Antonia Creswell, Kyriacos Nikiforou, Oriol Vinyals et al.2020 · 8 citationsarXiv
Strong Generalization and Efficiency in Neural Programs2007.03629v2 · Yujia Li, Felix Gimeno, Pushmeet Kohli et al.2020 · 19 citationsarXiv
Machine learning prediction errors better than DFT accuracy1702.05532v2 · Felix A. Faber, Luke Hutchison, Bing Huang et al.2017 · 704 citationsarXiv
Retrospective Analysis of the 2019 MineRL Competition on Sample Efficient Reinforcement Learning2003.05012v4 · Stephanie Milani, Nicholay Topin, Brandon Houghton et al.2020 · 9 citationsarXiv
Grandmaster level in StarCraft II using multi-agent reinforcement learning.31666705 · Vinyals, Oriol, Babuschkin, Igor, Czarnecki, Wojciech M et al.2020 · 3,510 citationsNature. 2019;575(7782):350-354
Rapid Learning or Feature Reuse? Towards Understanding the Effectiveness of MAML1909.09157v2 · Aniruddh Raghu, Maithra Raghu, Samy Bengio et al.2019 · 94 citationsarXiv
Reinforced Genetic Algorithm Learning for Optimizing Computation Graphs1905.02494v4 · Aditya Paliwal, Felix Gimeno, Vinod Nair et al.2019 · 38 citationsarXiv
Classification Accuracy Score for Conditional Generative Models1905.10887v2 · Suman Ravuri, Oriol Vinyals2019 · 145 citationsarXiv
Career total: 194 works. 122 are in this corpus.Showing the 50 most recent.
Profile built from the corpus for this byline.
Author records are still filling in while the Hub is in alpha. If this is your page, you'll be able to claim it soon. Spot a mistake? Tell us.