BZ

Barret Zoph

cs.LGcs.CVcs.CLstat.MLcs.AIcs.NEcs.CYcs.SDeess.AS

On Valency

published · living versions

Neural Architecture Search with Reinforcement Learning

with Quoc V. Le

1 version

W_2cf7t8wav1 · current

AutoAugment: Learning Augmentation Policies from Data

W_n5tjnkpav1

Transfer Learning for Low-Resource Neural Machine Translation

W_zfrg3efuv1

Preprints & journals

38 papers in the corpus · 2016–2024

OpenAI o1 System Card

OpenAI: Aaron Jaech, Adam Kalai, Adam Lerer et al.

50 citations

2412.16720v22024arXiv

GPT-4o System Card

OpenAI: Aaron Hurst, Adam Lerer, Adam P. Goucher et al.

179 citations

2410.21276v12024arXiv

Mixture-of-Experts Meets Instruction Tuning:A Winning Combination for Large Language Models

Sheng Shen, Le Hou, Yanqi Zhou et al.

23 citations

2305.14705v22023arXiv

A Pretrainer's Guide to Training Data: Measuring the Effects of Data Age, Domain Coverage, Quality, & Toxicity

Shayne Longpre, Gregory Yauney, Emily Reif et al.

36 citations

2305.13169v22023arXiv

The Flan Collection: Designing Data and Methods for Effective Instruction Tuning

Shayne Longpre, Le Hou, Tu Vu et al.

139 citations

2301.13688v22023arXiv

Scaling Instruction-Finetuned Language Models

Hyung Won Chung, Le Hou, Shayne Longpre et al.

1,440 citations

2210.11416v52022arXiv

A Review of Sparse Expert Models in Deep Learning

William Fedus, Jeff Dean, Barret Zoph

43 citations

2209.01667v12022arXiv

Emergent Abilities of Large Language Models

Jason Wei, Yi Tay, Rishi Bommasani et al.

1,263 citations

2206.07682v22022arXiv

Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language models

Aarohi Srivastava, Abhinav Rastogi, Abhishek Rao et al.

569 citations

2206.04615v32022Transactions on Machine Learning Research, May/2022, https://openreview.net/forum?id=uyTL5Bvosj

PaLM: Scaling Language Modeling with Pathways

Aakanksha Chowdhery, Sharan Narang, Jacob Devlin et al.

2,555 citations

2204.02311v52022arXiv

ST-MoE: Designing Stable and Transferable Sparse Expert Models

Barret Zoph, Irwan Bello, Sameer Kumar et al.

51 citations

2202.08906v22022arXiv

GLaM: Efficient Scaling of Language Models with Mixture-of-Experts

Nan Du, Yanping Huang, Andrew M. Dai et al.

237 citations

2112.06905v22021arXiv

Multi-Task Self-Training for Learning General Representations

Golnaz Ghiasi, Barret Zoph, Ekin D. Cubuk et al.

83 citations

2108.11353v12021arXiv

Simple Training Strategies and Model Scaling for Object Detection

Xianzhi Du, Barret Zoph, Wei-Chih Hung et al.

28 citations

2107.00057v12021arXiv

Revisiting ResNets: Improved Training and Scaling Strategies

Irwan Bello, William Fedus, Xianzhi Du et al.

229 citations

2103.07579v12021arXiv

Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsity

William Fedus, Barret Zoph, Noam Shazeer

989 citations

2101.03961v32021arXiv

Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentation

Golnaz Ghiasi, Yin Cui, Aravind Srinivas et al.

1,225 citations

2012.07177v22020arXiv

Does Data Augmentation Benefit from Split BatchNorms

Amil Merchant, Barret Zoph, Ekin Dogus Cubuk

4 citations

2010.07810v12020arXiv

Rethinking Pre-training and Self-training

Barret Zoph, Golnaz Ghiasi, Tsung-Yi Lin et al.

510 citations

2006.06882v22020arXiv

Naive-Student: Leveraging Semi-Supervised Learning in Video Sequences for Urban Scene Segmentation

Liang-Chieh Chen, Raphael Gontijo Lopes, Bowen Cheng et al.

165 citations

2005.10266v42020arXiv

Improving 3D Object Detection through Progressive Population Based Augmentation

Shuyang Cheng, Zhaoqi Leng, Ekin Dogus Cubuk et al.

62 citations

2004.00831v22020arXiv

AugMix: A Simple Data Processing Method to Improve Robustness and Uncertainty

Dan Hendrycks, Norman Mu, Ekin D. Cubuk et al.

783 citations

1912.02781v22019arXiv

RandAugment: Practical automated data augmentation with a reduced search space

Ekin D. Cubuk, Barret Zoph, Jonathon Shlens et al.

3,218 citations

1909.13719v22019arXiv

Learning Data Augmentation Strategies for Object Detection

Barret Zoph, Ekin D. Cubuk, Golnaz Ghiasi et al.

630 citations

1906.11172v12019arXiv

Attention Augmented Convolutional Networks

Irwan Bello, Barret Zoph, Ashish Vaswani et al.

1,321 citations

1904.09925v52019arXiv

SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition

Daniel S. Park, William Chan, Yu Zhang et al.

3,558 citations

1904.08779v32019Proc. Interspeech 2019, 2613-2617

Searching for Efficient Multi-Scale Architectures for Dense Image Prediction

Liang-Chieh Chen, Maxwell D. Collins, Yukun Zhu et al.

347 citations

1809.04184v12018arXiv

Backprop Evolution

Maximilian Alber, Irwan Bello, Barret Zoph et al.

8 citations

1808.02822v12018arXiv

AutoAugment: Learning Augmentation Policies from Data

Ekin D. Cubuk, Barret Zoph, Dandelion Mane et al.

1,106 citations

1805.09501v32018arXiv

Efficient Neural Architecture Search via Parameter Sharing

Hieu Pham, Melody Y. Guan, Barret Zoph et al.

1,084 citations

1802.03268v22018arXiv

Progressive Neural Architecture Search

Chenxi Liu, Barret Zoph, Maxim Neumann et al.

138 citations

1712.00559v32017arXiv

Intriguing Properties of Adversarial Examples

Ekin D. Cubuk, Barret Zoph, Samuel S. Schoenholz et al.

58 citations

1711.02846v12017arXiv

Searching for Activation Functions

Prajit Ramachandran, Barret Zoph, Quoc V. Le

2,333 citations

1710.05941v22017arXiv

Neural Optimizer Search with Reinforcement Learning

Irwan Bello, Barret Zoph, Vijay Vasudevan et al.

319 citations

1709.07417v22017arXiv

Learning Transferable Architectures for Scalable Image Recognition

Barret Zoph, Vijay Vasudevan, Jonathon Shlens et al.

6,575 citations

1707.07012v42017arXiv

Neural Architecture Search with Reinforcement Learning

Barret Zoph, Quoc V. Le

4,378 citations

1611.01578v22016arXiv

Transfer Learning for Low-Resource Neural Machine Translation

Barret Zoph, Deniz Yuret, Jonathan May et al.

804 citations

1604.02201v12016arXiv

Multi-Source Neural Translation

Barret Zoph, Kevin Knight

305 citations

1601.00710v12016arXiv

Career total: 54 works. 38 are in this corpus.

Profile built from the corpus for this byline.

Author records are still filling in while the Hub is in beta. If this is your page, you'll be able to claim it soon. Spot a mistake? Tell us.