Report · Page 163

On the Opportunities and Risks of Foundation Models
163
Jacob Andreas. 2020. Good-Enough Compositional Data Augmentation. Association for Computational Linguistics (July
2020), 7556–7566. https://doi.org/10.18653/v1/2020.acl-main.676
Jacob Andreas, Marcus Rohrbach, Trevor Darrell, and Dan Klein. 2016. Neural module networks. In Proceedings of the IEEE
Conference on Computer Vision and Pattern Recognition. 39–48.
Marcin Andrychowicz, Filip Wolski, Alex Ray, Jonas Schneider, Rachel Fong, Peter Welinder, Bob McGrew, Josh Tobin,
Pieter Abbeel, and Wojciech Zaremba. 2017. Hindsight Experience Replay. arXiv preprint arXiv:1707.01495 (2017).
Julia Angwin, Jeff Larson, Surya Mattu, and Lauren Kirchner. 2016. Machine Bias: There’s software used across the country
to predict future criminals. And it’s biased against blacks. ProPublica.
Rohan Anil, Badih Ghazi, Vineet Gupta, Ravi Kumar, and Pasin Manurangsi. 2021. Large-scale differentially private BERT.
arXiv preprint arXiv:2108.01624 (2021).
Rohan Anil, Vineet Gupta, Tomer Koren, Kevin Regan, and Yoram Singer. 2020. Scalable Second Order Optimization for
Deep Learning. arXiv preprint arXiv:2002.09018 (2020).
Lasse F. Wolff Anthony, Benjamin Kanding, and Raghavendra Selvan. 2020. Carbontracker: Tracking and Predicting the
Carbon Footprint of Training Deep Learning Models. ICML Workshop on Challenges in Deploying and monitoring
Machine Learning Systems. arXiv:2007.03051.
Stanislaw Antol, Aishwarya Agrawal, Jiasen Lu, Margaret Mitchell, Dhruv Batra, C Lawrence Zitnick, and Devi Parikh.
2015. Vqa: Visual question answering. In Proceedings of the IEEE international conference on computer vision. 2425–2433.
Maria Antoniak and David Mimno. 2021. Bad Seeds: Evaluating Lexical Methods for Bias Measurement. In Proceedings of
ACL 2021.
Hannah Arendt. 1987. Collective Responsibility. Springer Netherlands, Dordrecht, 43–50.
Martin Arjovsky, Léon Bottou, Ishaan Gulrajani, and David Lopez-Paz. 2019. Invariant risk minimization. arXiv preprint
arXiv:1907.02893 (2019).
Michael Armbrust, Armando Fox, Rean Griffith, Anthony D Joseph, Randy H Katz, Andrew Konwinski, Gunho Lee, David A
Patterson, Ariel Rabkin, Ion Stoica, et al. 2009. Above the clouds: A berkeley view of cloud computing. Technical Report.
Technical Report UCB/EECS-2009-28, EECS Department, University of California ....
Sanjeev Arora, Nadav Cohen, Wei Hu, and Yuping Luo. 2019a. Implicit regularization in deep matrix factorization. In
Advances in Neural Information Processing Systems. 7411–7422.
Sanjeev Arora, Hrishikesh Khandeparkar, Mikhail Khodak, Orestis Plevrakis, and Nikunj Saunshi. 2019b. A theoretical
analysis of contrastive unsupervised representation learning. arXiv preprint arXiv:1902.09229 (2019).
Sanjeev Arora, Yuanzhi Li, Yingyu Liang, Tengyu Ma, and Andrej Risteski. 2016. A latent variable model approach to
PMI-based word embeddings. Transactions of the Association for Computational Linguistics (2016).
Mikel Artetxe, Sebastian Ruder, and Dani Yogatama. 2020. On the Cross-lingual Transferability of Monolingual Representa-
tions. arXiv:1910.11856 [cs] (May 2020). http://arxiv.org/abs/1910.11856
Euan A Ashley. 2016. Towards precision medicine. Nature Reviews Genetics 17, 9 (2016), 507–522.
Amanda Askell, Miles Brundage, and Gillian Hadfield. 2019. The Role of Cooperation in Responsible AI Development.
http://arxiv.org/abs/1907.04534
David H. Autor. 2015. Why Are There Still So Many Jobs? The History and Future of Workplace Automation. Jour