Report · Page 201

On the Opportunities and Risks of Foundation Models
201
Nithya Sambasivan, Shivani Kapania, Hannah Highfill, Diana Akrong, Praveen Paritosh, and Lora M Aroyo. 2021. “Everyone
wants to do the model work, not the data work”: Data Cascades in High-Stakes AI. In proceedings of the 2021 CHI
Conference on Human Factors in Computing Systems. 1–15.
Victor Sanh, Lysandre Debut, Julien Chaumond, and Thomas Wolf. 2019. DistilBERT, A Distilled Version of BERT: Smaller,
Faster, Cheaper and Lighter. arXiv preprint arXiv:1910.01108 (2019).
Gillian Sankoff. 2018. Language Change Across the Lifespan. Annual Review of Linguistics 4, 1 (2018), 297–316. https:
//doi.org/10.1146/annurev-linguistics-011817-045438 arXiv:https://doi.org/10.1146/annurev-linguistics-011817-045438
Lindsay Sanneman, Christopher Fourie, and Julie Shah. 2020. The State of Industrial Robotics: Emerging Technologies,
Challenges, and Key Research Directions. https://www.therobotreport.com/wp-content/uploads/2021/01/2020-Research-
Brief-Sanneman-Fourie-Shah.pdf
Keshav Santhanam, Siddharth Krishna, Ryota Tomioka, Andrew Fitzgibbon, and Tim Harris. 2021. DistIR: An Intermediate
Representation for Optimizing Distributed Neural Networks. In Proceedings of the 1st Workshop on Machine Learning and
Systems. 15–23.
Adam Santoro, Sergey Bartunov, Matthew Botvinick, Daan Wierstra, and Timothy P. Lillicrap. 2016. Meta-Learning with
Memory-Augmented Neural Networks. In ICML. 1842–1850. http://proceedings.mlr.press/v48/santoro16.html
Shibani Santurkar, Dimitris Tsipras, and Aleksander Madry. 2020. BREEDS: Benchmarks for Subpopulation Shift. arXiv
(2020).
Maarten Sap, Dallas Card, Saadia Gabriel, Yejin Choi, and Noah A. Smith. 2019. The Risk of Racial Bias in Hate Speech
Detection. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics. Association for
Computational Linguistics, Florence, Italy, 1668–1678. https://doi.org/10.18653/v1/P19-1163
Aliya Saperstein and Andrew M. Penner. 2012. Racial Fluidity and Inequality in the United States. Amer. J. Sociology 118, 3
(2012), 676–727. https://doi.org/10.1086/667722 arXiv:https://doi.org/10.1086/667722
Aliya Saperstein, Andrew M. Penner, and Ryan Light. 2013. Racial Formation in Perspective: Connecting Individuals,
Institutions, and Power Relations. Annual Review of Sociology 39, 1 (2013), 359–378. https://doi.org/10.1146/annurev-
soc-071312-145639 arXiv:https://doi.org/10.1146/annurev-soc-071312-145639
N. Saunshi, S. Malladi, and S. Arora. 2020a. A Mathematical Exploration of Why Language Models Help Solve Downstream
Tasks. arXiv preprint arXiv:2010.03648 (2020).
Nikunj Saunshi, Sadhika Malladi, and Sanjeev Arora. 2020b. A Mathematical Exploration of Why Language Models Help
Solve Downstream Tasks. arXiv preprint arXiv:2010.03648 (2020).
Jaromir Savelka, Vern R Walker, Matthias Grabmair, and Kevin D Ashley. 2017. Sentence boundary detection in adjudicatory
decisions in the united states. Traitement automatique des langues 58 (2017), 21.
Manolis Savva, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu,
Vladlen Koltun, Jitendra Malik, et al. 2019a. Habitat: A Platform for Embodied AI Research. In 2019 IEEE/CVF International
Conference on Computer Vision (ICCV). IEEE Computer Society, 9338–9346.
Manolis Savva, Abhishek Kadian, Oleksandr Maksymets, Yili Zhao, Erik Wijmans, Bhavana Jain, Julian Straub, Jia Liu,
Vladlen Koltun, Jitendra Malik, Devi Parikh, and Dhruv Batra. 20