Report · Page 203

On the Opportunities and Risks of Foundation Models
203
C. Shannon. 1948. A mathematical theory of communication. Bell Syst. Tech. J. 27 (1948), 379–423.
Lin Shao, Toki Migimatsu, Q. Zhang, Karen Yang, and Jeannette Bohg. 2020. Concept2Robot: Learning Manipulation
Concepts from Instructions and Human Demonstrations. In Robotics: Science and Systems (RSS).
Pratyusha Sharma, L. Mohan, Lerrel Pinto, and A. Gupta. 2018. Multiple Interactions Made Easy (MIME): Large Scale
Demonstrations Data for Imitation. In Conference on Robot Learning (CORL).
Noam Shazeer, Youlong Cheng, Niki Parmar, Dustin Tran, Ashish Vaswani, Penporn Koanantakool, Peter Hawkins, Hy-
oukJoong Lee, Mingsheng Hong, Cliff Young, et al. 2018. Mesh-TensorFlow: Deep Learning for Supercomputers. Advances
in Neural Information Processing Systems 31 (2018), 10414–10423.
Noam Shazeer, Azalia Mirhoseini, Krzysztof Maziarz, Andy Davis, Quoc Le, Geoffrey Hinton, and Jeff Dean. 2017. Outra-
geously large neural networks: The sparsely-gated mixture-of-experts layer. arXiv preprint arXiv:1701.06538 (2017).
Noam Shazeer and Mitchell Stern. 2018. Adafactor: Adaptive Learning Rates with Sublinear Memory Cost. In International
Conference on Machine Learning. PMLR, 4596–4604.
Bokui Shen, Fei Xia, Chengshu Li, Roberto Martın-Martın, Linxi Fan, Guanzhi Wang, Claudia D’Arpino, Shyamal Buch,
Sanjana Srivastava, Lyne P Tchapmi, Kent Vainio, Li Fei-Fei, and Silvio Savarese. 2021a. iGibson, a Simulation Environment
for Interactive Tasks in Large Realistic Scenes. International Conference on Intelligent Robots and Systems (IROS) (2021).
Haichen Shen, Lequn Chen, Yuchen Jin, Liangyu Zhao, Bingyu Kong, Matthai Philipose, Arvind Krishnamurthy, and Ravi
Sundaram. 2019. Nexus: A GPU Cluster Engine for Accelerating DNN-Based Video Analysis. In Proceedings of the 27th
ACM Symposium on Operating Systems Principles. 322–337.
Jia Tracy Shen, Michiharu Yamashita, Ethan Prihar, Neil Heffernan, Xintao Wu, and Dongwon Lee. 2021b. MathBERT: A
Pre-trained Language Model for General NLP Tasks in Mathematics Education. arXiv:2106.07340 [cs.CL]
Emily Sheng, Josh Arnold, Zhou Yu, Kai-Wei Chang, and Nanyun Peng. 2021. Revealing Persona Biases in Dialogue Systems.
arXiv:2104.08728 [cs.CL]
Emily Sheng, Kai-Wei Chang, Premkumar Natarajan, and Nanyun Peng. 2019. The Woman Worked as a Babysitter: On Biases
in Language Generation. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and
the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP). Association for Computational
Linguistics, Hong Kong, China, 3407–3412. https://doi.org/10.18653/v1/D19-1339
Toby Shevlane and Allan Dafoe. 2020. The Offense-Defense Balance of Scientific Knowledge: Does Publishing AI Research
Reduce Misuse?. In Proceedings of the 2020 AAAI/ACM Conference on AI, Ethics, and Society (AIES ’20). http://arxiv.org/
abs/2001.00463
Taylor Shin, Yasaman Razeghi, Robert L. Logan IV, Eric Wallace, and Sameer Singh. 2020. AutoPrompt: Eliciting Knowledge
from Language Models with Automatically Generated Prompts. In Proceedings of the 2020 Conference on Empirical
Methods in Natural Language Processing (EMNLP). Association for Computational Linguistics, Online, 4222–4235. https:
//doi.org/10.18653/v1/2020.emnlp-main.346
Ben Shneiderman and Pattie Maes. 1997. Direct manipulation vs. interface agents. In Interactions. ACM.
Mohammad Shoeybi, Mostofa Patwary, Raul Puri, Patrick LeGresley, Jared Casper, an