Piazza

Lectures: MW, 9-10:30 in 320 Soda

CCN: 67236

Instructor: John Canny, 637 Soda, Office Hours M 2-3pm, 637 Soda

Course Information

Topics and Readings are in the Discussions Page

Course Outline (WIP)

Date	Lecture Topic	Readings	Presenters	Assignments
8/23/17	Overview Slides (pptx) (pdf)		John Canny
8/28/17	Naturalistic Voice Interfaces Slides (pptx) (pdf)	Speech Acts Routledge Encyclopedia of Philosophy entry On the Dynamic Relations Between Common Ground and Presupposition Istvan Kecskes and Fenghui Zhang	John Canny
8/30/17	Conceptual Models, Affordances, Explanations Slides (pptx) (pdf)	The Design of Everyday Things CH1: The Psychopathology of Everyday Things, Don Norman Organising User Interfaces Around Reflective Accounts Dourish, Adler and Cantwell-Smith, Proceedings of Reflection '96 Explanation and abductive inference. Lombrozo, T., in K.J. Holyoak and R.G. Morrison (Eds.), Oxford Handbook of Thinking and Reasoning Oxford U. Press (2012). Reasoning About Object Affordances in a Knowledge Base Representation Yuke Zhu and Alireza Fathi, and Li Fei-Fei, ECCV 2014	John Canny
9/6/17	Visual Description David's slides Mick's slides	Show, Attend and Tell: Neural Image Caption Generation with Visual Attention (Links to an external site.)Links to an external site. Xu et al. A Hierarchical Approach for Generating Descriptive Image Paragraphs (Links to an external site.)Links to an external site. Krause et al.	David Gaddy Mick Jermsurawong
9/11/17	Video Description David's slides Allen's slides	Improving LSTM-based Video Description with Linguistic Knowledge Mined from Text, Venugopalan et al. Visual Relationship Detection with Language Priors, Lu et al.	David Chan Allen Tang
9/13/17	Visual Q&A David's Slides Mick's Slides	Andreas, Jacob, et al. "Learning to compose neural networks for question answering." arXiv:1601.01705 (2016). Xu et al. "Ask, Attend and Answer: Exploring Question-Guided Spatial Attention for Visual Question Answering"., arXiv 1511.05234v2	David Chan Mick Jermsurawong	Project Proposal out
9/18/17	Visual Prediction and Simulation Bala's slides Vivek's Slides	Finn et al., Unsupervised Learning for Physical Interaction through Video Prediction., arXiv 1605.07157v4 Zhu et al., Visual Semantic Planning using Deep Successor Representations., ICCV 2017.	Vivek Raghuram Bala Kumaravel
9/20/17	Visual Semantic Representations Allen's slides John's slides	Luc et al. "Predicting Deeper into the Future of Semantic Segmentation", ICCV 2017. Sermanet et al. "Time-Contrastive Networks: Self-Supervised Learning from Multi-View Observation"., arXiv 2017.	Allen Tang John Canny	Project Proposal due 10pm Proposal Presentation out
9/25/17	Project Proposals			Proposal Presentation due 9am
9/27/17	Conversational Agents
10/2/17	Grounded Language and Action
10/4/17
10/9/17	Immitation Learning
10/11/17
10/16/17	Visuo-Motor Policies
10/18/17
10/23/17	Hierarchical Policies, Game-Playing
10/25/17
10/30/17	Instructing Robots
11/1/17
11/6/17	Memory Networks
11/8/17
11/13/17	Higher levels, Activities, Negotiating meaning
11/15/17
11/20/17
11/27/17	Project Presentations
11/29/17	Project Presentations

Talking to Robots