MAS XXX: Cooperative Machines INSTRUCTOR COURSE DAY & Time ROOM H level credit Breazeal Cooperative Machines Special Topics in Media Technology XX-XX NE18-595, 1CC conference room (??) Units 12-0-0 This course examines the issues, principles, and challenges toward building machines that cooperate with humans and with other machines through lecture, lively discussion and critique of course readings, and student projects. Philosophical, scientific, and theoretical insights into this subject will be examined, as well as how these ideas are manifest in both natural and artificial systems (e.g. software agents and robots). Student projects explore selected course themes in depth. Part 1: Intention: Philosophical and Scientific Insights Week 1: Week 2: Week 3: Week 4 Week 5 Philosophy: Intention and Folk Psychology Development of Theory of Mind (ToM) Models of ToM Reading Behavior, Reading Minds Toward Machines with Theory of other Minds Part 2: Collaborative Systems Week 6: Week 7 Week 8: Week 9 Week 10 Human computer collaboration Theory of collaborative dialog Student semester project proposals due Recognizing intentional structure in discourse Plan recognition in discourse Machines that express intent Part 3: Machines that Collaborate and Cooperate Week 11 Week 12: Week 13: Robot teams Human Computer Collaboration Student presentations of semester projects Course Readings Week 1: Philosophy B. Malle & J. Knobe (2001), “The Distinction between Desire and Intention: A Folk-Conceptual Analysis.” In Malle, Moses and Baldwin (eds.) Intention and Intentionality. MIT Press. Chapter 2. M. Bratman (1990), “ What is intention?” In Cohen, Morgan and Pollack (eds.) Intentions in Communication. MIT Press. Chapter 2. D. Dennett (1987), “Three kinds of intentional psychology.” In The Intentional Stance. MIT Press. Chapter 3. Week 2: Development of Theory of Mind A. Meltzoff & R. Brooks (2001) “Like Me” as a Building block for understanding other minds: bodily acts, attention and intention. In Malle, Moses & Baldwin (eds) Intention and Intentionality. MIT Press. Chapter 8. S. Baron Cohen (1991), “Precursers to a Theory of Mind: Understanding Attention in Others.” In A. Whiten (ed) Natural Theories of Mind. Blackwell. Chapter 16. H. Wellman (1991), “From Desires to Beliefs: Acquisition of a Theory of Mind.” In A. Whiten (ed.) Natural Theories of Mind. Blackwell. Chapter 2. Week 3: Models of Theory of Mind A. Gopnick & H. Wellman (1992), “Why the Child’s Theory of Mind Really Is a Theory.” Mind and Language 7(1-2), pp 145-171. S. Nichols, S. Stich, A. Leslie and D. Klein (1996), “Variations of off-line simulation.” In Carreuthers and Smith (eds.) Theories of Theories of Mind. Cambridge University Press. Chapter 4. A. Goldman (2001), “Desire, Intention, and the Simulation Theory.” In Malle, Moses and Baldwin (eds.) Intention and Intentionality. MIT Press. Chapter 10. Week 4 Reading behavior, reading minds D. Baldwin & L. Moses (1994), “Early understanding of referential intent and attentional focus: evidence from language and emotion.” In C. Lewis and P. Mitchell (eds.) Children’s Early Understanding of Mind.” Lawrence Erlbaum Assoc. Chapter 7. A. Woodward, J. Sommerville and J. Guajardo (2001), “How infants make sense of intentional action.” In Malle, Moses, and Baldwin (eds.) Intention and Intentionality. MIT Press. Chaper 7. D. Povinelli (1996), “Chimpanzee theory of mind? The long road to strong inference.” In P. Carruthers and P. Smith (eds.) Theories of Theories of Mind. Cambridge University Press. Chapter 18. Week 5 Toward Machines with ToM M. Mataric (2000). “Getting Humanoids to Move and Imitate". In IEEE Intelligent Systems:18-24, Jul 2000. B. Scassellati (2000). "Theory of Mind for a Humanoid Robot," In the first IEEE/RSJ International Conference on Humanoid Robotics. Cambridge, Ma. C. Breazeal, D. Bushbaum, J. Gray, B. Blumberg (2004). “Learning from and about others: towards using imitation to bootstrap the social competence of robots.” In review Artificial Life. Week 6: Collaborative Systems B. Gross (1996). “Collaborative Systems.” 1994 AAAI Presidential Address.” 2(17), pp. 67-85. B. Grosz and C. Sidner (1986), "Attention, Intentions, and the Structure of Discourse", Computational Linguistics, 12(3), pp 175—202. J. Allen, D. Byron, M. Dzikovska, G. Ferguson, L. Galescu and A. Stent (2001), “Towards conversational human-computer interaction.” In AI Magazine 22(4), pages 27-38, Winter, 2001. Week 7 Theory of collaborative dialog P. Cohen & H. Levesque (1990),”Persistence, Intention, and commitment.” In Cohen, Morgan, Pollack (eds) Intentions in Communication. MIT Press. Chapter 3. B. Grosz & C. Sider (1990) “Plans for Discourse” In Cohen, Morgan, Pollack (eds) Intentions in Communication. MIT Press. Chapter 20. D. Sullivan, A. Glass, B. Grosz, and S. Kraus (1999), “ Intention reconciliation in the context of teamwork: an initial empirical investigation.” In Klusch, Shehory, Weiss (eds) Cooperative Information Agents III, Lecture Notes in Artificial Intelligence. Vol 1652. Springer-verlag. Pp 149-162. Week 8: Recognizing intentional structure in discourse K. Lochbaum (1998), “A collaborative planning model for intentional structure.” Computational Linguistics 4(24) pp.525-571. F. Quek, D. McNeill, R. Bryll, S. Duncan, X. Ma, C. Kirbas, K. McCullough, R. Ansari (2002), “Multimodal human discourse: gesture and speech. ACM transactions on computer human interaction 9(3), pp 171-193. J. Cassell, Y. Nakano, T. Bickmore (2001) “Non-verbal cues for discourse structure.” In proceedings of the association for computational linguistics, July 2001. Telouse, France. Week 9 Plan recognition in discourse D. Litman & J. Allen (1990) “Discourse processing and commonsense plans” In Cohen, Morgan, and Pollack (eds.) Intentions in Communication. MIT Press. Chatper 17. Lesh, N., Rich, C., Sidner, C.L. (1999) “Using plan recognition in humancomputer collaboration.” In Proceedings of the International Conference on User Modelling (UM-99), N. Lesh, C. Rich, and C. Sidner (2001), “Collaborating with focused and unfocused users under imperfect communication. In proceedings of the international conference on User Modelling. Springer Verlag, pp. 64—73. Week 10 Machines that express intent F. de Rosis, C. Pelachaud, I. Poggi, V. Carofiglio and B. De Carolis (2003) “From Greta’s Mind to her Face: Modelling the Dynamics of Affective States in a Conversational Embodied Agent.” International Journal of Human-Computer Studies, 59. J. Cassell and H. Vilhjalmsson (1999), “Fully embodied conversational avatars: making communicative behaviors autonomous.” Autonomous Agents and Multiagent Systems 2 pp 45—64. S. Carberry, L. Lambert, and L. Schroeder ( ), “Toward recognizing and conveying an attitude of doubt via natural language.” Applied Artificial Intelligence, 16(7), pp. 495-517, 2002. Week 11 Robot teams T. Balch & R. Arkin (1994), “Communication in Reactive Multiagent Robotic Systems.” Autonomous Robots 1(1), p 27-52. P. Stone & M. Veloso (1999), “Task Decomposition, Dynamic Role Assignment, and Low-Bandwidth Communication for Real-Time Strategic Teamwork.” Artificial Intelligence, 110(2), pp 241-273. M. Veloso, P. Stone & M. Bowling (1998) “Anticipation: A Key for Collaboration in a Team of Agents.” In Proceedings of the third international conference on autonomous agents. Week 12: Human computer collaboration C. Rich, C. Sidner and N. Lesh (2001) “Collagen: Applying Collaborative Discourse Theory to Human-Computer Interaction.” AI Magazine. Winter 2001. pp 15-25 J. Rickel, N. Lesh, C. Rich, C. Sidner, and A. Gertner (2002), “Collaborative Discourse Theory as a Foundation for Tutorial Dialog.” In proceedings of the 6 th International Conference on Intelligent Tutoring Systems. Springer Verlag, pp 512-551.