WORKSHOP – STANFORD UNIVERSITY Agent-Based Modeling of Educational and Social Systems Spiro Maroulis and Paulo Blikstein Sponsored by the Stanford Interdisciplinary Training Program in Quantitative Education Policy Research, with funding from the Institute of Education Sciences Maroulis & Blikstein Instructors Spiro Maroulis Assistant Professor, School of Public Affairs Arizona State University email: s-maroulis@kellogg.northwestern.edu http://www.kellogg.northwestern.edu/Faculty/Directory/Maroulis_Spiro Paulo Blikstein Assistant Professor, School of Education and (by courtesy) School of Engineering Stanford University email: paulob@stanford.edu http://tltl.stanford.edu Workshop Website http://ies2011.stanford.edu Email lists Instructors (Spiro, Paulo & TAs): ies2011faculty@lists.stanford.edu All students (excluding instructors and TAs): ies2011students@lists.stanford.edu Workshop Description and Goals This workshop begins with the premise that we are all modelers in the sense that we construct explanations in our heads to simplify situations in which we want to answer a question. These may be personal questions, such as, "What dissertation topic should I choose?" or "Is this the right job for me?" They also may be questions about policy and organizations, such as, "Should we implement a meritbased pay system for teachers?" or “What conditions would lead to a school choice system that ‘works’?” When we observe economic and social systems, gather information, draw inferences, and attempt to predict future outcomes, we are engaged in a process of informal modeling. This workshop 2 Agent-Based Modeling of Educational and Social Systems Maroulis & Blikstein will introduce how and why you might convert such informal models and intuitions into more tangible, formal models you can ‘run,’ explore, or perhaps use to try to change some small corner of the world. The theoretical and methodological basis for this workshop comes from the emerging field of complex systems – a field that studies the dynamics of systems, such as organizations, whose behavior is the consequence of many different interdependent agents, and can be difficult to research using traditional analytical and empirical methods. To investigate the behavior of a natural or social system over time, complex systems research often makes use of computational agent-based models. In particular, agent-based models are used to discover the emergence of macro-level properties from the individual-level actions of the agents, as well as identify leverage points in a social systems – points where a small, local change can have a disproportionate system-level impact. While there are many good reasons for creating agent-based models of social systems, this workshop places emphasis on one in particular: the process of computational modeling can help you improve your own mental models of how economic and social systems work. To this end, the goals of the workshop are to: introduce you to a “complex systems” perspective on educational policy, help you gain skill in using NetLogo agent-based modeling environment, a popular and powerful complex systems modeling tool, and increase your interest in computational modeling while getting you to think about how modeling may help you address problems that matter to you. No prior modeling or programming knowledge is required. Pre-Workshop Preparation Read Kelly, K. (1994). Out of control: The new biology of machines, social systems, and the economic world. Perseus Books. Chapters 1 & 2. Available online at: http://www.kk.org/outofcontrol/contents.php 3 Agent-Based Modeling of Educational and Social Systems Maroulis & Blikstein Maroulis, S., Guimera, R., Petry, H., Gomez, L., Amaral, L.A.N., Wilensky, U. (2010). “Complex Systems View on Educational Policy Research.” Science, Volume 300, Issue 6000. Download Wilensky, U. (1999). NetLogo. http://ccl.northwestern.edu/netlogo/. Center for Connected Learning and Computer-Based Modeling, Northwestern University, Evanston, IL. Please bring your laptops with NetLogo installed to the session. NetLogo can be downloaded for free and can be installed on either a Mac, PC, or Linux. Do NetLogo Tutorial #1: Models NetLogo Tutorial #2: Commands NetLogo Tutorial #3: Procedures Links to all three tutorials can be found on the far left-hand side of this webpage: http:/ccl.northwestern.edu/netlogo/docs/ Fill pre-workshop survey A pre-workshop form is available at this URL: http://bit.ly/l9rnV2 This survey gets you thinking about an idea for an agent-based model of your choosing that you will begin building during the workshop. Please complete it by Saturday, June 25, 12pm. 4 Agent-Based Modeling of Educational and Social Systems Maroulis & Blikstein Agenda Day 1 Class Topic Duration Staff I Introductory Exercise: The Beer Game 1 hour Maroulis II Introduction to Complex Systems Topics include emergence; applications in the natural sciences; pedagogical applications inside classrooms. Examples include canonical models from the natural sciences as well as Stanford student projects from Prof. Blikstein’s course. 1 hour Blikstein Break 15 mins Building Agent-Based Models, Example In this instructor-led interactive session, we will build a simple model together. Topics covered include defining equilibrium in dynamic systems; defining agents and behavioral rules in NetLogo; networking agents; and conducting computational experiments. 1.5 hours Lunch 1 hour Building Agent-Based Models, Example (cont.) 1.5 hours Break 15 mins IV Modeling Economic and Social Systems We will discuss the motivation for computational modeling in social science. This will include a review several “classic” social science ABMs, as well as a more recent and specific applications to educational policy. 1 hour Maroulis V Building Agent-Based Models, Lab In this “lab” session, you will begin working on a model of your choosing. After providing some initial guidance and practical tips, the instructors will be available to answer individual questions as you develop your model. 1 hour Maroulis, Blikstein, doctoral students III III 5 Maroulis Maroulis Agent-Based Modeling of Educational and Social Systems Maroulis & Blikstein Day 2 Class V Topic Duration Building Agent-Based Models, Lab (cont.) Participants continue to develop their own models with instructor assistance. 3 hours Lunch 1 hour Staff Maroulis, Blikstein, doctoral students Maroulis, Blikstein, doctoral students Building Agent-Based Models, Lab (cont.) Participants continue to develop their own models with instructor assistance. 1.5 hours Break 15 mins VII Conducting Computational Experiments Topics covered include relationship to social experiments, regression analysis, and hypothesis testing; model calibration, verification, and validation; and practical tips on importing and exporting data to statistical packages. 1 hour Maroulis VIII Building Agent-Based Models, Lab (cont.) Participants continue to develop their own models with instructor assistance. Emphasis may shift from model development to model experimentation. 1.5 hours Maroulis, Blikstein, doctoral students Duration Staff VI Day 3 Class Topic IX Building Agent-Based Models, Lab (cont.) Participants continue to develop their own models with instructor assistance. Emphasis may shift from model development to model experimentation. 2 hours X Student Model Presentations 1 hour XI Wrap-Up and Conclusion 1 hour 6 Maroulis, Blikstein, doctoral students Maroulis Agent-Based Modeling of Educational and Social Systems