CS6282 Very Large Scale Distributed Systems Ooi Wei Tsang SOC1-04-20 ooiwt@comp.nus.edu.sg 1 NUS.SOC.CS5248 Ooi Wei Tsang Distributed Systems Very Large Scale Distributed Systems New technological trends lead to VLDS Examples P2P File Sharing MMORPG News Alert Web Services Sensor Network Examples of VLDS P2P File Sharing MMORPG News Alert Video on Demand Scope of CS6282 Explore basic techniques and their applications Goal At the end of the class, students are expected to understand how to build large scale distributed systems. Target Audience Anyone interested in distributed systems or doing related research (db, grid, sensors, media etc.) Learning Mode I am here to light you on fire, not to fill your bucket. Learning Mode We learn together Activities Read Think Discuss Innovate Continuous Assessments 10 Project 20 50 Exam Assignments/Quizzes Class Participation 20 Exam (20%) Open Book Essay Type Project (50%) Individual/Pair Research Based Expect Something New Types of Project Identify a new problem Propose a solution Types of Project Existing Problem New Solution Types of Project Existing Solutions New Evaluations Types of Project Existing Solutions New Application Types of Project Collect and Analyze Data New Insights Project Components Define Problem Find Solution Implement Evaluate Present Project Deliverables 8-page research paper Poster presentations Combine Project with your current research (subj. to advisor’s approval) with another module (subj to instructor’s approval) In Class Participation Discussions Scribing Presentations Scribing Scribe notes Discuss and merge Typeset in LaTeX Post online Presentations Read papers Present in class Answer questions Assignments + Quizzes Quizzes Paper Reviews Survey WARNING Zero-Tolerance for Plagiarism Related Class CS5223 Distributed Systems Tue 6:30-8:30pm LT33 Gary Tan Very Large Scale Distributed Systems Design Requirements Correct Scalable Robust Efficient Simple Secure Design Requirements Correct Scalable Robust Efficient Simple Secure Undesirable Characteristics Numbers Scattered Dynamic Unreliable Untrustable Undesirable Properties Numbers Scattered Dynamic Unreliable Untrustable Motivating Examples DNS (lookup) P2P File Sharing (lookup, storage) VoD (multicast) MMORPG (global states) Network Management (data collection) Olympics News Alert (event notification) Operations Lookup Multicast Data Collection Storage Event Notifications : Standard Techniques Build a Tree (or some form of Hierarchy) Build a Mesh/Graph (or some structure) Gossip (send to random nodes) Flood (send to everyone)