CS655: Advanced Topics in Distributed Systems [Fall 2013]

[Announcements]

[Syllabus]

Schedule

Instructor		Lecture Coordinates
	Shrideep Pallickara Office: Room 346, Computer Science Office Hours: 3:30-4:30 pm TTH or by appointment E-mail: shrideep {aT} cs.colostate.edu (with the obvious change) Tel: 970.492.4209		TTH: 11:00 am -12:15 pm CSB Room 425

Note on Presentations:

The idea is to weave a narrative around 1 main paper and 2 related papers
- The presenter is expected to contribute another relevant paper
You will meet with me regularly to plan the composition of your presentation
- Make sure that you rehearse the presentation before class
The presenter’s critical review and slides will be posted 2 hours before class
Each student is expected to ask at least one question in class.
- The questions should not be softball questions with obvious answers
- The questions should be framed as outlined in class
Take a look at the section on critical reviews for additional content in these presentations

Week	Date	Readings		Notes	Critical Review	Presenter
1	8/27	Introduction. [Lecture 1]
	8/29	Above the Clouds: A Berkeley View of Cloud Computing. Michael Armbrust et al. [Paper] [Lecture 2]

2	9/3	Scalable, Distributed Data Structures for Internet Service Construction. Steven D. Gribble, Eric A. Brewer, Joseph M. Hellerstein, and David Culler , UC Berkeley. Proceedings of OSDI 2000. [Paper] [Lecture 3]
	Application Development
	9/5	The Google File System. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leun. [Paper] [Lecture 4]
			Dynamo: Amazon's Highly Available Key-value Store. Giuseppe DeCandia et al. [Paper]
			The Andrew File System

3	9/10	Granules: A Lightweight, Streaming Runtime for Cloud Computing With Support for Map-Reduce. Shrideep Pallickara et al. [Paper] [Lecture 5]
	9/13	Improving MapReduce Performance in Heterogeneous Environments. Zaharia, M., Konwinski, A., Joseph, A. D., Katz, R. H., and Stoica, I. In Proceedings of OSDI. 2008, 29-42. [Paper]		[Slides]	[Alsaraan-CR]	Hessah
			Mapreduce: Simplified Data Processing on Large Clusters. Jeffrey Dean and Sanjay Ghemawat. [Paper]
			MapReduce and parallel DBMSs: friends or foes? Michael Stonebraker, Daniel J. Abadi, David J. DeWitt, Samuel Madden, Erik Paulson, Andrew Pavlo, Alexander Rasin. Commun. ACM 53(1): 64-71 (2010). [Paper]
			Initial Findings for Provisioning Variation in Cloud Computing. M. Rehman and M. Sakr. CloudComm 2010. [Paper]
			Enhancement of Xen’s Scheduler for MapReduce Workloads. Hui Kang et al. HPDC 2011. [Paper]
			P2P-MapReduce: Parallel data processing in dynamic Cloud environments. Marozzo, F., Talia, D., and Trunfio, P. [Paper]

4	9/17 & 9/19	Dryad: Distributed Data-Parallel Programs from Sequential Building Blocks. Michael Israd et. al. EuroSys 2007: 59-72. [Paper]		[Slides]	[Rabiet-CR]	Louis
			Biologically-inspired distributed middleware management for stream processing systems. ACM Middleware conference, 2008. G. T. Lakshmanan and R. Strom. [Paper]
			Pegasus: A framework for mapping complex scientific workflows onto distributed systems. Ewa Deelman et. al. Journal of Scientific Programming. Volume 13 Issue 3, July 2005. [Paper]
			Ciel: A universal execution engine for distributed data-flow computing. NSDI 2012. Derek G. Murray et al [Paper]

5	9/24 & 9/26	BOINC: A System for Public-Resource Computing and Storage. David Anderson. GRID 2004. [Paper]		[Slides]	[Stern-CR]	Ryan
			BOINC: Designing a Runtime System for Volunteer Computing. David P. Anderson, Carl Christensen and Bruce Allen. [Paper]
			Performance Evaluation of Scheduling Policies for Volunteer Computing. Derrick Kondo, David P. Anderson and John McLeod VII. eScience 2007. [Paper]
			Performance Prediction and Analysis of BOINC Projects: An Empirical Study with EmBOINC. Trilce Estrada, Michela Taufer, David Anderson. Journal of Grid Computing. 2009. [Paper]

6	10/1 & 10/3	Condor: Deploying a High Throughput Computing Cluster. Jim Basney and Miron Livny. [Paper]		[Slides]	[Budgaga- CR]	Walid

			The Anatomy of the Grid: Enabling Scalable Virtual Organizations. I. Foster, C. Kesselman, S. Tuecke. International J. Supercomputer Applications, 15(3), 2001. [Paper]

	Process Migration
7	10/8 & 10/10	Survey: Process migration. Dejan S. Milojicic, Fred Douglis, Yves Paindaveine, Richard Wheeler and Songnian Zhou. ACM Computing Surveys. 32:3, 2000. [Paper]		[Slides]	[Alsaraan- CR]	Hessah
			Rate of change load balancing in distributed and parallel systems. Miguel Campos, L.; Scherson, I. 10th Symposium on Parallel and Distributed Processing, 1999. [Paper]

	Data Storage Systems
8	10/15 & 10/17	Bigtable: A Distributed Storage System for Structured Data. Fay Chang et al. [Paper]		[Slides]	[Rabiet-CR]	Louis
			The Google File System. Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leun. [Paper]
			The Chubby lock service for loosely-coupled distributed systems. Mike Burrows. [Paper]

9	10/22 & 10/24	Building a Database on S3. Matthias Brantner et al. [Paper]		[Slides]	[Alsaraan-CR]	Hessah
			PNUTS: Yahoo!’s Hosted Data Serving Platform. Brian F. Cooper et. al. [Paper]
			SQL in the Clouds. James Johnson. [Paper]

10	10/29 & 10/31	Cassandra - A Decentralized Structured Storage System. Avinash Lakshman and Prashant Malik. [Paper]		[Slides]	[Budgaga-CR]	Walid
			Dynamo: Amazon's Highly Available Key-value Store. Giuseppe DeCandia et al. [Paper]
			Storage management and caching in PAST, a large-scale, persistent peer-to-peer storage utility. A. Rowstron and P. Druschel. SOSP 2001. [Paper]

11	11/5 & 11/7	Data Management in the Cloud: Limitations and Opportunities. Daniel Abadi. [Paper]		[Slides]	[Stern-CR]	Ryan
			Adapting Microsoft SQL Server for Cloud Computing. Philip A. Bernstein et al. [Paper]

	Virtualization
12	11/12 & 11/14	Xen and the Art of Virtualization. Paul Barham et al. [Paper]		[Slides]	[Budgaga-CR]	Walid
			Optimizing Network Virtualization in Xen. Aravind Menon et al. [Paper]
			Denali: Lightweight Virtual Machines for Distributed and Networked Applications. Andrew Whitaker, Marianne Shaw, and Steven D. Gribble. [Paper]

13	11/19 & 11/21	Performance Issues In Clouds: An Evaluation of Virtual Image Propagation and I/O Paravirtualization. D. Armstrong, K. Djemame The Computer Journal, June 2011, vol. 54, iss. 6, pp. 836-849. [Paper]		[Slides]	[Stern-CR]	Ryan
			kvm: the Linux Virtual Machine Monitor. A. Kivity, Y. Kamay, D. Laor, U. Lublin, A. Liguor. Proc. 2007 Ottawa Linux Symposium (OLS 2007), Ottawa, Canada, June 27-30, 2007, pp. 225-230. [Paper]
			Virtualization of Linux servers. F. Camargos, G. Girard, B. Ligneris. Proc. 2008 Linux Syposium, Ottawa, Ontario, Canada, July 23-26, 2008, pp. 63-76. [Paper]

	Replication
14	12/3 & 12/5	Understanding Replication in Databases and Distributed Systems. Fernando Pedone, Matthias Wiesmann, André Schiper, Bettina Kemme, Gustavo Alonso. International Conference on Distributed Computing Systems - ICDCS , pp. 464-474, 2000. [Paper]		[Slides]	[Rabiet-CR]	Louis
			Concurrency problems with replication in DFS and DDB - Jim Gray, Pat Helland, Patrick O'Neil, and Dennis Shasha. 1996. The dangers of replication and a solution. SIGMOD Rec. 25, 2 (June 1996), 173-182. [Paper]
			Jeong-Hyon Hwang, Magdalena Balazinska, Alex Rasin, Ugur Çetintemel, Michael Stonebraker, Stanley B. Zdonik: High-Availability Algorithms for Distributed Stream Processing. ICDE 2005: 779-790. [Paper]


15	12/10 & 12/12	Measuring Pay-per-Install: The Commoditization of Malware Distribution by Juan Caballero et al [Paper]
16	12/13	Student project/term-paper presentations

CS655: Advanced Topics in Distributed Systems [Fall 2013]

Schedule

Application Development

Process Migration

Data Storage Systems

Virtualization

Replication