References - 5Dorn, Christoph, and Richard N. Taylor. "Co-adapting Human Collaborations and SoftwareArchitectures." In Proceedings of <strong>the</strong> 2012 International Conference on SoftwareEngineering, pp. 1277-1280. IEEE Press, 2012.Drachova, S., J. O. Hallstrom, J. Hollingsworth, D. P. Jacobs, J. Krone, and M. Sitaraman."A Systematic Approach to Teaching Abstraction and Ma<strong>the</strong>matical Modeling." (2011).Dustdar, Schahram, Christoph Dorn, Fei Li, Luciano Baresi, Giacomo Cabri, CesarePautasso, and Franco Zambonelli. "A roadmap Towards Sustainable Self-awareService <strong>Systems</strong>." In Proceedings of <strong>the</strong> 2010 <strong>ICSE</strong> Workshop on SoftwareEngineering for Adaptive and Self-Managing <strong>Systems</strong>, pp. 10-19. ACM, 2010.Facelli, Julio C. "An Agenda for <strong>Ultra</strong>-<strong>Large</strong>-<strong>Scale</strong> System Research for Global HealthInformatics." ACM SIGHIT Record 2, no. 1 (2012): 12-12.Faleiro, Jose, Sriram Rajamani, Kaushik Rajan, G. Ramalingam, and Kapil Vaswani."C<strong>Scale</strong>–A Programming Model for Scalable and Reliable Distributed Applications." In<strong>Large</strong>-<strong>Scale</strong> Complex IT <strong>Systems</strong>. Development, Operation and Management, pp.148-156. Springer Berlin Heidelberg, 2012.Felfernig, Alexander, Monika Schubert, Monika Mandl, Francesco Ricci, and Walid Maalej."Recommendation and Decision Technologies for Requirements Engineering." InProceedings of <strong>the</strong> 2nd International Workshop on Recommendation <strong>Systems</strong> forSoftware Engineering, pp. 11-15. ACM, 2010.Does <strong>Scale</strong> Really Matter?: ULS <strong>Systems</strong> <strong>Seven</strong> <strong>Years</strong> LaterLinda Northrop: May 24, <strong>2013</strong>© <strong>2013</strong> Carnegie Mellon University90
References - 6Froihofer, Lorenz, Gerhard Glos, Johannes Osrael, and Karl M. Goeschka. "Overview andEvaluation of Constraint Validation Approaches in Java." In Proceedings of <strong>the</strong> 29thInternational Conference on Software Engineering, pp. 313-322. IEEE ComputerSociety, 2007.Gabriel, Richard P., and Ron Goldman. "Conscientious Software." In ACM SIGPLANNotices, vol. 41, no. 10, pp. 433-450. ACM, 2006.Gershenson, Carlos, and Nelson Fernández. "Complexity and information: Measuringemergence, self‐organization, and homeostasis at multiple scales." Complexity 18, no.2 (2012): 29-44.Goth, Greg. "<strong>Ultra</strong>large <strong>Systems</strong>: Redefining Software Engineering?." IEEE Software 25,no. 3 (2008): 91-94.Greenwood, Phil, Alessandro Garcia, Yuanfang Cai, Claudio Sant'Anna, Kevin Sullivan,Thomas Cottenier, and James Noble. "3rd Workshop on Assessment of ContemporaryModularization Techniques (ACoM 2009)." In Proceedings of <strong>the</strong> 24th ACM SIGPLANConference Companion on Object Oriented Programming <strong>Systems</strong> Languages andApplications, pp. 715-716. ACM, 2009.Does <strong>Scale</strong> Really Matter?: ULS <strong>Systems</strong> <strong>Seven</strong> <strong>Years</strong> LaterLinda Northrop: May 24, <strong>2013</strong>© <strong>2013</strong> Carnegie Mellon University91
- Page 2 and 3:
Software Engineering Institute (SEI
- Page 4 and 5:
Ultra-Large-Scale (ULS)SystemsDoes
- Page 6 and 7:
Beginning of theULS System JourneyD
- Page 8 and 9:
Societal ProblemsClimate change and
- Page 10 and 11:
Trend Toward Increasing Scale-1•
- Page 12 and 13:
Increasing Scale In Military System
- Page 14 and 15:
Expert PanelGregory AbowdGeorgia In
- Page 16 and 17:
Inspiration: Open Source and Cooper
- Page 18 and 19:
ULS Systems Research Study Reportht
- Page 20 and 21:
What Is an Ultra-Large-Scale (ULS)
- Page 22 and 23:
Approaches to Software DevelopmentT
- Page 24 and 25:
Analogies are UsefulDoes Scale Real
- Page 26 and 27:
Think EcosystemDiverse users with c
- Page 28 and 29:
ChallengesULS systems will present
- Page 30 and 31:
What We LearnedThere is an unstoppa
- Page 32 and 33:
Early Post-Study Observations• We
- Page 34 and 35:
Since ThenDemonstrators in Cairo's
- Page 36 and 37:
Software is Ubiquitous and Often Tr
- Page 38 and 39:
More Fuel for ScaleDoes Scale Reall
- Page 40 and 41: The “Crowd”DARPA BAA 11-64: Soc
- Page 42 and 43: Some ULS Systems Buzz~21,266 downlo
- Page 44: Upon ReflectionSTE(Social-Technical
- Page 47 and 48: Selected Experiences withSystems at
- Page 49 and 50: Smart Grid - A ULS SystemDiagrams c
- Page 51 and 52: Broader ULS System ImpactThe expans
- Page 53 and 54: XSEDE’s innovative, open standard
- Page 55 and 56: Healthcare AnalyticsProblem: Define
- Page 57 and 58: Adding AnalyticsBusiness andMission
- Page 59 and 60: Best in Class Healthcare AnalyticsO
- Page 61 and 62: Sample Published WorkContextual Des
- Page 63 and 64: Selected SEI ResearchTargeted at UL
- Page 65 and 66: Architecture in ULS System ContextU
- Page 67 and 68: SEI and Broader Carnegie Mellon Col
- Page 69 and 70: So, Where Are We?The report has bee
- Page 71 and 72: Opportunities and ThreatsOpportunit
- Page 73 and 74: Putting Technology to Work: a Few T
- Page 75 and 76: What I SeeMachine LearningMulticore
- Page 77 and 78: Food for Thought• Is our research
- Page 79 and 80: Thanks To The Entire ULS System Stu
- Page 81 and 82: A Special Thank You and TributeDoes
- Page 83 and 84: InteractionDoes Scale Really Matter
- Page 85 and 86: References for Slides 65-66Does Sca
- Page 87 and 88: References - 2Bryant, Barrett R., J
- Page 89: References - 4Clements, Paul, and M
- Page 93 and 94: References - 8Hill, James H., Jules
- Page 95 and 96: References - 10Lucrédio, Daniel, E
- Page 97 and 98: References - 12Salehie, Mazeiar, an
- Page 99 and 100: References - 14Valerdi, Ricardo, El
- Page 101 and 102: References - 16Zhu, Liming, and Yan