Crash Course in Open Source Cloud Computing - Mil-OSS
Crash Course in Open Source Cloud Computing - Mil-OSS
Crash Course in Open Source Cloud Computing - Mil-OSS
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Crash</strong> <strong>Course</strong> <strong>in</strong> <strong>Open</strong><strong>Source</strong> <strong>Cloud</strong> Comput<strong>in</strong>gDavid Nalley<strong>Cloud</strong>Stack Community ManagerTwitter/identi.ca: @ke4qqqEmail: david.nalley@cloudstack.org
Agenda1. Introduction2. Quick <strong>Cloud</strong> Comput<strong>in</strong>g Overview3. <strong>Open</strong> <strong>Source</strong> Build<strong>in</strong>g Blocks for <strong>Cloud</strong> Comput<strong>in</strong>g4. <strong>Open</strong> <strong>Source</strong> Tools for <strong>Cloud</strong> Management5. Questions
%whoami• <strong>Cloud</strong>stack Community Manager•Jo<strong>in</strong>ed Citrix via <strong>Cloud</strong>.com acquisition July 2011• Recover<strong>in</strong>g Sysadm<strong>in</strong>• Fedora Project Contributor <strong>in</strong>clud<strong>in</strong>g:●Packag<strong>in</strong>g●Serv<strong>in</strong>g on the Fedora Project Board●Writ<strong>in</strong>g Documentation• Contributor to a number of other projects:●Zenoss●<strong>Open</strong>Groupware●Sahana●Cobbler•Sometimes Author and Blogger at<strong>Open</strong><strong>Source</strong>.com/L<strong>in</strong>ux Pro Magaz<strong>in</strong>e
Quick <strong>Cloud</strong> Comput<strong>in</strong>g Overview:Or the Obligatory“What is the <strong>Cloud</strong>?” Slides
Some th<strong>in</strong>gs 'the cloud' is not:• Magical• A solution to all your problems• A Pony Farm (http://www.flickr.com/photos/edenpictures/4914241241/<strong>in</strong>/photostream/ CC-BY photo)
Five Characteristics of <strong>Cloud</strong>s1. On-Demand Self-Service2. Broad Network Access3. Resource Pool<strong>in</strong>g4. Rapid Elasticity5. Measured Service
<strong>Cloud</strong> Comput<strong>in</strong>g Service ModelsUSER CLOUD a.k.a. SOFTWARE AS A SERVICESaaSS<strong>in</strong>gle application, multi-tenancy, network-based, one-to-many delivery ofapplications, all users have same access to features.Examples: Salesforce.com, Google Docs, Picasa, SugarCRMDEVELOPMENT CLOUD a.k.a. PLATFORM-AS-A-SERVICEPaaSApplication developer model, Application deployed to an elastic servicethat autoscales, low adm<strong>in</strong>istrative overhead. No concept of virtualmach<strong>in</strong>es or operat<strong>in</strong>g system. Code it and deploy it.Examples: Google AppEng<strong>in</strong>e, W<strong>in</strong>dows Azure, Rackspace Site, Red HatMakara/<strong>Open</strong>Shift, <strong>Cloud</strong>FoundrySYSTEMS CLOUD a.k.a INFRASTRUCTURE-AS-A-SERVICEIaaSServers and storage are made available <strong>in</strong> a scalable way over a network.Examples: EC2,Rackspace <strong>Cloud</strong>Files, <strong>Open</strong>Stack, <strong>Cloud</strong>Stack,Eucalyptus, Ubuntu Enterprise <strong>Cloud</strong>, <strong>Open</strong>Nebula
Deployment ModelsPublic, Private & Hybrid <strong>Cloud</strong>s
<strong>Cloud</strong> Still RequiresArchitectural Design<strong>Cloud</strong> Comput<strong>in</strong>g isn’t a magical solutionDesign your architecture with the end <strong>in</strong> m<strong>in</strong>dMake your <strong>in</strong>frastructure easily replicable
Build<strong>in</strong>g Compute <strong>Cloud</strong>swith <strong>Open</strong> <strong>Source</strong> Software
Why <strong>Open</strong> <strong>Source</strong>?User-Driven Solutions to Real ProblemsLower barrier to participationLarger user base, users help<strong>in</strong>g usersAggressive release cycles stay current with the state-ofthe-art<strong>Open</strong> data, <strong>Open</strong> standards, <strong>Open</strong> APIsAvoids vendor lock-<strong>in</strong>
<strong>Open</strong> <strong>Cloud</strong> Initiative (OCI)Pr<strong>in</strong>ciples of <strong>Open</strong> <strong>Cloud</strong>Interoperability (the ability to exchange and use <strong>in</strong>formation) between cloudcomput<strong>in</strong>g products and services is required for unfettered competitionbetween vendors and unrestricted choice for users.Users must be able to come (no barriers to entry) and go (no barriers toexit) regardless of who they are (no discrim<strong>in</strong>ation) and what systems theyuse (technological neutrality).Support<strong>in</strong>g vendors must therefore cooperate on standards, implement<strong>in</strong>gthose that exist (where applicable) and collaborat<strong>in</strong>g via an open process todevelop those that don't, with a view to compet<strong>in</strong>g fairly on quality.h t t p : / / w w w . o p e n c l o u d i n i t i a t i v e . o r g
<strong>Open</strong> Virtual Mach<strong>in</strong>e Formats<strong>Open</strong> Virtualization Format (OVF) is an openstandard for packag<strong>in</strong>g and distribut<strong>in</strong>g virtualappliances or more generally software to be run <strong>in</strong>virtual mach<strong>in</strong>es.Formats for hypervisors/cloudtechnologies:•Amazon - AMI•KVM – QCOW2•VMware – VMDK•Xen – IMG
Sourc<strong>in</strong>g <strong>OSS</strong>VMs and <strong>Cloud</strong> Appliances
<strong>Open</strong> <strong>Source</strong> Hypervisors<strong>Open</strong> <strong>Source</strong>Xen, Xen <strong>Cloud</strong> Platform (XCP)KVM – Kernel-based VirtualizationVirtualBox* - Oracle supported Virtualization Solutions<strong>Open</strong>VZ* - Conta<strong>in</strong>er-based, Similar to Solaris Conta<strong>in</strong>ers or BSDZonesLXC – User Space chrooted <strong>in</strong>stallsProprietaryVMwareCitrix XenserverMicrosoft Hyper-VOracleVM (Based on OS Xen)
<strong>Open</strong> <strong>Source</strong> Compute <strong>Cloud</strong>sYear Started License HypervisorsSupported2008 GPL Xenserver, XCP,KVM, Vmware, OVM,Hyper-V2006 GPL Xen, KVM, VMware2010(DevelopedbyNASA byAnso Labspreviously)ApacheVMware ESX andESXi, MicrosoftHyper-V, Xen, KVMand Virtual Box andmoreOther open source compute software <strong>in</strong>clude Abiquo, Red Hat’s <strong>Cloud</strong>Forms (Aeolus) and<strong>Open</strong>NebulaNumerous companies are build<strong>in</strong>g cloud software on <strong>Open</strong>Stack <strong>in</strong>clud<strong>in</strong>g Nebula, Piston Inc.
<strong>Open</strong> <strong>Source</strong>Platform-as-a-ServiceYear Started Sponsors Platforms Supported2011 VMware Spr<strong>in</strong>g, Rails,Node.js2011 Joyent Node.js2011 Red Hat Express – Ruby, PhpandPythonFlex – JBoss, JavaEE62010 WSO2 JBoss, Java EE6
<strong>Open</strong> <strong>Source</strong><strong>Cloud</strong> Comput<strong>in</strong>g StorageGlusterFS – Scale Out NAS system aggregat<strong>in</strong>g storageover Ethernet or Inf<strong>in</strong>ibandCeph – Distributed file storage system developed byDreamHost<strong>Open</strong>Stack Object Storage (Swift) – Long-term storageobject storage systemSheepdog – Distributed storage for KVM hypervisorsNFS – Old standby, tried and true, not designed for cloudscale or performance, but NFS 4.1 with pNFS might maketh<strong>in</strong>gs <strong>in</strong>terest<strong>in</strong>g.
<strong>Cloud</strong> APIs Aren’t Created Equal<strong>Open</strong> <strong>Source</strong> Abstractionsjcloudslibclouddeltacloudfogec2
Manag<strong>in</strong>g <strong>Cloud</strong>s with<strong>Open</strong> <strong>Source</strong> Tools
Automation Unlocksthe Potential of the <strong>Cloud</strong>•Meat<strong>Cloud</strong>, Can’tKeep up with <strong>Cloud</strong>Comput<strong>in</strong>g•Devops & Agile ITPhilosophy•Script RepetitiveTasks•Automate,Automate, Automate
4 Types of Management ToolsProvision<strong>in</strong>gInstallation of operat<strong>in</strong>g systems and othersoftwareConfiguration ManagementSets the parameters for servers, can specify<strong>in</strong>stallation parametersOrchestration/AutomationAutomate tasks across systemsMonitor<strong>in</strong>gRecords errors and health of IT<strong>in</strong>frastructure
<strong>Open</strong> <strong>Source</strong>Provision<strong>in</strong>g ToolsYear Started Language License InstallationTargetsCobbler 2007 Python GPLv2 Red Hat,<strong>Open</strong>SUSEFedora,Debian,UbuntuBoxGr<strong>in</strong>der 2010 Ruby LGPL Fedora/RHEL/Cent<strong>OSS</strong>pacewalk 2008 Perl, Python,JavaGPLv2Fedora,Centos, RHELCrowbar 2011 Ruby Apache (Bare metalprovision<strong>in</strong>g)
<strong>Open</strong> <strong>Source</strong>Configuration Management ToolsYear StartedLanguageLicenseCfeng<strong>in</strong>e 1993 C Apache YesClient/ServerChef 2009 Ruby Apache Chef Solo –NoChef Server -YesPuppet 2004 Ruby Apache yes
<strong>Open</strong> <strong>Source</strong>Monitor<strong>in</strong>g ToolsLicenseType ofMonitor<strong>in</strong>gCollectionMethodsCacti / RRDTool GPL Performance SNMP, syslogNagios GPL Availability SNMP,TCP,ICMP, IPMI,syslogZabbix GPL Availability/Performance andmoreZenoss GPL Availability,Performance,EventManagementSNMP,TCP/ICMP, IPMI,SyntheticTransactionsSNMP, ICMP,SSH, syslog,WMI
<strong>Open</strong> <strong>Source</strong>Automation/Orchestration ToolsYearStartedLanguage License Client/ServerSupportOrganizationCapistrano 2006 Ruby MIT Yes NoneRunDeck 2010 Java Apache Yes DTOSolutionsFunc 2007 Python GPL Yes FedoraProjectMCollective 2009 Ruby Apache Yes PuppetLabs
Conceptual AutomatedToolcha<strong>in</strong>BootStrappedImage<strong>Cloud</strong>Stack<strong>Open</strong>StackEucalyptusProvisionCobblerKickstartConfigurationPuppetChefMonitor<strong>in</strong>gNagiosZenossCactiStart/StopServicesRunDeckCapistranoMCollective
Questions?Slides Can be Viewed and Downloaded at:http://ke4qqq.fedorapeople.org/miloss.odphttp://ke4qqq.fedorapeople.org/miloss.pdf
Contact Medavid.nalley@cloudstack.orgProfessional: 864.990.1252Professional:http://www.cloudstack.orgPersonal:http://ke4qqq.wordpress.comTwitter/identi.ca: @ke4qqq
<strong>Crash</strong> <strong>Course</strong> <strong>in</strong> <strong>Open</strong> <strong>Source</strong> <strong>Cloud</strong> Comput<strong>in</strong>gby Mark R. H<strong>in</strong>kle & David Nalley is licensed under aCreative Commons Attribution-ShareAlike 3.0 United States License.
Change language