JavaGAT Adaptor for UNICORE 6 - Development and Evaluation in ...
JavaGAT Adaptor for UNICORE 6 - Development and Evaluation in ...
JavaGAT Adaptor for UNICORE 6 - Development and Evaluation in ...
You also want an ePaper? Increase the reach of your titles
YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.
<strong>JavaGAT</strong> <strong>Adaptor</strong> <strong>for</strong> <strong>UNICORE</strong> 6<strong>Development</strong> <strong>and</strong> <strong>Evaluation</strong><strong>in</strong> the Project AeroGridTobias Schlauch, German Aerospace Center<strong>UNICORE</strong> Summit 2009, August 25th, 2009, Delft, The Netherl<strong>and</strong>sFolie 1<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Outl<strong>in</strong>eThe AeroGrid ProjectData Management System DataF<strong>in</strong>derIntegration of <strong>JavaGAT</strong> <strong>in</strong>to DataF<strong>in</strong>derSummaryFolie 2<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
AeroGridProject DataGrid-based cooperation between <strong>in</strong>dustry,research centres, <strong>and</strong> universities <strong>in</strong>aerospace eng<strong>in</strong>eer<strong>in</strong>gRuntime: April 1, 2007 – March 30, 2010Website: http://www.aero-grid.deFolie 3<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
AeroGridProject PartnerGerman Aerospace Center (DLR)Institute <strong>for</strong> Propulsion TechnologySimulation <strong>and</strong> Software Technology (Coord.)MTU Aero Eng<strong>in</strong>es GmbHT-Systems Solutions <strong>for</strong> Research GmbHUniversity of the Armed Forces, MunichInstitute <strong>for</strong> Jet PropulsionFolie 4<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Background: Turbo Mach<strong>in</strong>erySimulation TasksSimulation of turb<strong>in</strong>e componentsDesign (variants)OptimizationAero elasticityAero acousticsCool<strong>in</strong>gComplex geometriesMultistage componentsUse of the CFD-Code TRACE(Institute of Propulsion Technology)1.0Stator 5RechnungMessung1.00.80.6Stator 7RechnungMessung1.00.80.60.40.2Stator 14RechnungMessung0.80.60.40.20.0Totaldruck0.40.0Totaldruck0.20.0TotaldruckFolie 5<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
DataF<strong>in</strong>derOverviewDataF<strong>in</strong>derEfficient management of scientific <strong>and</strong> technical dataFocus on huge data sets<strong>Development</strong> of the DataF<strong>in</strong>der by DLRAvailable as Open Source SoftwarePrimary functionalityStructur<strong>in</strong>g of data through assignment of meta <strong>in</strong><strong>for</strong>mation <strong>and</strong> selfdef<strong>in</strong>eddata modelsComplex search mechanism to f<strong>in</strong>d dataFlexible usage of heterogeneous storage resourcesIntegration <strong>in</strong> the work<strong>in</strong>g environmentFolie 6<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
DataF<strong>in</strong>derBasic ConceptsClient-Server solutionBased on open <strong>and</strong> stable st<strong>and</strong>ards, such as XML <strong>and</strong> WebDAVExtensive use of st<strong>and</strong>ard software components (open source /commercial), limited own development at client sideFolie 7<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
DataF<strong>in</strong>der ClientGraphical User InterfacesUser ClientAdm<strong>in</strong>istrator ClientImplementation <strong>in</strong> Python with Qt/PyQtFolie 8<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
DataF<strong>in</strong>der ConfigurationData Model <strong>and</strong> Data StoresLogical view to dataDef<strong>in</strong>ition of data structur<strong>in</strong>g <strong>and</strong> metadata(“data model”)Separated storage of data structure / metadata<strong>and</strong> actual data filesFlexible use of (distributed) storage resourcesFile system, WebDAV, FTP, GridFTPAmazon S3 (Simple Storage Service)Tivoli Storage Manager (TSM)Storage Resource Broker (SRB)Complex search mechanism to f<strong>in</strong>d dataFolie 9<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
DataF<strong>in</strong>der Data ModelMapp<strong>in</strong>g of Organizational Data StructuresRelationProject AProject MegaCodeUserKeyUltraEddieValueObject(collection)Simulation IProject MegaCodeUserKeyUltraEddieValueSimulation IIProject MegaCodeUserKeyUltraEddieValueObject(file)File 1File 2Project MegaCode UltraUser EddieKey ValueProject MegaCode UltraUser EddieKey ValueUserProject MegaCode UltraUser EddieKey ValueProject BProject MegaCode UltraUser EddieKey ValueExperimentProject MegaCode UltraUser EddieKey ValueProject CProject MegaCode UltraUser EddieKey ValueAttributes(metadata)Folie 10<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Grid Application Toolkit (GAT)Provides a simple API to several grid applicationsDeveloped dur<strong>in</strong>g the Gridlab projectma<strong>in</strong>ly developed at Max-Plank-Institute <strong>for</strong> Gravitational Physics(Albert E<strong>in</strong>ste<strong>in</strong> Institute),at the Center <strong>for</strong> Computation <strong>and</strong> Technology at theLouisiana State University, <strong>and</strong>at VU AmsterdamImplementationC versionC++ wrapperPython wrapperJava versionFolie 11<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
<strong>JavaGAT</strong> ArchitectureFolie 12<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
<strong>UNICORE</strong> <strong>JavaGAT</strong> <strong>Adaptor</strong>Developed at the Max-Plank-Institute <strong>for</strong> Gravitational PhysicsBased on HiLAHiLA (High-Level API) supports the access to <strong>UNICORE</strong> 5 <strong>and</strong><strong>UNICORE</strong> 6 via an easy <strong>and</strong> unique API.It is not necessary to <strong>in</strong>stall components of <strong>UNICORE</strong> 5 or<strong>UNICORE</strong> 6 on the submitt<strong>in</strong>g (client) host.Implemented functionalities:Pre <strong>and</strong> post stag<strong>in</strong>gJob submissionOffl<strong>in</strong>e monitor<strong>in</strong>gFolie 13<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Integration of <strong>JavaGAT</strong> <strong>in</strong>to DataF<strong>in</strong>derJob Management SystemFolie 14<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Integration of <strong>JavaGAT</strong> <strong>in</strong>to DataF<strong>in</strong>derAccess<strong>in</strong>g <strong>JavaGAT</strong> libraries from PythonFolie 15<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Integration of <strong>JavaGAT</strong> <strong>in</strong>to DataF<strong>in</strong>derJPypeWhat is JPype?JNI-based wrapperCommunication through <strong>in</strong>terfac<strong>in</strong>g at the native level <strong>in</strong> bothVirtual Mach<strong>in</strong>esFull access to java class librariesProject Website:http://jpype.source<strong>for</strong>ge.net/Folie 16<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
DataF<strong>in</strong>der <strong>in</strong> AeroGridTurb<strong>in</strong>e SimulationFolie 17<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Turb<strong>in</strong>e Simulation: Graphical User InterfaceFolie 18<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Turb<strong>in</strong>e SimulationUsage of External Applications1. CGNS Infos / ADFview / CGNS Plot2. TRACE GUI3. Gnuplot123Integration withAeroGrid tools!Folie 19<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
SummaryGrid Application Toolkit (GAT) is used by applicationsto access grid services <strong>in</strong>dependently of grid middleware.GAT is be<strong>in</strong>g st<strong>and</strong>ardized with<strong>in</strong> Open Grid Forum (OGF). St<strong>and</strong>ardis called SAGA (Simple API <strong>for</strong> Grid Applications).<strong>UNICORE</strong> adaptor <strong>for</strong> <strong>JavaGAT</strong> allows access of <strong>UNICORE</strong> 5 <strong>and</strong><strong>UNICORE</strong> 6 resources.DataF<strong>in</strong>der has been extended to use GAT-API calls <strong>for</strong> gridoperations.Folie 20<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Thank <strong>for</strong> your attention!!!L<strong>in</strong>ksAeroGrid:<strong>JavaGAT</strong>:DataF<strong>in</strong>der:http://www.aero-grid.de/https://g<strong>for</strong>ge.cs.vu.nl/gf/project/javagat/http://source<strong>for</strong>ge.net/projects/dataf<strong>in</strong>der/ContactEmail: anastasia.eifer@dlr.dealex<strong>and</strong>er.beck-ratzka@aei.mpg.deFolie 21<strong>UNICORE</strong> Summit 2009 > Tobias Schlauch > <strong>JavaGAT</strong> <strong>Adaptor</strong> für <strong>UNICORE</strong> 6 – <strong>Development</strong> und <strong>Evaluation</strong> <strong>in</strong> the Project AeroGrid > 25.08.2009
Change language