Grid Computing Cluster – the Development and ... - Lim Lian Tze

Grid@USMFigure 1: Grid monitoring benefits(RCP) application that gives the flexibilityin deploying the end solutioninto various/any grid environmentsregardless of the grid architecture orthe operating system. The RCP providesthe power of plugins that canextend the system functionality easilyand quickly without refactoringthe whole core component from thescratch. Moreover, these plugins alsoprovide extension points for other pluginsto be integrated or add/enhanceany existing service (plugin) such asinterfacing to Ganglia and any othermonitoring tools.ARCHITECTUREiNet-Grid is one of the core modulesof iNet-Enterprise Suite and plays arole as the centralized grid monitoringmodule that retrieves and managesall the nodes information withina cluster send by a grid monitoringagent. Only one grid agent needsto be installed in a Linux-based machinewithin a cluster equipped withany grid monitoring solution such asGanglia. This monitoring agent willlook into Ganglia database, retrievethe data and send it to the centralmonitoring Server a specific definedtime interval (15 seconds by default).Figure 2 best visualizes the iNet-Grid’sarchitecture followed by its monitoringagent architecture in Figure 3.Furthermore, iNet-Grid consists ofthree components: grid agent, griddata manager and grid data viewer.A grid agent is installed in one machinefor each cluster. It collects andprocesses data loaded from the Gangliadatabase and sends it to griddata manager which resides in iNet-Server. Figure 4 portrays iNet-Grid’sfunctional architecture.The monitoring information consistsof the number of all incoming/outgoingpackets, CPU speed,CPU number, CPU usage load andhard disk used/free size. On theother hand, the network monitoringinformation consists of; bandwidthutilization, viruses/worms infectingor propagating within the network,the applications that are consumingbandwidth, traffic analyzers, etc. Thevalues are read from Ganglia databasewhich kept in round robin database(RRD) format files in the location /usr/share/ganglia/rrdtool/file/libs. Belowis the list of the files:• boottime.rrd • bytes_out.rrd• cpu_idle.rrd • cpu_num.rrd• cpu_system.rrd • cpu_wio.rrd• disk_total.rrd • load_five.rrd• mem_buffers.rrd • mem_free.rrd• mem_total.rrd • pkts_in.rrd• proc_run.rrd • swap_free.rrd• bytes_in.rrd • cpu_aidle.rrd• cpu_nice.rrd • cpu_speed.rrd• cpu_user.rrd • disk_free.rrd• load_fifteen.rrd • load_one.rrd• mem_cached.rrd • mem_shared.rrd• part_max_used.rrd • pkts_out.rrd• proc_total.rrd • swap_total.rrdCONNECTIONFUNCTIONALITYThe grid monitoring agent sends a requestto the central monitoring server.The central monitoring server thenchecks/verifies whether the requestis a valid request or not (the monitoringagent will verify his identity usinga unique ID that is pre-defined in thedatabase), if it is valid, the server willgive the authorization to the monitoringagent and allows him to sendthe data so it can be used for realtimeor historical monitoring information.When the data reaches tothe server, it will be stored into thedatabase. “Grid” table is where thedata is stored (Table 1 shows the tabledata dictionary).iNet-Console (which acts as aviewer) will send a grid data requestto the central monitoring server requestingfor grid monitoring information.Finally, the received grid informationwill be displayed to the viewer.The format of the data sent to theclient is as shown in Figure 5.RESULTSThe implementation of iNet-Grid prototypehas been done. We tested itwith 5 clusters and 90 nodes in total.From our evaluation we can concludethe effectiveness of the system. Thescreenshots taken during the prototypeare shown in Figure 6.EFFICIENT GRIDMONITORINGGrid monitoring is considered efficientif it is a combination of networkand grid monitoring, the networkmonitoring in term of bandwidth,anomaly, security, user misusage/misdealingwith the networkresources which obviously will resultin slow network, thus, minimizingthe grid productivity specially if it requirescommunication between differentparties over the network. On theother hand, grid monitoring will ensurethat the Grid resources are usedand managed wisely and efficiently36 INET-GRID