Performance Modeling and Benchmarking of Event-Based ... - DVS

More documents

Recommendations

Info

118 CHAPTER 5. BENCHMARKING OF EVENT-BASED SYSTEMS 5.5 Concluding Remarks In this chapter, we introduced SPECjms2007, the first industry standard benchmark for MOM, and discussed its goals, the business scenario it models and its internal component architecture. We presented a detailed workload characterization with the goal to help users understand the internal components of the workload and the way they are scaled. We proposed a novel methodology for performance evaluation of MOM platforms using standard benchmarks and discussed how the workload can be customized to exercise and evaluate selected aspects of MOM performance. Our workload analysis not only helps to better understand and interpret official benchmark results, but also provides an example of how to define a scalable workload configuration for evaluating selected performance and scalability aspects of MOM. In addition, we presented a case study of a leading JMS platform, the WebLogic server, conducting an in-depth performance analysis of the platform under a number of different workload and configuration scenarios. Our analysis covered various workload aspects including P2P vs. pub/sub communication, persistent vs. non-persistent messaging, varying message sizes, number of message consumers, number of message producer threads, etc. Finally, we illustrated how to adjust the SPECjms2007 standard workload to target different aspects of pub/sub communication and introduced jms2009-PS, a new benchmark for pub/sub-based messaging systems built on top of the SPECjms2007 standard workload. Overall, jms2009-PS allows the user to adjust the workload in terms of the number of topics, subscriptions, the number and type of selectors, and message delivery modes. In a case study of an open source middleware we analyzed alternative ways of implementing publish/subscribe communication in terms of their overhead, performance and scalability. The case study showed that the flexibility provided by topic-based publish-subscribe communication comes at a high price. The most critical factor affecting the system performance however was the number of topics used for communication. Having a low number of topics provides maximum flexibility, however, it introduces a scalability bottleneck due to the synchronization delays.
Chapter 6 Performance Modeling of EBS - Case Studies In this chapter we present two case studies in which we apply our approach for workload characterization and performance modeling of event-based systems introduced in Chapter 4. In the first case study we use the SIENA [40] publish/subscribe system with a basic workload comprising a single message type. In the second more complex case study we model a realistic state-of-the-art event-driven system on a leading commercial middleware platform including all system layers. A detailed system model is built in a step-by-step fashion and then used to predict the system performance under various workload and configuration scenarios. In both case studies, we show how QPN models can be exploited for performance analysis and capacity planning in the software engineering process. The results demonstrate the effectiveness, practicality and accuracy of the proposed modeling and prediction approach, which provides a powerful tool for ensuring that systems are designed and sized to meet their QoS requirements. Furthermore, we apply our performance modeling patterns (Section 4.2) and make use of QPN extensions (Section 4.3) in the second case study. 6.1 DEBS Case Study 6.1.1 Scenario We consider a scenario in which DEBS is used to manage the interactions among participants in a supermarket supply chain [202]. The participants involved are the supermarket company, its stores, its distribution centers and its suppliers. Since most of the interactions in the supply chain are asynchronous in nature, they can be implemented using DEBS. Some examples of services that can be handled by the system are supermarket order and shipment handling, inventory management in supermarkets and distribution centers, automated tracking of goods as they move through the supply chain and dissemination of new product announcements, price updates, special offers and discount information from the company headquarters to the supermarkets. Here we consider a simplified version of the SPECjms2007 scenario (see Section 5.1), in which the dissemination of requests for quotes are sent when goods in a distribution center are depleted and an order has to be placed to refill stock. A request for quote is published as an event in the system and it is automatically delivered to all suppliers that offer the respective types of goods. It is assumed that suppliers have subscribed to all events belonging to the product groups/categories they sell. 119
Page 1:
Performance Modeling and Benchmarki
Page 4 and 5:
priorities. Finally, we validated o
Page 6 and 7:
4.3.4 Tool Extension . . . . . . .
Page 8 and 9:
5.7 Proportions of the Interactions
Page 11 and 12:
List of Acronyms Acronym λ t,k j A
Page 13 and 14:
Acronym SPEC-OSG SPE SPN SQL ST SUT
Page 15 and 16:
Chapter 1 Introduction 1.1 Motivati
Page 17 and 18:
PC Server 310 PC Server 310 PC Serv
Page 19 and 20:
1.3. APPROACH AND CONTRIBUTIONS OF
Page 21 and 22:
1.4. THESIS ORGANIZATION 7 • Stan
Page 23 and 24:
Chapter 2 Background In this chapte
Page 25 and 26:
2.1. EVENT-BASED SYSTEMS 11 is gene
Page 27 and 28:
2.2. TECHNOLOGY PLATFORMS OF EVENT-
Page 29 and 30:
Page 31 and 32:
Page 33 and 34:
Page 35 and 36:
2.3. INTRODUCTION TO QUEUEING PETRI
Page 37 and 38:
2.3. INTRODUCTION TO QUEUEING PETRI
Page 39 and 40:
Chapter 3 Related Work In this chap
Page 41 and 42:
3.2. BENCHMARKING OF EVENT-BASED SY
Page 43 and 44:
3.2. BENCHMARKING OF EVENT-BASED SY
Page 45 and 46:
3.4. CONCLUDING REMARKS 31 hierarch
Page 47 and 48:
Chapter 4 Performance Engineering o
Page 49 and 50:
4.1. MODELING METHODOLOGY FOR EBS 3
Page 51 and 52:
Page 53 and 54:
Page 55 and 56:
Page 57 and 58:
4.2. PERFORMANCE MODELING PATTERN 4
Page 59 and 60:
Page 61 and 62:
Page 63 and 64:
Page 65 and 66:
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Page 79 and 80:
Page 81 and 82: 4.2. PERFORMANCE MODELING PATTERN 6
Page 87 and 88: 4.3. EXTENSIONS OF QPNS 73 ,-).$%&'
Page 89 and 90: 4.4. CONCLUDING REMARKS 75 Without
Page 91 and 92: Chapter 5 Benchmarking of Event-Bas
Page 93 and 94: 5.1. SPECJMS2007 - A STANDARD BENCH
Page 115 and 116: 5.2. CASE STUDY I: SPECJMS2007 101
Page 125 and 126: 5.3. JMS2009-PS - A PUBLISH /SUBSCR
Page 127 and 128: 5.3. JMS2009-PS - A PUBLISH /SUBSCR
Page 129 and 130: 5.4. CASE STUDY II: JMS2009-PS 115
Page 131: 5.4. CASE STUDY II: JMS2009-PS 117
Page 135 and 136: 6.2. MODELING SPECJMS2007 121 Scena
Page 137 and 138: 6.2. MODELING SPECJMS2007 123 BASE*
Page 139 and 140: 6.2. MODELING SPECJMS2007 125 1‘O
Page 141 and 142: 6.2. MODELING SPECJMS2007 127 Sc. 1
Page 143 and 144: 6.2. MODELING SPECJMS2007 129 Perce
Page 145 and 146: 6.2. MODELING SPECJMS2007 131 Serve
Page 147 and 148: 6.3. CONCLUDING REMARKS 133 the mod
Page 149 and 150: Chapter 7 Conclusions and Outlook W
Page 151 and 152: 7.1. ONGOING AND FUTURE WORK 137 JA
Page 153 and 154: 7.1. ONGOING AND FUTURE WORK 139 th
Page 155 and 156: Bibliography [1] J. Abbott, K. B. M
Page 157 and 158: BIBLIOGRAPHY 143 [29] BiCEP Researc
Page 159 and 160: BIBLIOGRAPHY 145 [61] G. Cugola and
Page 161 and 162: BIBLIOGRAPHY 147 [92] R. Henjes, M.
Page 163 and 164: BIBLIOGRAPHY 149 [128] S. Kounev an
Page 165 and 166: BIBLIOGRAPHY 151 [162] Object Compu
Page 167 and 168: BIBLIOGRAPHY 153 [197] K. Sachs, S.
Page 169 and 170: BIBLIOGRAPHY 155 [228] P. Tran, P.
Page 171: Erklärung Hiermit erkläre ich, di
show all

Performance Modeling and Benchmarking of Event-Based ... - DVS

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?