Performance Modeling and Benchmarking of Event-Based ... - DVS

More documents

Recommendations

Info

76 CHAPTER 4. PERFORMANCE ENGINEERING OF EVENT-BASED SYSTEMS As a further contribution of this chapter, we introduced a novel terminology for Performance Modeling Patterns, which we used to describe eleven performance modeling patterns for EBS. Our goal is to support modelers in building good performance models of EBS in a structured and efficient way by providing building blocks, which reflect common aspects of EBSs and capture their performance relevant aspects. These performance modeling patterns are the first published patterns using QPNs as modeling paradigm. Furthermore, they are the first patterns targeting EBS applications. Additionally to the modeling methodology and the performance modeling patterns, we present several newly developed extensions for QPNs to improve their flexibility and efficiency. Our extensions are already implemented in the QPME tool or planned for future releases.
Chapter 5 Benchmarking of Event-Based Systems In this chapter we discuss how to benchmark EBS using the example of MOMs and present a methodology for performance evaluation of MOM platforms using the SPECjms2007 standard benchmark. SPECjms2007 is the first industry standard benchmark for message-oriented middleware and was developed by SPEC member organizations under the lead of TU Darmstadt. The main contributions of SPECjms2007 are a comprehensive and standardized workload describing use cases of a real world application and a flexible benchmark framework. The workload itself is not specific to MOMs and can easily be adopted for other systems. We show by means of the example of the jms2009-PS benchmark we show how the workload can be adopted for pub/sub-based platforms. In two comprehensive case studies we show how both benchmarks, SPECjms2007 and jms2009-PS, can be applied to analyze specific features of the underlying middleware. 5.1 SPECjms2007 - A Standard Benchmark SPECjms2007 is the first industry standard benchmark for MOM servers based on the Java Message Service standard interface. It was developed by the Java subcommittee of the Standard Performance Evaluation Corporation with the participation of TU Darmstadt, IBM, Sun, BEA, Sybase, Apache, Oracle and JBoss [130, 198, 200]. One of the major benefits of SPECjms2007 is that, in addition to providing a standard workload and metrics for MOM performance, the benchmark provides a flexible and robust framework for in-depth performance evaluation of messaging infrastructures [202, 201]. It allows us to create custom workload scenarios and interactions to stress selected aspects of the MOM infrastructure. Several officially reviewed results for different MOM products were published by SPEC [215]. In this section we discuss the requirements and provide an in-depth analysis of the workload. We describe the workload interactions, the way they are interrelated and how they can be customized. In a detailed case study we present how to apply this knowledge and evaluate different performance aspects of a MOM using SPECjms2007. 5.1.1 Workload Requirements and Goals of the SPECjms2007 Benchmark In order to guarantee that applications meet their QoS requirements, it is essential that the platforms on which they are built are tested using benchmarks to measure and validate their performance and scalability. Benchmarks not only help to compare alternative platforms and 77
Page 1:
Performance Modeling and Benchmarki
Page 4 and 5:
priorities. Finally, we validated o
Page 6 and 7:
4.3.4 Tool Extension . . . . . . .
Page 8 and 9:
5.7 Proportions of the Interactions
Page 11 and 12:
List of Acronyms Acronym λ t,k j A
Page 13 and 14:
Acronym SPEC-OSG SPE SPN SQL ST SUT
Page 15 and 16:
Chapter 1 Introduction 1.1 Motivati
Page 17 and 18:
PC Server 310 PC Server 310 PC Serv
Page 19 and 20:
1.3. APPROACH AND CONTRIBUTIONS OF
Page 21 and 22:
1.4. THESIS ORGANIZATION 7 • Stan
Page 23 and 24:
Chapter 2 Background In this chapte
Page 25 and 26:
2.1. EVENT-BASED SYSTEMS 11 is gene
Page 27 and 28:
2.2. TECHNOLOGY PLATFORMS OF EVENT-
Page 29 and 30:
Page 31 and 32:
Page 33 and 34:
Page 35 and 36:
2.3. INTRODUCTION TO QUEUEING PETRI
Page 37 and 38:
2.3. INTRODUCTION TO QUEUEING PETRI
Page 39 and 40: Chapter 3 Related Work In this chap
Page 41 and 42: 3.2. BENCHMARKING OF EVENT-BASED SY
Page 43 and 44: 3.2. BENCHMARKING OF EVENT-BASED SY
Page 45 and 46: 3.4. CONCLUDING REMARKS 31 hierarch
Page 47 and 48: Chapter 4 Performance Engineering o
Page 49 and 50: 4.1. MODELING METHODOLOGY FOR EBS 3
Page 57 and 58: 4.2. PERFORMANCE MODELING PATTERN 4
Page 87 and 88: 4.3. EXTENSIONS OF QPNS 73 ,-).$%&'
Page 89: 4.4. CONCLUDING REMARKS 75 Without
Page 93 and 94: 5.1. SPECJMS2007 - A STANDARD BENCH
Page 115 and 116: 5.2. CASE STUDY I: SPECJMS2007 101
Page 125 and 126: 5.3. JMS2009-PS - A PUBLISH /SUBSCR
Page 127 and 128: 5.3. JMS2009-PS - A PUBLISH /SUBSCR
Page 129 and 130: 5.4. CASE STUDY II: JMS2009-PS 115
Page 131 and 132: 5.4. CASE STUDY II: JMS2009-PS 117
Page 133 and 134: Chapter 6 Performance Modeling of E
Page 135 and 136: 6.2. MODELING SPECJMS2007 121 Scena
Page 137 and 138: 6.2. MODELING SPECJMS2007 123 BASE*
Page 139 and 140: 6.2. MODELING SPECJMS2007 125 1‘O
Page 141 and 142:
6.2. MODELING SPECJMS2007 127 Sc. 1
Page 143 and 144:
6.2. MODELING SPECJMS2007 129 Perce
Page 145 and 146:
6.2. MODELING SPECJMS2007 131 Serve
Page 147 and 148:
6.3. CONCLUDING REMARKS 133 the mod
Page 149 and 150:
Chapter 7 Conclusions and Outlook W
Page 151 and 152:
7.1. ONGOING AND FUTURE WORK 137 JA
Page 153 and 154:
7.1. ONGOING AND FUTURE WORK 139 th
Page 155 and 156:
Bibliography [1] J. Abbott, K. B. M
Page 157 and 158:
BIBLIOGRAPHY 143 [29] BiCEP Researc
Page 159 and 160:
BIBLIOGRAPHY 145 [61] G. Cugola and
Page 161 and 162:
BIBLIOGRAPHY 147 [92] R. Henjes, M.
Page 163 and 164:
BIBLIOGRAPHY 149 [128] S. Kounev an
Page 165 and 166:
BIBLIOGRAPHY 151 [162] Object Compu
Page 167 and 168:
BIBLIOGRAPHY 153 [197] K. Sachs, S.
Page 169 and 170:
BIBLIOGRAPHY 155 [228] P. Tran, P.
Page 171:
Erklärung Hiermit erkläre ich, di
show all

Performance Modeling and Benchmarking of Event-Based ... - DVS

Create successful ePaper yourself

Delete template?

Save as template?