Performance Modeling and Benchmarking of Event-Based ... - DVS

More documents

Recommendations

Info

4.3.4 Tool Extension . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75 4.4 Concluding Remarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 75 5 Benchmarking of Event-Based Systems 77 5.1 SPECjms2007 - A Standard Benchmark . . . . . . . . . . . . . . . . . . . . . . . 77 5.1.1 Workload Requirements and Goals of the SPECjms2007 Benchmark . . . 77 5.1.2 Workload Scenario . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80 5.1.3 Modeled Interactions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 81 5.1.4 SPECjms2007 Workload Characterization . . . . . . . . . . . . . . . . . . 85 5.1.5 Benchmark Implementation . . . . . . . . . . . . . . . . . . . . . . . . . . 95 5.2 Case Study I: SPECjms2007 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101 5.2.1 Experimental Setting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101 5.2.2 Horizontal and Vertical Scaling . . . . . . . . . . . . . . . . . . . . . . . . 102 5.2.3 Customized Vertical Workloads . . . . . . . . . . . . . . . . . . . . . . . . 102 5.2.4 Publish/Subscribe Messaging . . . . . . . . . . . . . . . . . . . . . . . . . 104 5.2.5 P2P Messaging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107 5.2.6 Conclusions of the SPECjms2007 Case Study . . . . . . . . . . . . . . . . 110 5.3 jms2009-PS - A Publish /Subscribe Benchmark . . . . . . . . . . . . . . . . . . . 110 5.3.1 Configuration Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . 113 5.4 Case Study II: jms2009-PS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115 5.4.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115 5.4.2 Test Scenarios . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 115 5.4.3 Experimental Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117 5.5 Concluding Remarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 118 6 Performance Modeling of EBS - Case Studies 119 6.1 DEBS Case Study . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 6.1.1 Scenario . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 119 6.1.2 Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120 6.1.3 Experimental Results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 120 6.1.4 Conclusions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121 6.2 Modeling SPECjms2007 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121 6.2.1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121 6.2.2 Modeling SPECjms2007 . . . . . . . . . . . . . . . . . . . . . . . . . . . . 122 6.2.3 Experimental Evaluation . . . . . . . . . . . . . . . . . . . . . . . . . . . 125 6.2.4 Conclusion . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133 6.3 Concluding Remarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 133 7 Conclusions and Outlook 135 7.1 Ongoing and Future Work . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
List of Figures 1.1 A (Distributed) Event-based System . . . . . . . . . . . . . . . . . . . . . . . . . 3 2.1 Event Notification in an EBS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 2.2 Point-to-point messaging. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 2.3 Example for Pub/Sub Messaging. . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 2.4 Subscription Models . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 15 2.5 Subscription Models (cont.) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16 2.6 Router Network of REBECA [155] . . . . . . . . . . . . . . . . . . . . . . . . . . 20 2.7 QPN Notation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 2.8 A QPN Model of a Central Server with Memory Constraints (reprinted from [26]). 24 4.1 Response Time (RT) in Traditional Request / Reply and in EBS . . . . . . . . . 34 4.2 System Topology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35 4.3 High-Level System Model. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 41 4.4 Modeling Non-Poisson Event Publications. . . . . . . . . . . . . . . . . . . . . . . 42 4.5 Firing of Transition ϕ i in Mode µ σ i . . . . . . . . . . . . . . . . . . . . . . . . . . 43 4.6 Modeling Network Connections. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43 4.7 Standard Queue Pattern . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45 4.8 Standard Pub/Sub Pattern - Fixed Number of Subscribers . . . . . . . . . . . . . 46 4.9 Standard Pub/Sub Pattern - Configurable No. of Subscribers . . . . . . . . . . . 48 4.10 Example for Pattern 3 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 49 4.11 Pattern 3 using an Enqueuer for Incoming Events . . . . . . . . . . . . . . . . . . 53 4.12 Time-Controlled Pull Pattern . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 54 4.13 Time-controlled Pull Pattern . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 57 4.14 Standard Pull Patterns . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59 4.15 Modeling a Thread Pool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61 4.16 Pull Pattern - Request controlled II . . . . . . . . . . . . . . . . . . . . . . . . . 63 4.17 Standard Queue Pattern . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66 4.18 Load Balancer - Random . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68 4.19 Load Balancer - Round Robin . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69 4.20 Load Balancer - Pull . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71 4.21 Physical and Logical Layers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73 4.22 Example for Priority of Transitions . . . . . . . . . . . . . . . . . . . . . . . . . . 74 5.1 Overview of the Workload Scenario and its Roles . . . . . . . . . . . . . . . . . . 80 5.2 Interaction 1 - Communication between SM and DC . . . . . . . . . . . . . . . . 82 5.3 Interaction 2 - Communication between SP and DC . . . . . . . . . . . . . . . . 82 5.4 Workflow of the SPECjms2007 Interactions (N)P=(Non-)Persistent; (N)T= (Non-)Transactional . . . . . . . . . . . . . . . . 83 5.5 # Locations for Horiz. Topology . . . . . . . . . . . . . . . . . . . . . . . . . . . 91 5.6 Horiz. Topology Message Mix . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 91 v
Page 1: Performance Modeling and Benchmarki
Page 4 and 5: priorities. Finally, we validated o
Page 8 and 9: 5.7 Proportions of the Interactions
Page 11 and 12: List of Acronyms Acronym λ t,k j A
Page 13 and 14: Acronym SPEC-OSG SPE SPN SQL ST SUT
Page 15 and 16: Chapter 1 Introduction 1.1 Motivati
Page 17 and 18: PC Server 310 PC Server 310 PC Serv
Page 19 and 20: 1.3. APPROACH AND CONTRIBUTIONS OF
Page 21 and 22: 1.4. THESIS ORGANIZATION 7 • Stan
Page 23 and 24: Chapter 2 Background In this chapte
Page 25 and 26: 2.1. EVENT-BASED SYSTEMS 11 is gene
Page 27 and 28: 2.2. TECHNOLOGY PLATFORMS OF EVENT-
Page 35 and 36: 2.3. INTRODUCTION TO QUEUEING PETRI
Page 37 and 38: 2.3. INTRODUCTION TO QUEUEING PETRI
Page 39 and 40: Chapter 3 Related Work In this chap
Page 41 and 42: 3.2. BENCHMARKING OF EVENT-BASED SY
Page 43 and 44: 3.2. BENCHMARKING OF EVENT-BASED SY
Page 45 and 46: 3.4. CONCLUDING REMARKS 31 hierarch
Page 47 and 48: Chapter 4 Performance Engineering o
Page 49 and 50: 4.1. MODELING METHODOLOGY FOR EBS 3
Page 57 and 58:
4.2. PERFORMANCE MODELING PATTERN 4
Page 59 and 60:
Page 61 and 62:
Page 63 and 64:
Page 65 and 66:
Page 67 and 68:
Page 69 and 70:
Page 71 and 72:
Page 73 and 74:
Page 75 and 76:
Page 77 and 78:
Page 79 and 80:
Page 81 and 82:
Page 83 and 84:
Page 85 and 86:
Page 87 and 88:
4.3. EXTENSIONS OF QPNS 73 ,-).$%&'
Page 89 and 90:
4.4. CONCLUDING REMARKS 75 Without
Page 91 and 92:
Chapter 5 Benchmarking of Event-Bas
Page 93 and 94:
5.1. SPECJMS2007 - A STANDARD BENCH
Page 95 and 96:
Page 97 and 98:
Page 99 and 100:
Page 101 and 102:
Page 103 and 104:
Page 105 and 106:
Page 107 and 108:
Page 109 and 110:
Page 111 and 112:
Page 113 and 114:
Page 115 and 116:
5.2. CASE STUDY I: SPECJMS2007 101
Page 117 and 118:
Page 119 and 120:
Page 121 and 122:
Page 123 and 124:
Page 125 and 126:
5.3. JMS2009-PS - A PUBLISH /SUBSCR
Page 127 and 128:
5.3. JMS2009-PS - A PUBLISH /SUBSCR
Page 129 and 130:
5.4. CASE STUDY II: JMS2009-PS 115
Page 131 and 132:
5.4. CASE STUDY II: JMS2009-PS 117
Page 133 and 134:
Chapter 6 Performance Modeling of E
Page 135 and 136:
6.2. MODELING SPECJMS2007 121 Scena
Page 137 and 138:
6.2. MODELING SPECJMS2007 123 BASE*
Page 139 and 140:
6.2. MODELING SPECJMS2007 125 1‘O
Page 141 and 142:
6.2. MODELING SPECJMS2007 127 Sc. 1
Page 143 and 144:
6.2. MODELING SPECJMS2007 129 Perce
Page 145 and 146:
6.2. MODELING SPECJMS2007 131 Serve
Page 147 and 148:
6.3. CONCLUDING REMARKS 133 the mod
Page 149 and 150:
Chapter 7 Conclusions and Outlook W
Page 151 and 152:
7.1. ONGOING AND FUTURE WORK 137 JA
Page 153 and 154:
7.1. ONGOING AND FUTURE WORK 139 th
Page 155 and 156:
Bibliography [1] J. Abbott, K. B. M
Page 157 and 158:
BIBLIOGRAPHY 143 [29] BiCEP Researc
Page 159 and 160:
BIBLIOGRAPHY 145 [61] G. Cugola and
Page 161 and 162:
BIBLIOGRAPHY 147 [92] R. Henjes, M.
Page 163 and 164:
BIBLIOGRAPHY 149 [128] S. Kounev an
Page 165 and 166:
BIBLIOGRAPHY 151 [162] Object Compu
Page 167 and 168:
BIBLIOGRAPHY 153 [197] K. Sachs, S.
Page 169 and 170:
BIBLIOGRAPHY 155 [228] P. Tran, P.
Page 171:
Erklärung Hiermit erkläre ich, di
show all

Performance Modeling and Benchmarking of Event-Based ... - DVS

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?