Cost-Based Optimization of Integration Flows - Datenbanken ...

List of Figures
1.1 Overview of the Structure of this Thesis . . . . . . . . . . . . . . . . . . . . 4
2.1 Classification of Integration Approaches . . . . . . . . . . . . . . . . . . . . 6
2.2 Reference System Architecture for Integration Flows . . . . . . . . . . . . . 8
2.3 Classification of Modeling Approaches for Integration Flows . . . . . . . . . 9
2.4 Integration Flow Modeling with Directed Graphs and Hierarchies of Sequences 10
2.5 Integration Flow Modeling with Directed Graphs . . . . . . . . . . . . . . . 11
2.6 Classification of Execution Approaches for Integration Flows . . . . . . . . 15
2.7 Classification of Adaptive Query Processing . . . . . . . . . . . . . . . . . . 19
2.8 Use Cases of the Example Scenario w.r.t. the Information System Pyramid 27
2.9 Example Horizontal Integration Flows . . . . . . . . . . . . . . . . . . . . . 28
2.10 Example Integration Flow – Plan P 4 . . . . . . . . . . . . . . . . . . . . . . 29
2.11 Example Vertical Integration Flows . . . . . . . . . . . . . . . . . . . . . . . 31
3.1 Extended Reference System Architecture . . . . . . . . . . . . . . . . . . . . 35
3.2 Example Dependency Graph and its Application . . . . . . . . . . . . . . . 38
3.3 General Model of Operator Execution Statistics . . . . . . . . . . . . . . . . 39
3.4 Plan Cost Estimation Example . . . . . . . . . . . . . . . . . . . . . . . . . 44
3.5 Temporal Aspects of the P-PPO . . . . . . . . . . . . . . . . . . . . . . . . 46
3.6 Example Execution Scenario . . . . . . . . . . . . . . . . . . . . . . . . . . . 46
3.7 Example Execution of the Optimization Algorithm . . . . . . . . . . . . . . 50
3.8 Example Critical Path Optimization . . . . . . . . . . . . . . . . . . . . . . 51
3.9 Join Enumeration Example Plans . . . . . . . . . . . . . . . . . . . . . . . . 53
3.10 Heuristic Join Reordering Example . . . . . . . . . . . . . . . . . . . . . . . 54
3.11 Cost-Based Optimization Techniques . . . . . . . . . . . . . . . . . . . . . . 60
3.12 Example Rescheduling Parallel Flows . . . . . . . . . . . . . . . . . . . . . . 61
3.13 Example Rewriting Sequences to Parallel Flows . . . . . . . . . . . . . . . . 63
3.14 Example Merging Parallel Flows . . . . . . . . . . . . . . . . . . . . . . . . 65
3.15 Example Reordering and Merging of Switch Paths . . . . . . . . . . . . . . 67
3.16 Example Control-Flow-Aware Selection Reordering . . . . . . . . . . . . . . 68
3.17 Example Eager Group-By Application . . . . . . . . . . . . . . . . . . . . . 70
3.18 Example Setoperation Type Selection . . . . . . . . . . . . . . . . . . . . . 72
3.19 Example Setoperation Cost Comparison . . . . . . . . . . . . . . . . . . . . 72
3.20 Comparison Scenario Periodical Re-Optimization . . . . . . . . . . . . . . . 75
3.21 Influence of Optimization Interval ∆t . . . . . . . . . . . . . . . . . . . . . . 76
3.22 Use Case Comparison of Periodical Re-Optimization . . . . . . . . . . . . . 77
3.23 Speedup of Rewriting Sequences to Parallel Flows . . . . . . . . . . . . . . 78
3.24 Use Case Scalability Comparison of Periodical Re-Optimization . . . . . . . 80
3.25 Optimization Overhead of Join Enumeration . . . . . . . . . . . . . . . . . 81
3.26 Cumulative Statistic Maintenance Overhead . . . . . . . . . . . . . . . . . . 81
219