the ISO 12207 <strong>software</strong> life cycle processes. Forexample, within the “verificati<strong>on</strong> process” (of the“supporting processes”) 59 <strong>metrics</strong> can be applied(measured). As an example, Appendix A shows adetailed structure of the <strong>software</strong> <strong>product</strong> internal<strong>quality</strong> <strong>metrics</strong>’ names <strong>and</strong> where they can be measuredduring the <strong>software</strong> life cycle processes or activitiesal<strong>on</strong>g with the corresp<strong>on</strong>ding characteristic <strong>and</strong>subcharacteristic for each of those <strong>metrics</strong>. In thisappendix, <strong>on</strong>ly the <strong>software</strong> life processes/activitieswhich have internal <strong>quality</strong> <strong>metrics</strong> are menti<strong>on</strong>ed.However, from Figure 4 we can note that there is no<strong>metrics</strong> which could be measured during 4 out of 5primary life cycle processes. This means that there is noany metric from ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g> external <strong>quality</strong> <strong>metrics</strong>could be useful during the acquisiti<strong>on</strong>, supply,operati<strong>on</strong>, <strong>and</strong> maintenance primary life cycleprocesses. Moreover, there is no <strong>metrics</strong> which could bemeasured during 3 out of 8 of the supporting life cycleprocesses; that is, documentati<strong>on</strong>, c<strong>on</strong>figurati<strong>on</strong>management, <strong>and</strong> audit processes.5. Primary Life Cycle Processes 6. Supporting Life Cycle Processes5.1 Acquisiti<strong>on</strong> (0 Metric)6.1 Documentati<strong>on</strong> (0 Metric)5.2 Supply (0 Metric)6.2 C<strong>on</strong>figurati<strong>on</strong> Management (0 Metric)5.3 Development6.3 Quality Assurance (2 Metrics)(1 Metric in Software Qualificati<strong>on</strong>6.4 Verificati<strong>on</strong> (59 Metrics)Testing activity)6.5 Validati<strong>on</strong> (13 Metrics)5.4 Operati<strong>on</strong> (0 Metric)6.6 Joint review (59 Metrics)5.5 Maintenance (0 Metric)6.7 Audit (0 Metric)6.8 Problem Resoluti<strong>on</strong> (4 Metrics)Figure 4: The ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-3 Internal Quality Metrics <strong>and</strong> where they could be measured in the SLCP.3.2 EXTERNAL QUALITY METRICSWithin the ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-2 <strong>on</strong> <strong>software</strong> <strong>product</strong> external<strong>quality</strong> <strong>metrics</strong>, there is 110 <strong>metrics</strong>. These <strong>metrics</strong> canbe applied during the <strong>software</strong> life cycle. External<strong>quality</strong> defined in ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-1 as the totality ofcharacteristics of the <strong>software</strong> <strong>product</strong> from an externalview. It is the <strong>quality</strong> when the <strong>software</strong> is executed,which is typically measured <strong>and</strong> evaluated while testingin a simulated envir<strong>on</strong>ment with simulated data usingexternal <strong>metrics</strong>. During testing, most faults should bediscovered <strong>and</strong> eliminated. However, some faults maystill remain after testing. As it is difficult to correct the<strong>software</strong> architecture or other fundamental designaspects of the <strong>software</strong>, the fundamental design usuallyremains unchanged throughout testing [12].Figure 5 shows the number of external <strong>quality</strong><strong>metrics</strong> which can be applied (measured) during each ofthe ISO 12207 <strong>software</strong> life cycle processes. Forexample, within the “operati<strong>on</strong> process” of the “primaryprocesses”, 93 <strong>metrics</strong> can be applied (measured).5. Primary Life Cycle Processes 6. Supporting Life Cycle Processes5.1 Acquisiti<strong>on</strong> (0 Metric)6.1 Documentati<strong>on</strong> (0 Metric)5.2 Supply (0 Metric)6.2 C<strong>on</strong>figurati<strong>on</strong> Management5.3 Development(0 Metric)(7 Metrics in Software Integrati<strong>on</strong> activity)6.3 Quality Assurance (14 Metrics)(100 Metric in Software Qualificati<strong>on</strong> Testing activity)6.4 Verificati<strong>on</strong> (0 Metrics)(7 Metrics in System Integrati<strong>on</strong> activity)6.5 Validati<strong>on</strong> (47 Metrics)5.4 Operati<strong>on</strong> (93 Metric)6.6 Joint review (0 Metric)5.5 Maintenance (48 Metric)6.7 Audit (0 Metric)6.8 Problem Resoluti<strong>on</strong> (1 Metric)Figure 5: The ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-2 External Quality Metrics <strong>and</strong> where they could be measured in the SLCP.3.3 QUALITY IN USE METRICSWithin the ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-2 <strong>on</strong> <strong>software</strong> <strong>product</strong> <strong>quality</strong> inuse <strong>metrics</strong>, there is 15 <strong>metrics</strong>. These the 15 <strong>metrics</strong>can be applied during the <strong>software</strong> life cycle. Quality inUse defined in ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-1 as the user’s view of the<strong>quality</strong> of the <strong>software</strong> <strong>product</strong> when it is used in aspecific envir<strong>on</strong>ment <strong>and</strong> a specific c<strong>on</strong>text of use. Itmeasures the extent to which users can achieve theirgoals in a particular envir<strong>on</strong>ment, rather than measuringthe properties of the <strong>software</strong> itself. The term ‘user’
efers to any type of intended users, including bothoperators <strong>and</strong> maintainers, <strong>and</strong> their requirements canbe different. [12].Figure 6 shows the number of <strong>quality</strong> in use <strong>metrics</strong>which can be applied (measured) during each of the ISO12207 <strong>software</strong> life cycle processes. For example,during the “<strong>software</strong> qualificati<strong>on</strong> testing” activity ofthe “development process” of the “primary processes”,12 <strong>metrics</strong> can be applied (measured).5. Primary Life Cycle Processes 6. Supporting Life Cycle Processes5.1 Acquisiti<strong>on</strong> (0 Metric)6.1 Documentati<strong>on</strong> (0 Metric)5.2 Supply (0 Metric)5.3 Development(12 Metric in Software Qualificati<strong>on</strong> Testing activity)5.4 Operati<strong>on</strong> (15 Metric)5.5 Maintenance (0 Metric)6.8 Problem Resoluti<strong>on</strong> (0 Metrics)6.2 C<strong>on</strong>figurati<strong>on</strong> Management(0 Metric)6.3 Quality Assurance (0 Metrics)6.4 Verificati<strong>on</strong> (0 Metrics)6.5 Validati<strong>on</strong> (11 Metrics)6.6 Joint review (0 Metrics)6.7 Audit (0 Metric)Figure 6: The ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-4 Quality in Use Metrics <strong>and</strong> where they could be measured in the SLCP.4. DISCUSSION OF THE MAPPINGIn ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-3, there are some external <strong>quality</strong> <strong>metrics</strong> –as in Table 1 - which have been referred to be appliedduring the “integrati<strong>on</strong>” activity of the “developmentprocess” of the “primary processes”. But, within the“development” process, there are two activities relatedto the “integrati<strong>on</strong>”, that is, “system integrati<strong>on</strong>” <strong>and</strong>“<strong>software</strong> integrati<strong>on</strong>”. However, this document (ISO<str<strong>on</strong>g>9126</str<strong>on</strong>g>-3) did not specify during which “integrati<strong>on</strong>”activity those <strong>metrics</strong> can be applied (measured).Table 1: Some External Quality Metrics.1- Estimated latent fault 2- Incorrect operati<strong>on</strong>densityavoidance3- Failure density 4- Availabilityagainst test cases5- Failure resoluti<strong>on</strong> 6- Mean down time7- Fault density 8- Mean recovery time9- Fault removal 10- Restartability11- Mean time <str<strong>on</strong>g>between</str<strong>on</strong>g>failures (MTBF)12- User supportfuncti<strong>on</strong>al c<strong>on</strong>sistency13- Breakdown 14- Restore effectiveness15- Failure avoidance 16- RestorabilityIt is clearly noted that through the ISO 12207“organizati<strong>on</strong>al processes” n<strong>on</strong>e of the 195 <strong>quality</strong><strong>metrics</strong> - found in ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g> series of internati<strong>on</strong>alst<strong>and</strong>ards - can be applied (measured).As menti<strong>on</strong>ed in ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-1, the <strong>quality</strong> in use<strong>metrics</strong> should be measured during the executi<strong>on</strong> of the<strong>software</strong> <strong>product</strong> in an actual working envir<strong>on</strong>ment.However, in Figure 6 we can see that there is 12 <strong>metrics</strong>which could be measured through the “<strong>software</strong>qualificati<strong>on</strong> testing” activity. But since ISO 12207menti<strong>on</strong>ed that the “<strong>software</strong> qualificati<strong>on</strong> testing”activity is a part of the “development process” Thus, it’sstrange <strong>and</strong> make no sense to measure the 12 <strong>metrics</strong>The “joint review process” of the “supportingprocesses” c<strong>on</strong>sists of three activities; <strong>on</strong>e of theseactivities is the “technical reviews” activity. The“technical reviews” activity c<strong>on</strong>tains <strong>on</strong>e task that is,“Technical reviews shall be held to evaluate the<strong>software</strong> <strong>product</strong>s or services under c<strong>on</strong>siderati<strong>on</strong> <strong>and</strong>provide evidence that: a) they are complete . . . ” [9].Now, if we go back to Figure 4, we will find that thereis 59 internal <strong>quality</strong> <strong>metrics</strong> that could be measuredduring the “joint review” process. Whereas, fromFigures 5 <strong>and</strong> 6, it is seen that there is no any external<strong>quality</strong> or <strong>quality</strong> in use <strong>metrics</strong> that can be appliedduring “joint review” process.5. CONCLUSIONThe current editi<strong>on</strong> of the ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g> c<strong>on</strong>sists ofinventories of proposed <strong>metrics</strong> to measure the <strong>quality</strong>of the internal, external, <strong>and</strong> in-use <strong>software</strong> <strong>product</strong>.However, for each of these <strong>metrics</strong> there is a crossreference<strong>on</strong> where it could be applied (measured)during the ISO 12207 <strong>software</strong> life cycle processes <strong>and</strong>activities. This paper provided a <str<strong>on</strong>g>mapping</str<strong>on</strong>g> <str<strong>on</strong>g>between</str<strong>on</strong>g> thosetwo st<strong>and</strong>ards to investigate the cross-references<str<strong>on</strong>g>between</str<strong>on</strong>g> them. Based <strong>on</strong> this <str<strong>on</strong>g>mapping</str<strong>on</strong>g>, the followingcomments <strong>and</strong> suggesti<strong>on</strong>s for the upcoming new ISO25000 series of st<strong>and</strong>ards (SQuaRE) can be c<strong>on</strong>cluded:- There is no any metric can be measured duringthe “organizati<strong>on</strong>al processes”.- A number of external <strong>quality</strong> <strong>metrics</strong> wherementi<strong>on</strong>ed in ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>-2 to be measured duringthe “integrati<strong>on</strong>” activity. However, within theISO 12207 there are two activities labeled“system integrati<strong>on</strong>” <strong>and</strong> “<strong>software</strong> integrati<strong>on</strong>”.This will make the user of the ISO <str<strong>on</strong>g>9126</str<strong>on</strong>g>c<strong>on</strong>fused.