Hacia el nuevo estándar de pruebas ISO/IEC 29119 - JICS 2009 ...
Hacia el nuevo estándar de pruebas ISO/IEC 29119 - JICS 2009 ...
Hacia el nuevo estándar de pruebas ISO/IEC 29119 - JICS 2009 ...
Create successful ePaper yourself
Turn your PDF publications into a flip-book with our unique Google optimized e-Paper software.
<strong>Hacia</strong> <strong>el</strong> <strong>nuevo</strong><br />
estándar <strong>de</strong> <strong>pruebas</strong><br />
<strong>ISO</strong> / <strong>IEC</strong> <strong>29119</strong><br />
Javier Tuya<br />
Universidad <strong>de</strong> Oviedo<br />
AENOR: AEN/CTN 71/SC7/GT26<br />
giis.uniovi.es<br />
Jornadas <strong>de</strong> Innovación y Calidad d<strong>el</strong> Software<br />
Alcalá <strong>de</strong> Henares, 4 <strong>de</strong> Septiembre <strong>de</strong> <strong>2009</strong>
Estado actual<br />
• Estándares BSI<br />
BS 7925-1, SW Testing: Part 1-Vocabulary<br />
BS 7925-2, SW Testing: Part 2-SW Component Testing<br />
• Estándares IEEE testing:<br />
IEEE Std 829, Software Test Documentation<br />
IEEE Std 1008, Software Unit Testing<br />
• Otros estándares <strong>ISO</strong>/<strong>IEC</strong>: 12207, 15289<br />
• Otros estándares sectoriales<br />
• Cuerpo <strong>de</strong> conocimiento y metodologías (p.e.)<br />
ISTQB<br />
TMap Next®<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 2
Estado actual<br />
• Áreas no cubiertas por estándares BSI/IEEE<br />
Aspectos organizativos<br />
Proceso y gestión <strong>de</strong> las <strong>pruebas</strong><br />
Pocas técnicas funcionales y no funcionales<br />
Pruebas basadas en riesgos<br />
• Objetivo<br />
• Unificar estándares anteriores en uno solo<br />
• Cubrir <strong>el</strong> ciclo <strong>de</strong> vida completo<br />
• Aplicable a todo tipo <strong>de</strong> sistemas software<br />
• Consistente con otros estándares <strong>ISO</strong><br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 3
Organización<br />
• Estructura Comités y GT • Propuesta: Febrero 2007<br />
• WG26: Mayo 2007<br />
<strong>ISO</strong> <strong>IEC</strong> AENOR<br />
• Base para<br />
Terminología común<br />
JTC1<br />
CTN71<br />
Cuerpo <strong>de</strong> conocimiento<br />
Cualificaciones profesionales<br />
Certificaciones<br />
SC7<br />
SC7<br />
Contratación<br />
• Información<br />
WG26<br />
GT26 http://www.softwaretestingsta<br />
ndard.org/<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 4
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> – Estructura<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 5
Plan <strong>de</strong> trabajo<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 6
Parte 1 – Conceptos y<br />
Vocabulario<br />
• Conceptos generales<br />
Ciclo <strong>de</strong> vida <strong>de</strong> las <strong>pruebas</strong><br />
Objetivos <strong>de</strong> las <strong>pruebas</strong><br />
Tipos <strong>de</strong> <strong>pruebas</strong>, niv<strong>el</strong>es <strong>de</strong> <strong>pruebas</strong>, técnicas<br />
• Conformidad<br />
• Implicaciones en diferentes ciclos <strong>de</strong> vida<br />
(secuencial, evolutivo, ágil)<br />
• Roles y Responsabilida<strong>de</strong>s<br />
• Vocabulario<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 7
Parte 2 – Procesos<br />
(Versión Agosto 2008)<br />
Organizational Test Policy Process<br />
IT Policy,<br />
Management Policy<br />
Organizational Test Strategy Process<br />
Organizational Test Policy,<br />
IT Project Management Policy<br />
Project Test Management Process<br />
Organizational<br />
Test Strategy<br />
Project Management Plan<br />
Product documentation<br />
Software Dev<strong>el</strong>opment Plan<br />
Regulatory Standards<br />
Project and Product Risks<br />
Anomaly Reports<br />
Create/Maintain<br />
Project Test Plan<br />
(TM1)<br />
Project<br />
Test Plan<br />
Project Test Plan Updates<br />
Project Test Plan<br />
Create/Maintain Organizational Test Policy<br />
Create/Maintain Organizational Test Strategy<br />
Organizational<br />
Test Strategy<br />
Control<br />
Directives<br />
Organizational<br />
Test Policy<br />
Comments on Organizational<br />
Test Strategy usage<br />
Monitor and Control<br />
(TM2)<br />
Project Test<br />
Status Reports<br />
Lev<strong>el</strong> Test Status Report<br />
Project and Product Risks<br />
Organizational Test<br />
Policy Updates<br />
Report<br />
Test Project<br />
Completion<br />
(TM3)<br />
Organizational<br />
Test Policy<br />
Organizational<br />
Test Strategy<br />
Project Test<br />
Completion Report<br />
Lev<strong>el</strong> Test<br />
Completion<br />
Report<br />
• Política <strong>de</strong> la<br />
organización<br />
(Test Policy: TP)<br />
• Estrategia organización<br />
(Test Strategy: TS)<br />
• Gestión d<strong>el</strong> proyecto<br />
(Test Management:<br />
TM)<br />
Test Lev<strong>el</strong> Process<br />
Project<br />
Test Plan<br />
Create/Maintain<br />
Lev<strong>el</strong> Test Plan<br />
(TL1)<br />
Lev<strong>el</strong> Test Plan<br />
Lev<strong>el</strong> Test Plan Updates<br />
Test Execution Cycle<br />
Design &<br />
Build Tests<br />
(TL3)<br />
Test<br />
Specification<br />
Monitor and Control (TL2)<br />
Control<br />
Directives<br />
Run Tests<br />
(TL5)<br />
Test<br />
Results<br />
Test Process<br />
Information<br />
Measures<br />
Close Down<br />
Testing<br />
(TL7)<br />
[No issues noticed]<br />
Asset<br />
Archive<br />
Records<br />
Report<br />
Test Lev<strong>el</strong><br />
Completion<br />
(TL8)<br />
Test Results;<br />
Anomaly Reports<br />
Lev<strong>el</strong> Test<br />
Completion<br />
Report<br />
• Niv<strong>el</strong> <strong>de</strong> <strong>pruebas</strong> X<br />
(Test Lev<strong>el</strong>: TL)<br />
Set Up &<br />
Maintain Test<br />
Environment<br />
(TL4)<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
Test Environment<br />
Requirements<br />
Test Environment<br />
Readiness Report<br />
[Issue(s)<br />
noticed]<br />
Report<br />
Anomalies<br />
(TL6)<br />
Anomaly<br />
Report(s)<br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 8
Parte 2 – Ejemplo (TP)<br />
(Versión Agosto 2008)<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 9
Organizational Test Policy Process<br />
IT Policy,<br />
Management Policy<br />
Create/Maintain Organizational Test Policy<br />
Organizational<br />
Test Policy<br />
Parte 2 – Proceso <strong>de</strong> Gestión (TM)<br />
Organizational<br />
Organizational Test Strategy Process<br />
(Versión Agosto 2008)<br />
Organizational Test Policy,<br />
IT Project Management Policy<br />
Test Policy<br />
Create/Maintain Organizational Test Strategy<br />
Organizational Test<br />
Policy Updates<br />
Organizational<br />
Test Strategy<br />
Organizational<br />
Test Strategy<br />
Comments on Organizational<br />
Test Strategy usage<br />
Project Test Management Process<br />
Project Test Plan Updates<br />
Organizational<br />
Test Strategy<br />
Create/Maintain<br />
Project Test Plan<br />
(TM1)<br />
Project Test Plan<br />
Monitor and Control<br />
(TM2)<br />
Project Test<br />
Status Reports<br />
Report<br />
Test Project<br />
Completion<br />
(TM3)<br />
Project Test<br />
Completion Report<br />
Project Management Plan<br />
Product documentation<br />
Software Dev<strong>el</strong>opment Plan<br />
Regulatory Standards<br />
Project and Product Risks<br />
Anomaly Reports<br />
Project<br />
Test Plan<br />
Control<br />
Directives<br />
Lev<strong>el</strong> Test Status Report<br />
Project and Product Risks<br />
Lev<strong>el</strong> Test<br />
Completion<br />
Report<br />
Test Lev<strong>el</strong> Process<br />
Project<br />
Test Plan<br />
Create/Maintain<br />
Lev<strong>el</strong> Test Plan<br />
(TL1)<br />
Lev<strong>el</strong> Test Plan<br />
Monitor and Control (TL2)<br />
Test Process<br />
Information<br />
Close Down<br />
Testing<br />
(TL7)<br />
Asset<br />
Archive<br />
Records<br />
Report<br />
Test Lev<strong>el</strong><br />
Completion<br />
(TL8)<br />
Lev<strong>el</strong> Test<br />
Completion<br />
Report<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
Lev<strong>el</strong> Test Plan Updates<br />
Test Execution Cycle<br />
Design &<br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 10<br />
Test<br />
Specification<br />
Control<br />
Directives<br />
Run Tests<br />
Test<br />
Results<br />
Measures<br />
[No issues noticed]<br />
Test Results;<br />
Anomaly Reports
Parte 2 – Ejemplo (TM1)<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 11
Organizational<br />
Test Strategy<br />
Comments on Organizational<br />
Test Strategy usage<br />
Project Test Management Process<br />
Parte 2 – Niv<strong>el</strong> <strong>de</strong> Pruebas (TL)<br />
Create/Maintain<br />
Organizational<br />
Test Strategy<br />
Project Test Plan<br />
(TM1)<br />
Project Test Plan Updates<br />
Project Test Plan<br />
(Versión Agosto 2008)<br />
Monitor and Control<br />
(TM2)<br />
Project Test<br />
Status Reports<br />
Report<br />
Test Project<br />
Completion<br />
(TM3)<br />
Project Test<br />
Completion Report<br />
Project Management Plan<br />
Product documentation<br />
Software Dev<strong>el</strong>opment Plan<br />
Regulatory Standards<br />
Project and Product Risks<br />
Anomaly Reports<br />
Project<br />
Test Plan<br />
Control<br />
Directives<br />
Lev<strong>el</strong> Test Status Report<br />
Project and Product Risks<br />
Lev<strong>el</strong> Test<br />
Completion<br />
Report<br />
Test Lev<strong>el</strong> Process<br />
Project<br />
Test Plan<br />
Create/Maintain<br />
Lev<strong>el</strong> Test Plan<br />
(TL1)<br />
Lev<strong>el</strong> Test Plan<br />
Monitor and Control (TL2)<br />
Test Process<br />
Information<br />
Close Down<br />
Testing<br />
(TL7)<br />
Asset<br />
Archive<br />
Records<br />
Report<br />
Test Lev<strong>el</strong><br />
Completion<br />
(TL8)<br />
Lev<strong>el</strong> Test<br />
Completion<br />
Report<br />
Lev<strong>el</strong> Test Plan Updates<br />
Control<br />
Directives<br />
Measures<br />
Test Execution Cycle<br />
Test Results;<br />
Anomaly Reports<br />
Design &<br />
Build Tests<br />
(TL3)<br />
Test<br />
Specification<br />
Run Tests<br />
(TL5)<br />
Test<br />
Results<br />
[No issues noticed]<br />
Test Environment<br />
Requirements<br />
[Issue(s)<br />
noticed]<br />
Set Up &<br />
Maintain Test<br />
Environment<br />
(TL4)<br />
Test Environment<br />
Readiness Report<br />
Report<br />
Anomalies<br />
(TL6)<br />
Anomaly<br />
Report(s)<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 12
Noveda<strong>de</strong>s en progreso<br />
• Ultimo borrador difundido Agosto 2008<br />
• Ultima reunión internacional: Mayo <strong>2009</strong>-<br />
Hy<strong>de</strong>rabad (23 participants Australia, China,<br />
Denmark, Finland, Germany, Hong Kong, India,<br />
Korea, S Africa, Spain, UK, USA)<br />
Decidir sobre los 1557 comentarios recibidos<br />
Descripción procesos parte 2 adaptada a 24772<br />
Mod<strong>el</strong>o <strong>de</strong> procesos revisado<br />
Mappings 12207 & 15288<br />
• Ultimo borrador interno, Septiembre <strong>2009</strong><br />
Mod<strong>el</strong>o <strong>de</strong> procesos revisado<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 13
Parte 2 – Procesos<br />
(Versión Revisada, Septiembre <strong>2009</strong>)<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 14
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 15
Parte 3,4 – Documentación,<br />
Técnicas<br />
• Documentación<br />
Contenido + Plantillas<br />
• Técnicas<br />
Descripción + Ejemplos<br />
Estáticas: revisiones, inspecciones…<br />
Dinámicas<br />
• Especificación: PCE, AVL, Sintácticas, Casos Uso,<br />
Combinatorias…<br />
• Estructura: Condiciones…MC/DC, Flujo Datos…<br />
• Experiencia: Búsqueda Errores, Prueba Exploratoria<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 16
Conclusión<br />
• Cobertura <strong>de</strong> una laguna en <strong>el</strong> estado actual <strong>de</strong><br />
los estándares<br />
• Proveer a los profesionales <strong>de</strong> una guía sobre<br />
<strong>pruebas</strong> cubriendo todos los aspectos d<strong>el</strong> ciclo<br />
<strong>de</strong> vida (Conceptos, Vocabulario, Proceso,<br />
Documentación, Técnicas)<br />
• Más información:<br />
Información GT26: http://in2test.lsi.uniovi.es/gt26/<br />
Información WG26:<br />
http://www.softwaretestingstandard.org/<br />
Red RePRIS : http://in2test.lsi.uniovi.es/repris/<br />
Javier Tuya, <strong>JICS</strong> <strong>2009</strong><br />
<strong>ISO</strong>/<strong>IEC</strong> <strong>29119</strong> - Software Testing 17
Change language