10.12.2012 Views

Domain Testing: Divide and Conquer - Testing Education

Domain Testing: Divide and Conquer - Testing Education

Domain Testing: Divide and Conquer - Testing Education

SHOW MORE
SHOW LESS

You also want an ePaper? Increase the reach of your titles

YUMPU automatically turns print PDFs into web optimized ePapers that Google loves.

tester with a couple years experience. But it is an example of the kinds of thinking I do<br />

expect from a working tester.<br />

I have not specifically produced the equivalence class tables called for in the exercise.<br />

However, my analysis of the variables provides most of the information required for<br />

those tables.<br />

Observations of the students’ answers:<br />

� I don't see anything in the students’ answers (except for student4) that goes to the<br />

question of dimension.<br />

� I don’t see any output variables in the student answers.<br />

� I don’t see any interactions among variables noted. Though this wasn’t specifically<br />

called for in the instructions, I believe this is an important aspect of the skill of the<br />

working tester. Many aspects of products are not laid out for testers directly, but<br />

must be inferred mental models of the product that form in the normal course of<br />

learning a product.<br />

� I don’t see any issues or questions noted, or commentary on the sources <strong>and</strong><br />

limitations of their analyses.<br />

� In almost every case, the risks provided by the students added no information over<br />

<strong>and</strong> above the description of the corresponding equivalence class. Notice that in my<br />

analysis, I identified one list of “domain-defining risks” for each variable, <strong>and</strong> no<br />

separate list of equivalence classes. This is because in most cases, I felt a separate<br />

list would add nothing to the analysis.<br />

� The click help function was not mentioned in any of their analyses. Click help is<br />

functionally identical to an enumerated menu of options. Just because the interface<br />

is different does not seem to me a reason to exclude it from our testing.<br />

� The “custom” setting applies the dimensions of the printable area of the current<br />

printer, but this relationship is not noted in any of the student analyses. This may<br />

indicate that the students did not review the online help, nor perform enough of an<br />

exploration of this function.<br />

� Because the students apparently used only empirical observation to perform their<br />

analyses, their analyses are basically tautological. They each determined that the<br />

input length limit for the numeric fields is 31, apparently because that is how the<br />

software behaves. But a length of 31 is inconsistent with the obvious limits of those<br />

functions—clearly PowerPoint is not designed to h<strong>and</strong>le slides that are a billion<br />

trillion trillion inches wide or tall. So, it seems more reasonable to question the 31<br />

character limit than to enshrine it permanently in the test cases.<br />

� The consistency among the answer sheets for each student suggests that the students<br />

either collaborated with each other to produce their answers, or that they were<br />

instructed in a very specific formula of domain testing. I don’t believe domain<br />

testing is usefully reduced to a formula. I believe successful working testers show<br />

more variation in their work, because of natural variations in the experiences,<br />

temperament, exploration, knowledge, <strong>and</strong> contexts of thinking people. The lack of

Hooray! Your file is uploaded and ready to be published.

Saved successfully!

Ooh no, something went wrong!