Extractive Summarization of Development Emails

While for strace thread type follows the one of natural language thread type.
Figure 4. Average test result for STRACE thread-type
Perhaps such a behavior is due to the fact that people tend to underline always the same things in pieces of
source code: class names and method signatures. We thought that this happens because they do not represent machine
instructions, but only the functionality of the piece of code they contain. On the contrary, in case of natural
language, a human subject is able to better interpret the text and everyone can build a personal opinion about the
weight of every sentence.
Referring to the post-test questionnaire, the participants had to write for every question an integer vote between 1
and 5, with the corresponding extreme values indicated in the question itself. We discovered that on average people
did not find summarizing thread from a system more difficult than from the other, but they found the division
into essential and optional sentences harder for System A rather than System B. This is an interesting aspect to be
inspected: is this task really harder for ArgoUML, or the results are due to the fact that such system was required to
be summarized first and so participants were still unaccustomed to this job?
Figure 5. Average on answers to question “How difficult was it to summarize emails by sentences?" [1 = “very easy", 5 = “very
hard"]
Figure 6. Average on answers to question “How difficult was it to divide sentences into essential and optional?" [1 = “very
easy", 5 = “very hard"]
16