Extractive Summarization of Development Emails

More documents

Recommendations

Info

Contents 1 Introduction 3 1.1 Software engineering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.2 Relevance of summaries . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.3 Proposed solution: extractive summarization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 1.4 Structure of the document . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4 2 Related work 5 2.1 Bug Reports . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 2.2 Source Code . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5 2.3 Emails . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6 2.4 Speeches . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8 2.5 Extractive summarization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9 2.6 Considered techniques . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 10 3 Methodology 11 3.1 Pilot exploration: keywords vs sentences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 11 3.2 A human summaries collection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 13 3.3 Critical analysis of "Round 1" outputs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14 3.4 Benchmark creation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 18 3.5 Machine Learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19 4 Implementation 22 4.1 Summit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 22 4.2 An Eclipse Plug-in . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 4.3 REmail Summary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 23 5 Conclusions and Future Work 26 A Pilot exploration material 28 A.1 First pilot test output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28 A.2 Second pilot test output . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30 B Benchmark creation test 32 B.1 "Round 1" material . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32 B.2 “Round 2" post-test questionnaire charts (System A = FreeNet, System B = ArgoUML) . . . . . . . . . . 35 B.3 Benchmark . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37 1
Acknowledgments I would like to thank so much Prof. Michele Lanza and Dr. Marco D’Ambros to have been so helpful and kind: all of you made me understand that I have to believe more in myself. The most important concept I learnt during my bachelor project is: “Don’t think whether you are able to do it or not. Just do it!” - Michele Lanza. I want to thank Lorenzo Baracchi, Lucia Blondel, Cristian Bruseghini, Mattia Candeloro, Andrea Gallidabino, Giulia Giacalone, Jacopo Malnati, Thomas Mantegazzi, Carlo Alberto Mastrodicasa, Wahed Abdul Mehran, Stefano Pongelli, Fabio Rambone, Giorgio Ratti, Marcello Romanelli, Igor Moreno Santos, Thomas Selber, Yotam Sharon, Giulio Valente. Without you all, I would have never be able to perform my research experiments; so this paper would not exist. Thank you! A warm embrace goes to my family, my extraordinary boyfriend, my classmates and my friends. Thanks to have always supported me even in times of greatest stress. A special thank goes to Alberto Bacchelli. You are an amazing person and I have been very lucky to walk this interesting path with you. Thanks to have always been there whenever I felt not so confident or I just needed to talk with a friend. 2
Page 1: Bachelor Thesis June 12, 2012 Extra
Page 5 and 6: in charge of some "creative" produc
Page 7 and 8: method the terms were ordered by de
Page 9 and 10: • [4] that used a deterministic "
Page 11 and 12: need for reading them. Murray et al
Page 13 and 14: 2. Is extracting only keywords more
Page 15 and 16: • If a sentence contains some cit
Page 17 and 18: While for strace thread type follow
Page 19 and 20: The results of Round 2 showed that
Page 21 and 22: singular vote of each participant,
Page 23 and 24: 4 Implementation 4.1 Summit While t
Page 25 and 26: - the produced summary - the short
Page 27 and 28: 5 Conclusions and Future Work Our r
Page 29 and 30: A Pilot exploration material A.1 Fi
Page 31 and 32: A.2 Second pilot test output 1. Ema
Page 33 and 34: B Benchmark creation test B.1 "Roun
Page 35 and 36: What we need back from you is a zip
Page 37 and 38: Figure 22. Average on answers to qu
Page 39 and 40: Figure 27. Partial view of joined A
Page 41: References [1] A. Bacchelli, M. Lan

Extractive Summarization of Development Emails

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?