CoSIT 2017

162 Computer Science & Information Technology (CS & IT)
Figure 5. Content validation process of the “Items Algorithm”
Notes: The figure presents the content validation process of the “Items Algorithm”. First, the entire 10-K
section of each filing from the “Complete Submission Text File” as provided on the SEC server is
extracted. Word counts for the entire 10-K section as well as for all individual items are retrieved by
applying the “Items Algorithm” in order to be compared. Due to structural changes of the annual report on
Form 10-K over time (different number of items) the relation of text length between the overall 10-K
section and all individual items shall represent the ability of the algorithm to extract particular items from
the 10-K section.
Table 9 presents the validation results for the “Items Algorithm”.
Table 9. Validation results of the “Items Algorithm”
Notes: The table presents the validation results of the “Items Algorithm”. The second and third columns
show the number of filings of which items could be extracted from by applying the “Items Algorithm”