Extraction and Integration of MovieLens and IMDb Data - APMD

More documents

Recommendations

Info

Extraction and Integration of MovieLens and IMDb Data – Technical Report 2.1.2. Source files of the small data set The small data set consists in 5 text files, with tabular format, describing 100000 anonymous ratings of 1682 movies made by 943 users during the seven-month period from September 19 th , 1997 through April 22 nd , 1998. In the following, we describe the contents of each text file. u.data This file contains data about 100000 ratings (1 evaluation, corresponding to 1 user and 1 movie, in each line). It is a tab-separated list of UserID, MovieID, Rating and Timestamp, where: 4 − UserID is an integer, ranging from 1 to 943, that identifies a user. Each user has rated at least 20 movies. − MovieID is an integer, ranging from 1 to 1682, that identifies a movie. − Rating is an integer, ranging from 1 to 5, made on a 5-star scale (whole-star ratings only). − Timestamp is represented in seconds since 1/1/1970 UTC Data is randomly ordered. Figure 5 shows an extract of the file corresponding to 5 ratings. u.item 196 242 3 881250949 186 302 3 891717742 22 377 1 878887116 244 51 2 880606923 166 346 1 886397596 Figure 5 – Extract of the u.data file This file contains data about 1682 movies (1 movie in each line). This is a pipe-separated list of MovieID, MovieTitle, ReleaseDate, VideoReleaseDate, IMDbURL, unknown, Action, Adventure, Animation, Children’s, Comedy, Crime, Documentary, Drama, Fantasy, Film-Noir, Horror, Musical, Mystery, Romance, Sci-Fi, Thriller, War and Western, where − MovieID is an integer, ranging from 1 to 1682, that identifies a movie. − MovieTitle is a String that concatenates movie title and year of release (between brackets). − ReleaseDate is a DD-Mon-YYYY date indicating movie release date − VideoReleaseDate was destinated to video release date but it is always NULL − IMDbURL indicates the URL of the movie in the IMDb site. − The last 19 fields correspond to genres; a 1 indicates the movie is of that genre, a 0 indicates it is not; movies can be in several genres at once. Figure 6 shows an extract of the file corresponding to 5 movies. 1|Toy Story (1995)|01-Jan-1995||http://us.imdb.com/M/title-exact?Toy%20Story%20(1995)|0|0|0|1|1|1|0|0| 0|0|0|0|0|0|0|0|0|0|0 2|GoldenEye (1995)|01-Jan-1995||http://us.imdb.com/M/title-exact?GoldenEye%20(1995)|0|1|1|0|0|0|0|0|0| 0|0|0|0|0|0|0|1|0|0 3|Four Rooms (1995)|01-Jan-1995||http://us.imdb.com/M/title-exact?Four%20Rooms%20(1995)|0|0|0|0|0|0|0| 0|0|0|0|0|0|0|0|0|1|0|0 4|Get Shorty (1995)|01-Jan-1995||http://us.imdb.com/M/title-exact?Get%20Shorty%20(1995)|0|1|0|0|0|1|0| 0|1|0|0|0|0|0|0|0|0|0|0 5|Copycat (1995)|01-Jan-1995||http://us.imdb.com/M/title-exact?Copycat%20(1995)|0|0|0|0|0|0|1|0|1|0|0| 0|0|0|0|0|1|0|0 Figure 6 – Extract of the u.item file
u.genre Verónika Peralta This file contains data about 19 movie genres (1 genre in each line). This is a pipe-separated list of GenreID and GenreName, where − GenreID is an integer, ranging from 0 to 18, that identifies a genre. − GenreName is a String describing the genre. Genre names corresponds to genre columns of the u.item file. Figure 7 shows an extract of the file corresponding to 5 genres. u.user unknown|0 Action|1 Adventure|2 Animation|3 Children's|4 Figure 7 – Extract of the u.genre file This file contains data about 943 users (1 user in each line). This is a pipe-separated list of UserID, Age, Gender, Occupation and Zip-code, where: − UserID is an integer, ranging from 1 to 943, that identifies a user − Age is an integer indicating user’s age − Gender is denoted by a "M" for male and "F" for female − Occupation is an String indicating user occupation. − Zip-code is a five-digits integer indicating user ZIP-code. All demographic information was provided voluntarily by the users and was not checked for accuracy. Only users who have provided some demographic information are included in this data set. Figure 8 shows an extract of the file corresponding to 5 users. u.occupation 1|24|M|technician|85711 2|53|F|other|94043 3|23|M|writer|32067 4|24|M|technician|43537 5|33|F|other|15213 Figure 8 – Extract of the u.user file This file lists 21 user occupations (1 occupation in each line). Figure 9 shows an extract of the file corresponding to 5 occupations. 2.2. MovieLens target schemas administrator artist doctor educator engineer Figure 9 – Extract of the u.occupations file Both MovieLens data set were extracted to a Microsoft Access® database. The following sub-sections describe the target schemas for both data sets. 5
Page 1 and 2: Extraction and Integration of Movie
Page 3: Movies.dat 1::1193::5::978300760 1:
Page 7 and 8: Table Attributes Constraints SML_Us
Page 9 and 10: Verónika Peralta temporal table st
Page 11 and 12: Verónika Peralta − Manual insert
Page 13 and 14: Verónika Peralta corrections and a
Page 15 and 16: Verónika Peralta File Format Optio
Page 17 and 18: Table Attributes Constraints IMDb_M
Page 19 and 20: IMDb_ReleaseDates Dates of movie re
Page 21 and 22: Verónika Peralta In order to store
Page 23 and 24: Verónika Peralta − Movie type ca
Page 25 and 26: Verónika Peralta The implementatio
Page 27 and 28: ML_Movies SML_Movies IMDb_Movies ma
Page 29 and 30: 4.2. Integrated schema Verónika Pe
Page 31 and 32: I_MovieCountries Countries of movie
Page 33 and 34: I_Users Descriptive information abo
Page 35 and 36: Verónika Peralta integration proce

Extraction and Integration of MovieLens and IMDb Data - APMD

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?