Extraction and Integration of MovieLens and IMDb Data - APMD

More documents

Recommendations

Info

Extraction and Integration of MovieLens and IMDb Data – Technical Report 28 Figure 23 – Integrated schema I_Movies MovieId TitleMovieLens TitleIMDB I_MovieRatings MovieId Distribution Votes Rating I_Genres Genre I_MovieGenres MovieId Genre MovieId MovieId Genre I_Countries Country LongName DomainCode ISO2Code ISO3Code UNnumericalCode IsCurrent IsSovereign Sovereign Continent SecondaryContinent Area Inhabitants I_MovieCountries MovieId Country MovieId Country I_Years Year Decade I_MovieYears MovieId Year YearInfo Year MovieId I_MovieReleaseDates MovieId Country ReleaseDate ReleaseYear ReleaseInfo Year= ReleaseYear Country MovieId I_Keywords Keyword MovieQuantities I_MovieKeywords MovieId Keyword Keyword MovieId Language MovieId I_Languages Language I_MovieLanguages MovieId Language LanguageInfo I_CountryCodes CountryCode Country Description I_MovieProductionCompanies MovieId CompanyName CountryCode CompanyInfo CountryCode MovieId Type MovieId I_Types Type TypeDescription I_MovieTypes MovieId Type Color MovieId I_Colors Color I_MovieColors MovieId Color ColorInfo LinkType MovieId LinkMovieId=MovieId I_LinkTypes LinkType I_MovieLinks MovieId LinkMovieId LinkType 2 BudgetCurrency=Currency / RevenueCurrency=Currency MovieId I_Currencies Currency ConversionUSD I_MovieBusiness MovieId BudgetCurrency Budget BudgetUSD RevenueCurrency Revenue RevenueUSD 2 I_MovieDistributors MovieId DistributionCompany CountryCode DistributionInfo CountryCode MovieId I_Distributors DistributionCompany DistributionCompany I_Zones Zone Country Country I_MovieLocations MovieId Location Zone LocationInfo Zone MovieId I_MovieRunningTimes MovieId Country Duration RunningInfo Country MovieId SoundMix MovieId I_Sounds SoundMix I_MovieSounds MovieId SoundMix I_Directors Director MovieQuantity I_MovieDirectors MovieId Director DirectorAlias DirectorInfo MovieId Director I_Writers Writer MovieQuantity I_MovieWriters MovieId Writer WriterInfo MovieId Writer I_Producers Producer MovieQuantity I_MovieProducers MovieId Producer ProducerInfo MovieId Producer I_MovieCostumeDesigners MovieId CostumeDesigner CostumeInfo MovieId I_MovieProductionDesigners MovieId ProductionDesigner DesignerInfo MovieId I_Actresses Actress MovieQuantity I_MovieActresses MovieId Actress PlayInfo Role Casting MovieId Actress I_Actors Actor MovieQuantity I_MovieActors MovieId Actor PlayInfo Role Casting MovieId Actor I_Biographies Name RealName Birth Decease Height I_Ages AgeId MinAge MaxAge I_Durations DurationMin DurationMax DurationInterval DurationMin ≤ Duration ≤ DurationMax Country I_Occupations OccupationId Occupation I_UserRatings UserId MovieId Rating Timestamp I_Users UserId Gender AgeId OccupationId ZipCode UserId MovieId AgeId OccupationId I_Person Name Director Writer Producer Actress Actor CostumeDesigner ProductionDesigner Name I_Votes Votes I_Ratings Ratings Votes Rating I_Revenues RevenueUSD I_Budgets BudgetUSD RevenueUSD BudgetUSD I_Movies MovieId TitleMovieLens TitleIMDB I_MovieRatings MovieId Distribution Votes Rating I_Genres Genre I_MovieGenres MovieId Genre MovieId MovieId Genre I_Countries Country LongName DomainCode ISO2Code ISO3Code UNnumericalCode IsCurrent IsSovereign Sovereign Continent SecondaryContinent Area Inhabitants I_MovieCountries MovieId Country MovieId Country I_Years Year Decade I_MovieYears MovieId Year YearInfo Year MovieId I_MovieReleaseDates MovieId Country ReleaseDate ReleaseYear ReleaseInfo Year= ReleaseYear Country MovieId I_Keywords Keyword MovieQuantities I_MovieKeywords MovieId Keyword Keyword MovieId Language MovieId I_Languages Language I_MovieLanguages MovieId Language LanguageInfo I_CountryCodes CountryCode Country Description I_MovieProductionCompanies MovieId CompanyName CountryCode CompanyInfo CountryCode MovieId Type MovieId I_Types Type TypeDescription I_MovieTypes MovieId Type Color MovieId I_Colors Color I_MovieColors MovieId Color ColorInfo LinkType MovieId LinkMovieId=MovieId I_LinkTypes LinkType I_MovieLinks MovieId LinkMovieId LinkType 2 BudgetCurrency=Currency / RevenueCurrency=Currency MovieId I_Currencies Currency ConversionUSD I_MovieBusiness MovieId BudgetCurrency Budget BudgetUSD RevenueCurrency Revenue RevenueUSD 2 I_MovieDistributors MovieId DistributionCompany CountryCode DistributionInfo CountryCode MovieId I_Distributors DistributionCompany DistributionCompany I_Zones Zone Country Country I_MovieLocations MovieId Location Zone LocationInfo Zone MovieId I_MovieRunningTimes MovieId Country Duration RunningInfo Country MovieId SoundMix MovieId I_Sounds SoundMix I_MovieSounds MovieId SoundMix I_Directors Director MovieQuantity I_MovieDirectors MovieId Director DirectorAlias DirectorInfo MovieId Director I_Writers Writer MovieQuantity I_MovieWriters MovieId Writer WriterInfo MovieId Writer I_Producers Producer MovieQuantity I_MovieProducers MovieId Producer ProducerInfo MovieId Producer I_MovieCostumeDesigners MovieId CostumeDesigner CostumeInfo MovieId I_MovieProductionDesigners MovieId ProductionDesigner DesignerInfo MovieId I_Actresses Actress MovieQuantity I_MovieActresses MovieId Actress PlayInfo Role Casting MovieId Actress I_Actors Actor MovieQuantity I_MovieActors MovieId Actor PlayInfo Role Casting MovieId Actor I_Biographies Name RealName Birth Decease Height I_Ages AgeId MinAge MaxAge I_Durations DurationMin DurationMax DurationInterval DurationMin ≤ Duration ≤ DurationMax Country I_Occupations OccupationId Occupation I_UserRatings UserId MovieId Rating Timestamp I_Users UserId Gender AgeId OccupationId ZipCode UserId MovieId AgeId OccupationId I_Person Name Director Writer Producer Actress Actor CostumeDesigner ProductionDesigner Name I_Votes Votes I_Ratings Ratings Votes Rating I_Revenues RevenueUSD I_Budgets BudgetUSD RevenueUSD BudgetUSD
4.2. Integrated schema Verónika Peralta The integrated schema consists in 52 tables describing movies, companies and persons related to movies and the users that evaluated movies. Figure 23 shows the tables of the integrated schema, their primary keys (underlined attributes) and foreign keys (arrows between tables). Additional dotted lines relate some tables to a fictitious (not implemented) relation, describing persons. Shadow tables were used for the construction of the referential but are not visible for making queries. Table 13 describes each table, its attributes and constraints. Table Attributes Constraints I_Movies Join between IMDb and MovieLens I_Actors Master of actors I_Actresses Master of actresses I_Ages Age intervals I_Biographies Biographies of actors, actresses, directors, producers and other people involved in movies I_Budgets Master of budget intervals I_Colors Master of colors I_Countries Master of countries, providing several aggregation criteria and international country codes − MovieId: Numeric(4); MovieLens’ id − TitleMovieLens: String(100) − TitleImdb: String(250) − Actor: String(75) − MovieQuantity: Numeric(3); the number of played movies − Actress: String(75) − MovieQuantity: Numeric(3); the number of played movies − AgeId: Numeric(2) − MinAge: Numeric(2) − MaxAge: Numeric(2) − Name: String(70) − RealName: String(220) − Birth: String(130); date and place of birth − Decease: String(160); date, place and cause of decease − Height: String(15) − BudgetUSD: Numeric(15,2); start of an interval (internal use) Primary key: MovieId Unique: TitleImdb Primary key: Actor Primary key: Actress Primary key: AgeId Primary key: Name Primary key: BudgetUSD − Color: String(20) Primary key: Color − Country: String(40) − LongName: String(110) − DomainCode: String(2); internet domain − ISO2Code: String(2); ISO3166-1-alpha2 code − ISO3Code: String(3); ISO3166-1-alpha2 code − UNnumericalCode: Numeric(3); united nations country code − IsCurrent: Numeric(1); 1 for current countries, 0 for old ones − IsSovereign: Numeric(1); 1 for sovereign UN nations, 2 for sovereign non-UN nations, 3 for sovereign non-recognized nations, 4 for dependent territories and 5 for areas of special sovereignty − Sovereign: String(40); name of sovereign nation (current country in the case of old countries) − Continent: String(20) − SecondaryContinent: String(20); for countries having territories in two continents (the one with the highest are is taken as main continent) − Area: Numeric(8) − Inhabitants: Numeric(10) Primary key: Country 29
Page 1 and 2: Extraction and Integration of Movie
Page 3 and 4: Movies.dat 1::1193::5::978300760 1:
Page 5 and 6: u.genre Verónika Peralta This file
Page 7 and 8: Table Attributes Constraints SML_Us
Page 9 and 10: Verónika Peralta temporal table st
Page 11 and 12: Verónika Peralta − Manual insert
Page 13 and 14: Verónika Peralta corrections and a
Page 15 and 16: Verónika Peralta File Format Optio
Page 17 and 18: Table Attributes Constraints IMDb_M
Page 19 and 20: IMDb_ReleaseDates Dates of movie re
Page 21 and 22: Verónika Peralta In order to store
Page 23 and 24: Verónika Peralta − Movie type ca
Page 25 and 26: Verónika Peralta The implementatio
Page 27: ML_Movies SML_Movies IMDb_Movies ma
Page 31 and 32: I_MovieCountries Countries of movie
Page 33 and 34: I_Users Descriptive information abo
Page 35 and 36: Verónika Peralta integration proce

Extraction and Integration of MovieLens and IMDb Data - APMD

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?