Jure Leskovec, Stanford University - SNAP - Stanford University

More documents

Recommendations

Info

. . . 1, 5, 2, 7, 0, 9, 3 . . . a, r, v, t, y, h, b . . . 0, 0, 1, 0, 1, 1, 0 time Streams Entering Limited Working Storage Ad-Hoc Queries Standing Queries Processor Archival Storage Output 3/9/2011 Jure Leskovec, Stanford C246: Mining Massive Datasets 32
Can’t store the whole stream but we are happy with an approximate answer Sampling data from a stream: Sample of size k: each element is included with prob. k/N Queries over sliding windows: How many 1s are in last k bits? DGIM: summarize blocks with specific number of 1s To estimate the number of 1s in the most recent N bits: Sum the sizes of all buckets but the last Add half the size of the last bucket 1001010110001011010101010101011010101010101110101010111010100010110010 3/9/2011 Jure Leskovec, Stanford C246: Mining Massive Datasets 33
Page 1 and 2: CS246: Mining Massive Datasets Jure
Page 3 and 4: MapReduce Association Rules Findi
Page 5 and 6: The crew of the space shuttle Endea
Page 7 and 8: Many problems can be expressed as f
Page 9 and 10: Shingling: convert docs to sets of
Page 11 and 12: ands Hash cols of signature matrix
Page 13 and 14: SciFi Romnce A = U Σ V T - exampl
Page 15 and 16: SciFi Romnce A = U Σ V T - exampl
Page 17 and 18: Hierarchical: Agglomerative (botto
Page 19 and 20: LSH: Find somewhat similar pairs o
Page 21 and 22: Rank nodes using link structure Pa
Page 23 and 24: HITS (Hypertext-Induced Topic Selec
Page 25 and 26: High-dimensional data: Locality Sen
Page 27 and 28: Distance metric: Euclidean How ma
Page 29 and 30: Building decision trees using MapRe
Page 31: High-dimensional data: Locality Sen
Page 35 and 36: You get to see one input piece at a
Page 37 and 38: High-dimensional data: Locality Sen
Page 39 and 40: Observation: Subsets of a frequent
Page 41 and 42: User-user collaborative filtering
Page 43 and 44: MapReduce Association Rules Aprio
Page 45 and 46: Seminars: InfoSeminar: http://i.st

Jure Leskovec, Stanford University - SNAP - Stanford University

Create successful ePaper yourself

Delete template?

Save as template?