Recommender System with Apache Spark Apache Kafka and Elasticsearch

Recommendations

Info

The Machine Perception Learning Workflow Data ??? Machine Learning ??? $$$
The Machine Reality Learning Workflow Spark ML Missing piece! Various Spark DataFrames ??? Data Ingest Data Processing Model Training Deploy Live System • Historical • Streaming • Feature transformation & engineering • Model selection & evaluation • Pipelines, not just models • Versioning • Predict given new data • Monitoring & live evaluation Feedback Loop Stream (Kafka)
Page 1 and 2: Nick Pentreath Nov / 14 / 16 Buildi
Page 3 and 4: Agenda § Recommender systems & the
Page 5: Recommender Overview Systems
Page 9 and 10: Data Modeling for Recommender Syste
Page 11 and 12: User and Item System Requirements M
Page 13 and 14: Anatomy of a Data model User Event
Page 15 and 16: Why Kafka, Spark & Elasticsearch?
Page 17 and 18: Why Spark? DataFrames § Events & m
Page 19 and 20: Kafka for Recommender Systems
Page 21 and 22: Write to Event Store Event store Sp
Page 23 and 24: Item Metadata Analytics Spark Strea
Page 25 and 26: Structured Status Streaming § Stil
Page 27 and 28: Collaborative Matrix Factorization
Page 29 and 30: Collaborative Loading Data in Spark
Page 31 and 32: Deploying & Scoring Recommendation
Page 33 and 34: Recommendation Can we use the same
Page 35 and 36: Elasticsearch Custom scoring functi
Page 37 and 38: Elasticsearch We get search engine
Page 39 and 40: Monitoring & Feedback
Page 41 and 42: System Events Logging Recommendatio
Page 43 and 44: Scaling Model Scoring
Page 45 and 46: Scoring Increasing number of shards
Page 47 and 48: Scoring Locality Sensitive Hashing
Page 49 and 50: Demo
Page 51 and 52: Future Work • Apache Solr version
Page 53: Thanks! https://github.com/MLnick/e

Recommender System with Apache Spark Apache Kafka and Elasticsearch

You also want an ePaper? Increase the reach of your titles

Delete template?

Save as template?