Skip to content

Network Based Recommendation Engine using Map-Reduce (in Python) to run on top of Hadoop!

Notifications You must be signed in to change notification settings

harshvladha/Recommendation-Algorithm

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

24 Commits
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Recommendation Algorithm - Recommendation Engine for everything!

Join the chat at https://gitter.im/harshvladha/RecommendMe Network Based Recommendation Engine using Map-Reduce (in Python) to run on top of Hadoop!

The recommendation engine is divided into three parts :

  1. Pre-process Job
  2. Resource Allocation Job
  3. Recommendation Job

Each job has their own mapper and reducer.

MongoDB is used in this version for real-time data storage and streaming.

Algorithm explanation link

Movie-Lens data set : ml-1m is used as reference!

Hadoop Streaming

To run python map-reduce programs we need Hadoop Streaming. Command for hadoop streaming is inside bin directory of this project, please replace directories as per your need.

About

Network Based Recommendation Engine using Map-Reduce (in Python) to run on top of Hadoop!

Resources

Stars

Watchers

Forks

Packages

No packages published