GitHub - funtusov/Web2Mongo: a simple library that gets the http, parse it and saves to mongodb

funtusov / Web2Mongo Public

Notifications You must be signed in to change notification settings
Fork 0
Star 2

a simple library that gets the http, parse it and saves to mongodb

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
README		README
imdb.rb		imdb.rb

Repository files navigation

A small library that downloads web pages, parse them and saves the needed data in mongodb.

Uses HPricot.

Right now it's parsing IMDB movies, using simple multithreading, it's a quick trial of some functions. The IMDB part was inspired by an article that used the technique. I wondered it threading and mongodb from there.