How to map reduce data for routing graph generation, LOOM, and other timetable/transfer processing?

[kylerchin]

I want to map reduce the generation but I'm not sure how to chop up and process our thousands of zip files and process them.

Some sort of splitting and processing has to occur.

Loom discussion might also occur in #15

[chw-03]

METIS is very popular but Bast used merge-based in Scalable Transfer Patters

[kylerchin]

How do I go from a pile of 100 Gigabytes of data and split it up so I can perform the analysis in chunks? That's my question basically, I suppose I have to write a program that does like a geographical split

[kylerchin]

Keywords for papers:

map reduce geographical data graph algorithm preprocessing

map reduce spatial data graph algorithm

[chw-03]

Wake up kyler! new google docs just dropped
Map Reduce Partitioning in Distributed Systems: link