Skip to content

marouni/bigdataios

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

10 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

bigdataios

Comparing Bigdata IOs, the complete code examples of the my Scio vs. Beam talk that I gave for Nantes Scala User Group : https://blog.marouni.fr/nantes-scala-meetup/

How to run Spark Drivers

> sbt
> runMain DRIVER'S_FQCN --args

How to run Beam Drivers

> sbt
> runMain DRIVER'S_FQCN  --runner=direct --tempLocation=gs://datahubhouse/temp

How to run Scio Drivers

> sbt
> runMain DRIVER'S_FQCN --runner=direct --tempLocation=gs://datahubhouse/temp