Skip to content

A full end-to-end serverless pipeline to read Tweets and send them to BigQuery and Firestore/Firebase

License

Notifications You must be signed in to change notification settings

servian/gcp-serverless-twitter-pipeline

Repository files navigation

gcp-serverless-twitter-pipeline

A full end-to-end serverless pipeline to read Tweets and send them to BigQuery and Firestore/Firebase

Note that the below image/architecture does not include Dataflow -> PubSub -> Cloud Function -> Firestore (for brevity's sake it only showed Dataflow to Firestore). Also, the ML component doesn't exist yet off the back of BigQuery, but this could be simply BigQueryML.

Screen Shot 2019-03-14 at 3 06 03 pm

To deploy:

gcloud builds submit --config=cloudbuild.yaml .

About

A full end-to-end serverless pipeline to read Tweets and send them to BigQuery and Firestore/Firebase

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 4

  •  
  •  
  •  
  •