Add store: true
flag on each Singer tap to allow storing extracted data in internal storage for use in downstream task (i.e. without requiring a target task)
#41
Labels
kind/pending-feedback
Waiting for more feedback before starting some works
Extend each tap to allow storing data extracted from a tap (without schema information) to internal storage.
This task might either return:
The latter is preferable.
Ofc, this example is silly, as for Postgres there are already dedicated Query and CopyOut tasks, but for more complex source systems, this opens up the doors to useful patterns e.g. retrieving data from a specific system and then running tasks
ForEachItem
.Not a high priority for now, but worth keeping in mind the possibility.
The text was updated successfully, but these errors were encountered: