Discussion about this post

User's avatar
Ran's avatar

The most brilliant article ever. Consider me a disciple.

I do have a quibble with the title though. You are (rightly!) calling for Pull based DAG execution instead of the Push execution (as in dbt run). The DAG itself is still invaluable, the problem is the push (vs. pull) orchestration model.

Expand full comment
Andrew Padilla's avatar

Sounds like you are proposing a declarative approach to data orchestration which would be similar to how kubernetes approaches container orchestration in that you declare. a desired state and the system figures out how to get to that desired state.

Expand full comment
25 more comments...

No posts