-
Data Pipeline Architect
Data Pipeline Architect
A Luigi Task Which Uses Multiple Outputs of Other Task
If you want to have a single Luigi Task consume data from multiple other
dependencies, you can simply do so by specifying...
-
Data Pipeline Architect
Data Pipeline Architect
How Should the Analytics Team Access Data?
You are probably the first data person at a growing company. The team is doing an excellent job, people love the product and the futu...
-
Data Pipeline Architect
Data Pipeline Architect
3 Tools for Combining Multiple Data Sources
How to combine data from multiple sources into one place, so it can be queried quickly and will be safe in the long run? What is pop...
-
Data Pipeline Architect
Data Pipeline Architect
Extract,
Transform and
Load. ETL tools and frameworks are meant to do basic data plumbing: ingest data from many sources, perform some basic operations on it and finally save...
-
Data Pipeline Architect
Data Pipeline Architect
Being New to Luigi, How Do I Get Started Without Hitting Roadblocks?
You have read about Luigi and now would like to put it to use.
You could just jump into it, Trying to get i...
-
Data Pipeline Architect
Data Pipeline Architect
Try Luigi with Vagrant!
"Never bake your own ETL pipeline" seems to be a piece of advice, which most people working with data can whole-heartedly agree on.
So, what are the opt...