数据分析pipeline

[anneng]

https://towardsdatascience.com/data-pipelines-luigi-airflow-everything-you-need-to-know-18dc741449b7
Data pipelines, Luigi, Airflow: everything you need to know

https://medium.com/@jfeala/hi-joe-7bcc561afc25
WDL/CWL、Tail、Seven Bridges, DNAnexus, Curaverse
NextFlow
Luigi Prefect Airflow

https://www.datarevenue.com/en-blog/airflow-vs-luigi-vs-argo-vs-mlflow-vs-kubeflow
Airflow vs. Luigi vs. Argo vs. MLFlow vs. KubeFlow

[anneng]

https://www.nextflow.io/docs/latest/kubernetes.html

nextflow支持k8s