datapains-argo-workflow

Requirements

• Kubernetes (docker-desktop, minikube, etc)
• Helm
• Make
• Argo CLI

Argo Workflow

make setup-local-argo-workflow

kubectl port-forward svc/argo-server -n argo 2746:2746

Access UI here.

See versions here.

Whiskey Extractor

Guide

• https://medium.com/@simon.thelin90/tutorial-data-product-building-e2e-step-2-whiskey-extractor-in-argo-workflow-d317e9d2f92b

make deploy-argo-workflow-chart CHART=whiskey-analytics

Update chart

make update-chart CHART=whiskey-analytics

Spark K8S Example

make deploy-argo-workflow-chart CHART=spark-k8s-example

Update chart

make update-chart CHART=spark-k8s-example