Jump to content

Helm/Upstream Charts/spark-operator

From Wikitech

Chart name: spark-operator

Chart version: v2.2.1

Phab task: https://phabricator.wikimedia.org/T405492

Reviewers: Ben Tullis, TBD

Link to repo: https://github.com/kubeflow/spark-operator/tree/v2.2.1/charts/spark-operator-chart

Link to source code: https://gerrit.wikimedia.org/r/c/operations/deployment-charts/+/1191139

Topics:

  • data-engineering

n.b. This is to replace our own custom chart that was developed as part of task T318926

However, the RBAC of the upstream chart has been substantially improved since then, not least by https://github.com/kubeflow/spark-operator/issues/1977

Decision: [pass]

Reasoning:

The quality and functionality is significantly better than our home-grown version of this chart and since its adoption by Kubeflow, the spark-operator has enjoyed moce more community support. Notably, the RBAC configuration is much better than it was when last examined.