Data Engineering/Currently working on

From Wikitech
Jump to navigation Jump to search
Data Engineering logo.png

Currently Working On

  • Airflow - This is the job scheduler that will be executing our analytics tasks and pipelines
  • Datahub - This is a metadata catalog that will be used as the canonical reference to the datasets owned by the Foundation