Astronomer Architect - Apache Airflow

Northern Base
Plano, TX, United States
18 days ago
Apply on www.careerjet.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Microsoft Azure BigQuery Cloud Computing Data Governance Disaster Recovery Identity and Access Management Python (Programming Language) Key Management Octopus Deploy OpenID
+21 more
Performance Tuning Role-Based Access Control Prometheus Cloudera Runbook Workflow Management Systems Policy as Code Data Logging Statsd System Availability Snowflake Grafana Apache Spark Kubernetes Helm Charts Electronic Medical Records Kubernetes Information Technology Data Management Terraform Amazon Redshift Databricks

Requirements

Must-Have Skills: Apache Airflow Architecture, Administration & Production Support Airflow on Kubernetes Airflow DAG Design, Testing & Optimization Python Development, Custom Operators & Hooks Kubernetes, Helm Charts & Container Orchestration Terraform & Infrastructure as Code GitOps, Argo CD / Flux & CI/CD Pipelines Airflow High Availability, Upgrades & Performance Tuning Observability Tools: Prometheus, Grafana, StatsD & Centralized Logging Workflow Reliability, Idempotency, Retries & Backfills Dynamic Task Mapping, Deferrable Operators & Sensors AWS / Azure / GCP Cloud Platforms Data Platforms: Snowflake, BigQuery, Redshift, Databricks, Spark, EMR / Dataproc Security: SSO / OIDC, RBAC, Secrets Management & IAM Incident Management, Root Cause Analysis & Runbook Automation Enterprise-Scale Workflow Orchestration & Platform Engineering Preferred Experience: Airflow Migration and Multi-Scheduler Ecosystems OpenLineage, Marquez & Data Quality Frameworks dbt Core / Cloud Orchestration Multi-Region High Availability, Disaster Recovery & Backup Strategies Cost Optimization and Scheduler / Worker Capacity Planning Internal Developer Platforms and Self-Service Pipeline Tooling Apache Airflow Contributions and Airflow 2.7+ Features Policy as Code: OPA, Gatekeeper & Conftest Strong Cross-Functional Collaboration, Technical Leadership & Mentoring Education: Bachelor’s Degree in Computer Science or a related field.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com
Prepare application

Good distractions

Loading talks and stories from around this role…