ETL Data Engineer
GLOBAL TRANSGENDER SAFETY TASKS FORCE. USA INC
Austin, United States of America
yesterday
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Austin, United States of America
Tech stack
Java
Azure
Computer Engineering
Information Engineering
ETL
Github
Python
Metadata
Operational Databases
Scala
Software Deployment
Software Engineering
SQL Databases
Technical Data Management Systems
Cloud Platform System
Data Ingestion
Spark
Software Troubleshooting
Information Technology
Deployment Automation
Kafka
Data Management
Data Pipelines
Databricks
Requirements
- Bachelor's degree in Computer Science, Software Engineering, Computer Engineering, Electrical Engineering, or a related technical field, or equivalent practical experience.
- Strong experience building and supporting ETL/ELT pipelines and data platforms in cloud environments.
- Strong proficiency in Python, SQL, Spark, and Databricks for data engineering use cases.
- Experience with Azure Databricks, including notebooks, jobs/workflows, Unity Catalog, and production deployment patterns.
- Experience with CI/CD pipelines, GitHub-based workflows, and automated deployment of data products.
- Strong understanding of medallion architecture, data ingestion patterns, and batch/streaming tradeoffs.
- Experience working across architecture, product, and business teams to deliver reliable production data pipelines.
- Strong troubleshooting, communication, and technical leadership skills., * Experience with Scala, Java, Azure Event Hub, Kafka, or Pulsar in enterprise data pipeline environments.
- Experience with DLT, Auto Loader, structured streaming, and metadata-driven pipeline frameworks in Databricks.
- Experience with monitoring, observability, support operations, and production readiness reviews.
- Experience modernizing legacy ETL jobs or migrating on-prem data assets to cloud-native platforms.
- Familiarity with manufacturing data, plant-floor systems, industrial telemetry, or manufacturing analytics use cases.
- Experience working with globally distributed teams and multiple concurrent initiatives.