Data Engineer / Data Platform Engineer

The purpose of the role is to provide hands-on engineering support for data platform modernization, migration, and reliability efforts. The role is needed to reduce operational support load, modernize legacy Hadoop/Hive/Airflow workloads, and help move data-platform capabilities toward Snowflake, Confluent, AWS., * Help migrate infrastructure and data-platform workloads from legacy infrastructure to modern infrastructure.

• Help move the data-platform infrastructure and workloads to AWS us-east-2 (USE2), including required connectivity, deployment, and operational prerequisites.
• Enable secure, governed accessibility of legacy data to target data-platform consumers and downstream systems.
• Modernize the data-platform architecture, tooling, orchestration, storage, and operational practices to align with company standards.
• Support Snowflake, Confluent/Kafka, AWS, and data-platform infrastructure migration and operations across stage and production.
• Participate in production troubleshooting, incident response, documentation, runbook creation, and cross-team migration coordination.
• Use Terraform/IaC, GitLab, monitoring and documented processes to deliver repeatable and auditable changes.

Certain Advantage are seeking Data Engineers with strong senior-level, hands-on experience in production data-platform engineering, with a platform/DevOps-leaning background., * Senior-level, hands-on experience in production data-platform engineering, with a platform/DevOps-leaning background and strong data experience.

• Strong Python, bash and SQL skills
• Production experience with both Snowflake and Confluent/Kafka, with a focus on DevOps and operations. (Deep experience in one and working knowledge of the other is fine, i.e.
• Deep Snowflake and AWS, with working Kafka knowledge (topics, connectors, schemas), OR
• Deep Kafka/Confluent and AWS, with working Snowflake knowledge.
• Experience operating or migrating production systems across development, stage and production environments.
• Strong troubleshooting, incident-response, testing, documentation and cross-team communication skills.
• Experience with least-privilege access, change control, secrets handling and secure operational practices.

The below are “Nice-to-Have” Skills - so don’t forget to highlight any of these!

• Apache Spark and Hadoop/Hive/HQL, including modernizing or migrating legacy workloads
• Snowpark, dbt alternatives, AWS Glue, Monte Carlo, or other data-quality and catalog tools
• Migrating legacy Airflow, Hadoop or Hive workloads to cloud-native or managed platforms
• Experience working across a company migration or acquisition and aligning systems to a new organization’s standards
• Familiarity with Snowflake-to-Iceberg or Snowflake-to-data-lake migration patterns.