Lead Data Engineer

BCforward
Columbus, OH, United States
1 day ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Airflow Amazon Web Services Automation of Tests Continuous Integration Information Engineering Extract Transform Load (ETL) Software Engineering Parquet Snowflake Apache Spark Data Lakes
+6 more
Avro Apache Kafka Spark Streaming Restful APIs Data Pipelines Control M

Job description

  • Lead design and delivery of large-scale ETL/ELT pipelines and data lake solutions
  • Build and tune distributed workloads in Apache Spark (Parquet, Avro)
  • Develop Java-based services and REST APIs that support data workflows
  • Drive CI/CD, automated testing, observability and secure-by-design practices
  • Coach engineers on safe, effective use of AI-assisted development tools

Requirements

  • 10+ years in software engineering, with deep data engineering experience
  • Strong Java and Python
  • AWS
  • Hands-on experience leading AI-assisted development tools

Nice to have

  • Snowflake, Airflow/Dagster/Control-M, Kafka or Spark Structured Streaming
  • Delta Lake, Iceberg or Hudi
  • Regulated-environment experience (PII, audit, compliance)

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Loading talks and stories from around this role…