Lead Data Engineer
BCforward
Columbus, OH, United States
1 day ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerboard.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source
Tech stack
Java (Programming Language)
Airflow
Amazon Web Services
Automation of Tests
Continuous Integration
Information Engineering
Extract Transform Load (ETL)
Software Engineering
Parquet
Snowflake
Apache Spark
Data Lakes
+6 more
Avro
Apache Kafka
Spark Streaming
Restful APIs
Data Pipelines
Control M
Job description
- Lead design and delivery of large-scale ETL/ELT pipelines and data lake solutions
- Build and tune distributed workloads in Apache Spark (Parquet, Avro)
- Develop Java-based services and REST APIs that support data workflows
- Drive CI/CD, automated testing, observability and secure-by-design practices
- Coach engineers on safe, effective use of AI-assisted development tools
Requirements
- 10+ years in software engineering, with deep data engineering experience
- Strong Java and Python
- AWS
- Hands-on experience leading AI-assisted development tools
Nice to have
- Snowflake, Airflow/Dagster/Control-M, Kafka or Spark Structured Streaming
- Delta Lake, Iceberg or Hudi
- Regulated-environment experience (PII, audit, compliance)
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerboard.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦