> Markdown version of [/jobs/ext/2791981-data-engineer-iceberg](https://www.wearedevelopers.com/jobs/ext/2791981-data-engineer-iceberg). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer -Iceberg

- **Company:** American IT Systems
- **Location:** Atlanta, GA, United States
- **Experience:** Expert
- **Salary:** $144,000.0 - $210,000.0
- **Contract:** Permanent contract
- **Skills:** Airflow, Apache HTTP Server, Big Data, Computer Programming, Data Validation, Information Engineering, Extract Transform Load (ETL), Data Transformation, Data Security, Data Systems, Distributed Computing Environment, Python (Programming Language), Performance Tuning, Standard Sql, SQL Stored Procedures, SQL Databases, SQL Server Integration Services, Data Logging, Data Processing, Freeform SQL, Data Ingestion, Apache Spark, Software Troubleshooting, Data Lakes, Pyspark, Data Pipelines, Databricks
- **Published:** September 8, 2026
- **Apply:** https://www.careerjet.com/jobad/us505d5fc57320b90a70c6b52b8a18e788

## About the Role

* Strong hands-on experience with SQL
 * Strong programming experience with Python
 * Hands-on experience with Apache Spark / PySpark
 * Experience with Databricks
 * Strong experience with Apache Airflow
 * Hands-on experience with SSIS
 * Experience with Apache Iceberg
 * Strong understanding of ETL/ELT and data pipeline development
 * Experience working with large-scale datasets and distributed data processing
 * Strong troubleshooting and performance-tuning skills
 * Good understanding of modern data lake/lakehouse architectures

## Description

We are seeking an experienced Data Engineer with strong hands-on experience in SQL, Python, SSIS, Airflow, Apache Spark, Apache Iceberg, and Databricks. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines and data processing solutions in a cloud-based environment., * Design, develop, and maintain scalable ETL/ELT data pipelines using Python, SQL, SSIS, Airflow, and Spark.

 * Develop complex SQL queries, stored procedures, data transformations, and performance optimization solutions.
 * Build and maintain data pipelines and workflows using Apache Airflow, including scheduling, dependencies, monitoring, retries, and failure handling.
 * Develop and optimize Apache Spark/PySpark applications for large-scale data processing.
 * Work with Databricks to develop, deploy, and optimize data engineering workloads.
 * Work with Apache Iceberg tables and modern data lake/lakehouse architectures.
 * Migrate and modernize legacy SSIS ETL workflows into cloud-based and Spark/Databricks-based data pipelines.
 * Implement data ingestion, transformation, validation, and integration processes from multiple sources.
 * Optimize Spark jobs, SQL queries, data partitioning, and storage strategies for performance and scalability.
 * Implement data quality checks, error handling, logging, monitoring, and pipeline recovery mechanisms.
 * Collaborate with data architects, developers, analysts, and business teams to understand requirements and deliver reliable data solutions.
 * Follow best practices for data security, governance, performance, and operational reliability.


## Related Videos

- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)