> Markdown version of [/jobs/ext/2608114-telecommute-data-engineer-iceberg-migration](https://www.wearedevelopers.com/jobs/ext/2608114-telecommute-data-engineer-iceberg-migration). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # TELECOMMUTE Data Engineer (Iceberg Migration) - **Company:** iTech US, Inc. - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Amazon S3, Apache HTTP Server, Big Data, Information Systems, Data Governance, Data Infrastructure, Data Integrity, Data Security, Database Queries, Distributed Computing Environment, Python (Programming Language), Meta-Data Management, Scripting, Apache Spark, Build Management, Data Lakes, Information Technology, AWS Glue, AWS Data Analytics, Data Pipelines - **Published:** August 31, 2026 - **Apply:** https://www.dice.com/job-detail/07d58883-e8ad-4637-9412-dae414f0af63 ## About the Role Strong, hands-on knowledge of Apache Iceberg internals (table format, metadata management, snapshots, partitioning, schema evolution) Proven experience performing Delta-to-Iceberg migrations at scale Experience with AWS Lake Formation for access control and data governance Practical experience implementing or preserving Row-Level Security (RLS) and Column-Level Security (CLS) Experience with GDC (Global/Governed Data Catalog) or equivalent data cataloging/governance systems Solid understanding of distributed data processing and large-scale data migration challenges Strong SQL skills and experience with table format internals (Delta Lake, Iceberg, or similar) Preferred Qualifications Experience with Spark for large-scale data processing and migration tooling Familiarity with AWS data platform services (S3, Glue, Athena) Experience with data governance frameworks and compliance-driven access control requirements Prior experience building reusable migration frameworks or tooling for table format conversions Scripting/automation experience (Python, Scala) for migration validation and tooling, Education: At least a bachelor s degree (or equivalent experience) in Computer Science, Software/Electronics Engineering, Information Systems, or a closely related field is required for the project ## Description Must Have skills: Hands-on data engineer with strong Python skills and experience building large scale Apache Spark pipelines on AWS. Deep platform fluency across the modern data lake stack,S3, Glue Data Catalog, Athena, EMR, and Redshift, with a focus on reliable ingestion, transformation, and validation at scale. Project: The client has a central data platform built on AWS Glue Data Catalog. They've developed a fine-grained data access control (FGAC) system that is now being adopted across various data-producing teams. As part of this adoption, each application team must review their data pipelines to identify queries affected by the new access controls, and modify the queries they own accordingly. Please find JD here: Delta-to-Iceberg Migration Design and build a migration feature/framework to convert tables from Delta Lake format to Apache Iceberg at scale Leverage deep understanding of Iceberg internals (metadata layers, manifests, snapshots, partitioning, schema evolution) to ensure correct and efficient migration Validate data integrity, schema fidelity, and partitioning strategy parity between source Delta tables and migrated Iceberg tables Optimize migration processes for performance and reliability across large volumes of tables and data Identify and resolve edge cases, compatibility issues, or performance bottlenecks during migration at scale FGAC (Fine-Grained Access Control) Ensure Row-Level Security (RLS) and Column-Level Security (CLS) policies are correctly preserved or re-implemented on migrated Iceberg tables Integrate migration workflows with AWS Lake Formation to maintain governance and access control continuity Collaborate with security/governance teams to validate that FGAC policies enforce correctly post-migration Support GDC (Global Data Catalog / Governed Data Catalog) integration to ensure migrated tables remain properly cataloged and governed Build validation/reconciliation tooling to confirm access control parity between pre- and post-migration states General Responsibilities Document migration architecture, access control mapping logic, and operational runbooks Collaborate with data platform, governance, and security teams throughout the migration lifecycle Monitor and troubleshoot production issues related to migrated tables and access enforcement Contribute to best practices and reusable tooling for future Delta-to-Iceberg migration phases ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Swapping a Data Warehouse at Runtime: Zero-Downtime Migration Without Changing a Single Client](https://www.wearedevelopers.com/videos/100311-swapping-a-data-warehouse-at-runtime-zero-downtime-migration-without-changing-a-single-client) - [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours) - [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Tips, Techniques, and Common Pitfalls Debugging Kafka](https://www.wearedevelopers.com/videos/838-tips-techniques-and-common-pitfalls-debugging-kafka) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)