> Markdown version of [/jobs/ext/2735661-aws-data-engineer-open-data-platform](https://www.wearedevelopers.com/jobs/ext/2735661-aws-data-engineer-open-data-platform). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# AWS Data Engineer - Open Data Platform

- **Company:** SWIFT
- **Location:** New York, NY, United States
- **Experience:** Expert
- **Salary:** $80,000.0
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Apache HTTP Server, Big Data, Cloud Database, Identity and Access Management, Open Data Protocol, Performance Tuning, Cloud Platform System, Data Ingestion, Snowflake, Apache Spark, AWS Glue, AWS Data Analytics, Virtual Agents, Data Pipelines
- **Published:** September 5, 2026
- **Apply:** https://www.careerjet.com/jobad/us86bd9c838addc297c3757f8b0c0f6643

## About the Role

Strong hands-on experience with Amazon S3, AWS Glue, Apache Spark, Iceberg, IAM, and AWS networking.
Experience designing and implementing cloud-based data pipelines and large-scale data processing solutions.
Good understanding of Apache Iceberg architecture, table maintenance, schema evolution, partitioning, and performance optimization.
Should have Install/configuration experiance in Apache Polaris and Iceberg over Amazon S3 files.

## Description

We are seeking an experienced AWS Data Engineer to support the design and implementation of an AWS-based open data platform. The role will focus on building scalable data pipelines and integrating Amazon S3, AWS Glue, Apache Iceberg, and Apache Polaris with Snowflake and other analytics platforms., Design and develop data ingestion, transformation, and processing pipelines using AWS Glue, Apache Spark, and Amazon S3.
Build and manage Apache Iceberg tables supporting open, interoperable access across multiple compute engines.
Configure and integrate Apache Polaris to Iceberg REST Catalog with AWS and Snowflake.
Support platform security, access controls, networking, performance optimization, and operational monitoring.
Participate in workload benchmarking and evaluate the cost and performance of AWS Glue versus Snowflake., Senior. Distinguished AI Engineer - Agentic AI Platform (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years,…

 + 2 days ago
+


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours)
- [WeAreDevelopers LIVE - CSS is DOOMed](https://www.wearedevelopers.com/videos/1838-wearedevelopers-live-css-is-doomed)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)