> Markdown version of [/jobs/ext/2043436-sr-aws-data-engineer](https://www.wearedevelopers.com/jobs/ext/2043436-sr-aws-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. AWS Data Engineer - **Company:** Acunor Inc - **Location:** Fort Mill, SC, United States - **Experience:** Expert - **Salary:** $80,000.0 - $165,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Amazon S3, Data Analysis, Batch Processing, Big Data, Continuous Integration, Data as a Services, Data Architecture, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Security, Cursor (Graphical User Interface Elements), Github, Monitoring of Systems, Identity and Access Management, Python (Programming Language), Key Management, PostgreSQL, Metadata, OAuth, Octopus Deploy, Operational Databases, Performance Tuning, SQL Databases, Tokenization, Workflow Management Systems, Parquet, Real Time Systems, Test-Driven Development (TDD), Microsoft Power Automate, Sql Optimization, GitHub Copilot, Snowflake, Apache Spark, Reliability of Systems, AWS Lambda, Git, Servicebus, Data Lakes, Pyspark, Deployment Automation, AWS Glue, AWS Data Analytics, Functional Programming, Cloudwatch, Terraform, Stream Processing, Data Pipelines, Servicenow - **Published:** August 13, 2026 - **Apply:** https://www.careerjet.com/jobad/us40ce31f55543ca1c5a97b2abd96d7683 ## About the Role * 10+ years of data engineering experience with production pipelines, ETL/ELT, and large-scale data migrations. * Strong hands-on Python and PySpark/Spark development experience, including AWS Glue ETL jobs for ingestion, transformation, and curation across data lake layers. * Production experience with AWS data services such as Glue, S3, IAM, Lambda, EventBridge, CloudWatch, logs/alerts, Secrets Manager, and Glue Data Catalog. * Experience with batch and event-driven data architectures, including near real-time processing patterns and pipeline design. * Glue Workflow and AWS Orchestrator experience, including workflow orchestration, triggers, dependencies, and cross-service orchestration across AWS services. * Advanced SQL skills with Postgres/PostgreSQL and/or Amazon Aurora, including complex transformations, performance tuning, validation, reporting, loading, and schema management. * Ability to manage metadata and schema definitions using AWS Glue Data Catalog to support governance and discoverability. * Strong understanding of migration reliability practices, including delta loads, reconciliation, error handling, restart/checkpointing, rollback planning, and idempotency. * Knowledge of data security, PII handling, encryption, tokenization, least-privilege access, secrets management, and metadata governance. * Hands-on CI/CD and Git experience using GitHub Actions, Octopus Deploy, or similar tools for deployment automation. * Infrastructure as Code experience with Terraform or similar tools. * Ability to monitor, troubleshoot, support, and remediate production data pipeline issues independently using AWS monitoring tools. * Ability to contribute to system reliability, scalability, and performance optimization of the data platform. * Experience using AI-assisted development tools such as GitHub Copilot, Microsoft Copilot, or Cursor AI to improve coding productivity, documentation, testing, and troubleshooting. * Strong collaboration skills with BI, analytics, Snowflake, and downstream data consumers. Preferred Skills * Snowflake experience, including data consumption, warehouse integration, and collaboration with downstream analytics or BI teams. * Experience with Athena Federated Query, Glue crawlers, Lake Formation, SNS, CloudTrail, Parquet, Iceberg, or Delta. * OAuth 2.0, secure API integration, tokenization, or regulated-data experience. * Financial services background; ServiceNow or formal change-management experience preferred. * Data modeling, partitioning, schema evolution, test-driven development, or static-analysis experience. * AWS certification is a plus. ## Description * Design, build, and support scalable data pipelines using AWS Glue, Lambda, and EventBridge for event-driven and batch processing. * Build and maintain AWS Glue ETL jobs using PySpark/Python for ingestion, transformation, and curation across data lake layers. * Develop and manage Glue Workflows and AWS orchestration to coordinate workflows, triggers, and dependencies across AWS services. * Implement near real-time data processing patterns using AWS Lambda and EventBridge. * Write, optimize, and maintain complex Postgres SQL for validation, transformation, reporting, and performance tuning. * Manage metadata and schema definitions in AWS Glue Data Catalog to support governance and discoverability. * Monitor and troubleshoot pipeline performance using CloudWatch, logs, alerts, and AWS monitoring tools. * Contribute to system reliability, scalability, and performance optimization of the data platform. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Keeping applications secure by evolving OAuth 2.0 and OpenID Connect](https://www.wearedevelopers.com/videos/100152-keeping-applications-secure-by-evolving-oauth-2-0-and-openid-connect) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)