> Markdown version of [/jobs/ext/1281285-lead-aws-glue-developer](https://www.wearedevelopers.com/jobs/ext/1281285-lead-aws-glue-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead AWS Glue Developer - **Company:** Insight Global - **Location:** Town and Country, MO, United States - **Experience:** Expert - **Salary:** $30,000.0 - $35,000.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Amazon S3, Automation of Tests, Cloud Computing, Cloud Engineering, Code Review, Information Engineering, Data Governance, Data Integration, Extract Transform Load (ETL), Software Debugging, DevOps, File Systems, Amazon DynamoDB, Github, JSON, Python (Programming Language), Meta-Data Management, Metadata Repositories, Performance Tuning, Regression Testing, Amazon Simple Notification Service (SNS), Software Engineering, Systems Integration, S3 Bucket, Data Processing, File Transfer Protocol (FTP), GitHub Copilot, Apache Spark, Software Troubleshooting, AWS Lambda, Infrastructure as Code (IaC), Cloudformation, Event Driven Architecture, Pyspark, Integration Tests, Infrastructure Automation Frameworks, Deployment Automation, AWS Glue, Maintaining Code, Integration Frameworks, AWS Data Analytics, Functional Programming, Cloudwatch, Amazon Simple Queue Service (SQS), Software Version Control, Data Pipelines, Serverless Computing - **Published:** July 15, 2026 - **Apply:** https://jobs.insightglobal.com/jobs/find_a_job/missouri/town-and-country/lead-aws-glue-developer/job-550619/ ## About the Role 8+ years of software engineering or data engineering experience. 5+ years of hands-on AWS development experience. Strong expertise with: AWS Glue AWS Lambda Amazon S3 Amazon DynamoDB AWS CloudFormation AWS CodeCommit Python Apache Spark / PySpark Experience building serverless and event-driven architectures. Strong understanding of JSON data structures and APIs. Experience developing and deploying Infrastructure-as-Code solutions. Experience building and supporting ETL and data integration pipelines. Strong troubleshooting, debugging, and performance optimization skills. Experience writing automated unit and integration tests. Preferred Qualifications AWS Certified Data Engineer, Solutions Architect, or Developer certification. Experience with additional AWS services such as Step Functions, EventBridge, SNS, SQS, CloudWatch, or Redshift. Experience working in Agile/Scrum environments. Familiarity with GitHub and modern source control practices. Knowledge of data governance, security, and compliance requirements. Experience leading development teams and technical projects. AI & Productivity Expectations Comfortable using GitHub Copilot to accelerate software development and improve developer productivity. Ability to leverage AI-assisted coding tools while maintaining code quality, security, and performance standards. Interest in applying emerging AI-enabled development practices to cloud engineering and data engineering workflows. ## Description We are seeking a Lead AWS Glue Developer to design, build, and maintain scalable cloud-native data integration and ETL solutions within AWS. This role will lead the development of serverless data pipelines, automate cloud infrastructure deployment, and build robust data processing frameworks leveraging AWS Glue, AWS Lambda, DynamoDB, S3, and related AWS services. The ideal candidate will have deep expertise in AWS data engineering, Infrastructure as Code (IaC), Python development, and modern DevOps practices. Experience with AWS Glue, Lambda, CloudFormation, S3, and DynamoDB aligns closely with capabilities referenced in internal AWS engineering profiles., AWS Data Engineering & ETL Development Design, develop, and optimize AWS Glue ETL jobs using Python and Apache Spark. Build scalable batch and event-driven data processing solutions. Develop and maintain data pipelines that ingest, transform, validate, and load data into AWS data stores. Create and manage AWS Glue Data Catalogs, crawlers, and metadata management processes. Implement data quality controls, monitoring, and exception handling throughout ETL workflows. Serverless Application Development Develop AWS Lambda functions to automate file processing and event-driven workflows. Build solutions that process files dropped into S3 buckets and orchestrate movement of data into DynamoDB tables and downstream systems. Implement integrations between S3, Lambda, DynamoDB, and other AWS services. Troubleshoot, optimize, and enhance serverless applications for performance and reliability. Cloud Infrastructure & DevOps Create and maintain AWS CloudFormation templates to automate infrastructure provisioning and deployment. Configure and manage AWS CodeCommit repositories and CI/CD pipelines. Establish and maintain AWS environments following Infrastructure-as-Code best practices. Set up and administer S3 buckets, SFTP services, access controls, encryption, and lifecycle management policies. Collaborate with DevOps teams to automate deployments and improve platform reliability. Technical Leadership Provide technical leadership and architectural guidance to development teams. Lead code reviews and establish development standards and best practices. Mentor junior developers and data engineers. Collaborate with architects, business stakeholders, and product teams to define technical solutions. Drive performance tuning, scalability improvements, and cloud modernization initiatives. Testing & Quality Engineering Write comprehensive unit, integration, and regression tests for AWS Lambda functions and AWS Glue jobs. Implement automated testing strategies within CI/CD pipelines. Ensure high code quality, security compliance, and operational excellence. ## Related Videos - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [30 powerful AWS hacks in just 30 minutes: Boost your developer productivity](https://www.wearedevelopers.com/videos/1624-30-powerful-aws-hacks-in-just-30-minutes-boost-your-developer-productivity) - [Introducing JSON Structure](https://www.wearedevelopers.com/videos/100219-introducing-json-structure) - [The Future of Developer Experience with GenAI: Driving Engineering Excellence](https://www.wearedevelopers.com/videos/1107-the-future-of-developer-experience-with-genai-driving-engineering-excellence) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [What is Software Engineering in the Age of AI?](https://www.wearedevelopers.com/magazine/640-what-is-software-engineering-in-the-age-of-ai) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline)