> Markdown version of [/jobs/ext/2705837-data-engineer-technology](https://www.wearedevelopers.com/jobs/ext/2705837-data-engineer-technology). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer Technology - **Company:** Neptune and Company, Incorporated - **Location:** Duluth, GA, United States - **Experience:** Experienced - **Salary:** $35,360.0 - $52,000.0 - **Contract:** Permanent contract - **Skills:** Query Performance, Agile Methodology, Artificial Intelligence, Airflow, Amazon S3, Apache HTTP Server, Databases, Continuous Integration, Data Architecture, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Transformation, Data Warehousing, Relational Databases, Database Queries, Amazon DynamoDB, Python (Programming Language), MySQL, Message Queuing Telemetry Transport (MQTT), Online Analytical Processing, NoSQL, Scrum Methodology, Software Engineering, SQL Stored Procedures, SQL Databases, SQL Server Integration Services, Data Streaming, Delivery Pipeline, Pyspark, Information Technology, Druid, Apache Flink, AWS Glue, Apache Kafka, Code Inspection, Spark Streaming, Vertica, DocuSign, Stream Processing, Data Pipelines - **Published:** September 4, 2026 - **Apply:** https://www.jofdav.com/jobs/59538294-data-engineer-technology ## About the Role * Bachelor's degree in Computer Science, Engineering, or related field. 2-4 years of experience in data engineering roles., * Working experience with AWS Glue (PySpark/Python), S3, and Redshift. Docusign Envelope ID: 3DB5DE32-5404-82BD-80A4-A92CE5E89F74 * Hands-on experience migrating or supporting the migration of ETL workloads from legacy tools (SSIS, stored procedures, or similar) to modern cloud-native pipelines. * Strong SQL skills with best practices and SQL linting, particularly in Redshift or other columnar/MPP databases. * Experience with or strong interest in stream processing frameworks (Flink, Spark Streaming, Kafka Streams, or similar). * Familiarity with data pipeline orchestration, monitoring, and error handling patterns. * Familiarity with infrastructure-as-code and CI/CD concepts as applied to data pipelines. Desired Skills: * Experience with Aurora MySQL or other relational databases, and NoSQL such as DynamoDB. * Hands-on experience with near real-time OLAP engines (ClickHouse, Apache Druid, or similar). * Exposure to streaming data infrastructure (Kinesis, Kafka, MQTT). * Familiarity with IoT or utility/metering data. * Experience with dbt, Airflow, or Step Functions. * Strong communication skills, with the ability to explain complex data architecture concepts to technical and non-technical stakeholders. * A working understanding of software development methodologies (Agile, Scrum, etc.). * Strong problem-solving abilities and a drive for results. ## Description immediate mission: support the migration of ETL workloads out of Redshift stored procedures and legacy SSIS packages into scalable, maintainable pipelines using AWS Glue and S3. The longer-term vision: help us evolve from batch-oriented processing toward near real-time analytics using stream processing technologies like Apache Flink and ClickHouse, among others. You will be embedded in a cross-functional engineering team, working alongside senior engineers to build pipelines and grow your expertise in modern cloud-native data architecture. Objectives: * Build and maintain modern ETL/ELT pipelines using AWS Glue, S3, and related services to help replace legacy stored procedures and SSIS jobs. * Develop data transformation workflows that are testable, version-controlled, and observable. * Help maintain our Redshift data warehouse, including materialized views, query performance, and cost efficiency. * Support the evolution from batch ETL to near real-time stream processing, assisting with the evaluation and implementation of technologies such as Apache Flink, ClickHouse, Kafka, Kinesis, or equivalent platforms. * Design pipelines that support both near real-time and batch workloads as the platform transitions. * Collaborate with product and analytics teams to help ensure data models support reporting, AI/ML, and customer-facing features. * Follow and help refine established patterns and best practices for pipeline development. * Participate in production support and incident response for data infrastructure. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [MySQL Protocol Features You Should Be Aware Of](https://www.wearedevelopers.com/videos/100267-mysql-protocol-features-you-should-be-aware-of) - [Tomorrow's cloud data platforms - fully managed database-as-a-service (DBaaS)](https://www.wearedevelopers.com/videos/254-tomorrow-s-cloud-data-platforms-fully-managed-database-as-a-service-dbaas) - [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 162: AI careers, MCP, AWS best practices & floppy sweaters](https://www.wearedevelopers.com/magazine/571-dev-digest-162-ai-careers-mcp-aws-best-practices-floppy-sweaters) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)