> Markdown version of [/jobs/ext/2055128-data-engineer](https://www.wearedevelopers.com/jobs/ext/2055128-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Everforth Apex - **Location:** Greenwood Village, CO, United States (Remote available) - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon S3, Automation of Tests, Batch Processing, Big Data, Computer Programming, System Configuration, Continuous Integration, Data Architecture, Data Validation, Data Infrastructure, Data Integration, Data Integrity, Extract Transform Load (ETL), Data Warehousing, Relational Databases, Linux, Distributed File Systems, Python (Programming Language), NoSQL, Shell Script, Simple Network Management Protocols, Data Streaming, Workflow Management Systems, Parquet, Data Processing, Computer Network Operations, Data Storage Technologies, Data Ingestion, Delivery Pipeline, Apache Spark, Boto3, Git, Data Lakes, Apache Kafka, Spark Streaming, Virtual Agents, Text Analysis, Restful APIs, Software Version Control, Data Pipelines - **Published:** August 14, 2026 - **Apply:** https://www.dice.com/job-detail/845d9a09-fa3d-4375-978b-d8d6be5ab2e4 ## About the Role * Expert-level experience in building and maintaining ETL pipelines for Big Data. * Programming experience with Python and/or Scala. * Experience with large-scale data processing with Spark. * Experience with AWS services: S3, Glue, Athena, and EMR, including working with EMR as the operating system. * Strong understanding of relational databases and SQL. * Knowledge of data architecture, data warehousing, partitioning strategies, and columnar storage formats (e.g., Parquet). * Experience with workflow orchestration tools, with a preference for Airflow. * Proficiency with Linux-based operating systems and shell scripting. * Experience with Git-based version control and collaborative development workflows., * Experience with streaming or mini-batch data processing (Spark Streaming, structured streaming, or similar). * Experience with Apache Kafka or similar messaging/streaming platforms. * Experience with NoSQL databases. * Experience in the telecommunications industry or other large-scale network operations environments. * Familiarity with network data sources: telemetry, syslogs, SNMP traps, device configuration data. * Experience with data integration via REST APIs and cloud SDKs (e.g., boto3). * Experience writing automated tests for data pipelines. * Knowledge of text analysis or log parsing techniques. ## Description This role is for a Data Engineer to design, build, and maintain the ETL pipelines and data infrastructure that feed a data lake, anomaly detection models, and AI agents. The position focuses on constructing robust, scalable data pipelines using Spark/Scala, ensuring data quality and availability across a growing portfolio of network data sources. The goal is to enable downstream consumers such as data scientists, agents, and dashboards to access reliable, well-structured data., * Design, develop, and maintain scalable ETL pipelines using Apache Spark (Scala) to ingest, transform, and load network data into the data lake. * Onboard new data sources (network telemetry, syslogs, SNMP traps, device configuration data, ticketing systems) by building ingestion pipelines. * Implement monitoring and alerting solutions to ensure data pipeline reliability and performance. * Develop and manage deployment pipelines for continuous integration and delivery of data engineering solutions. * Manage and optimize data storage solutions, including distributed file systems, relational databases, and external sources accessed via API. * Implement data quality checks, validation rules, and automated testing to ensure pipeline reliability and data integrity. * Optimize pipeline performance for large-scale data processing across batch and mini-batch processing patterns. * Manage and evolve data schemas, partitioning strategies, and storage formats. * Support data backfills and recovery when upstream issues or schema changes require reprocessing. * Collaborate with data scientists and agent developers to deliver datasets that support anomaly detection models and AI agent workflows. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Docker network without Docker](https://www.wearedevelopers.com/videos/1418-docker-network-without-docker) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)