Data Engineers
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+37 more
Job description
This professional engagement requires two senior data engineering professionals to accelerate the development, validation, and production rollout of enterprise data migration utilities and analytical pipelines. Selected candidates will design and build robust, Python- and Java-based ETL pipelines to ingest, format, and harmonize data from multiple source systems into Databricks (Lakehouse/Delta Lake). The position involves developing downstream analytics and business intelligence reports while collaborating cross-functionally across multiple interface and platform teams to gather requirements, conduct data validation, and ensure smooth operational productionalizing., * Design, build, and optimize enterprise-grade ETL/ELT pipelines and utilities using Python (PySpark, Pandas) and Java (Spring Framework/Core Java).
- Extract, transform, and clean structured and semi-structured datasets from diverse databases and enterprise applications.
- Ingest and catalog data into Databricks Delta Lake, ensuring performance, data integrity, and compliance with data architecture standards.
- Build semantic data layers, views, and aggregate tables within Databricks to power business intelligence dashboards and operational reporting.
- Develop and deliver analytical reporting solutions, including Databricks SQL Dashboards, Power BI, or enterprise equivalents, for stakeholders.
- Partner with upstream source system owners, interface teams, and platform engineering groups to capture requirements, schema definitions, and validation criteria.
- Coordinate end-to-end integration testing, data reconciliation, and sign-offs between legacy source platforms and modern target platforms.
- Operationalize data pipelines by establishing robust error handling, automated retry logic, logging, and data monitoring.
- Package and deploy code through enterprise CI/CD workflows utilizing GitHub Actions, Jenkins, Azure DevOps, or ArgoCD.
- Troubleshoot complex end-to-end issues across application, middleware, data lakehouse, and infrastructure layers.
Requirements
Education: A bachelor’s degree in Computer Science, Information Technology, or a related technical discipline is preferred.
Experience: Six to eight plus years of progressive software engineering and data engineering experience in enterprise environments, including a proven track record of implementing legacy-to-cloud data migration utilities and multi-source ETL pipelines.
Technical Skills: Deep hands-on experience developing in Databricks, Delta Lake, Unity Catalog, Databricks Workflows/Jobs, and Spark SQL. Advanced proficiency in Python (PySpark, modular OOP scripting) and strong core Java proficiency (Spring Boot, REST APIs, or batch integration). Advanced SQL and PL/SQL capabilities across relational databases such as Oracle, SQL Server, and PostgreSQL are required, along with proficiency in GitHub and automated CI/CD pipelines.
Preferred Qualifications
- Hands-on exposure to Kubernetes or Docker containers for microservices and utility hosting.
- Familiarity with Event Hub, Kafka, or message broker patterns for near-real-time ingestion feeds.
- Basic understanding of Angular UI or similar web interfaces for administrative consoles and utility monitoring frontends.
- Practical experience delivering reporting models in Databricks SQL, Tableau, or Power BI.
About the company
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at, UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Everforth Apex Systems.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…