Data Engineer 5
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+29 more
Job description
An experienced Data Engineer is required to support critical data and analytics initiatives. This position involves collaborating with multiple stakeholders to design, develop, and optimize large-scale software solutions. The successful candidate will bring deep technical expertise to a dynamic team environment, operating on-site from Monday through Thursday with remote flexibility on Fridays during standard business hours., * Contribute to the design and implementation of data products and features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology.
- Contribute to the overall architecture, frameworks, and patterns for processing and storing large data volumes.
- Contribute to the evaluation of new technologies, tools, and frameworks centered around high-volume data processing.
- Translate product backlog items into logical units of work in engineering.
- Implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem.
- Build utilities, user-defined functions, libraries, and frameworks to better enable data flow patterns.
- Work with engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and followed.
- Build and incorporate automated unit tests and participate in integration testing efforts.
- Utilize and advance continuous integration and deployment frameworks.
- Troubleshoot data issues and perform root cause analysis.
- Work across teams to resolve operational and performance issues.
Requirements
Education: Bachelorβs degree in Computer Science or a related technical discipline.
Experience: Minimum of 10 years of experience in large-scale software development, including at least 5 years of dedicated big data experience.
Technical Skills: Proven proficiency in programming languages (Python or Scala preferred) and experience working with Hadoop and related processing frameworks such as Spark or Hive. Experience with messaging, streaming, and complex event processing tooling is required, alongside data warehousing concepts, SQL, and analytical functions. Competency in workflow orchestration tools like Apache Airflow, source code control tools like Github or Bitbucket, and experience in Agile/Scrum application development are necessary. Candidates must demonstrate experience working with AI, machine learning, and delivering LLM-based Databricks applications.
Preferred Qualifications
- Experience with Java, public cloud environments (particularly AWS and Databricks), and cloud warehouse tools like Snowflake.
- Experience working with NoSQL data stores such as HBase or DynamoDB, building RESTful APIs to enable data consumption, and utilizing build tools like Terraform, CloudFormation, Jenkins, or Circle CI.
- A strong desire to work collaboratively with teammates to devise optimal solutions in a fast-paced, agile environment, paired with excellent problem-solving abilities.
About the company
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at, UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Everforth Apex Systems.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦