Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+27 more
Job description
Contribute to Design and implement data products and features in collaboration with product owners, data analysts, and business partners using Agile / Scrum methodology
Contribute to overall architecture, frameworks and patterns for processing and storing large data volumes
Contribute to evaluation of new technologies/tools/frameworks centered around high-volume data processing
Translate product backlog items into logical units of work in engineering
Implement distributed data processing pipelines using tools and languages prevalent in the big data ecosystem
Build utilities, user defined functions, libraries, and frameworks to better enable data flow patterns
Work with engineering leads and other teams to ensure quality solutions are implemented, and engineering best practices are defined and followed
Build and incorporate automated unit tests and participate in integration testing efforts
Utilize and advance continuous integration and deployment frameworks
Troubleshoot data issues and perform root cause analysis
Work across teams to resolve operational & performance issues
Requirements
Bachelor’s degree in Computer Science, or related technical discipline
10+ years of experience in large-scale software development, 5+ years of big data experience
Programming experience, Python or Scala preferred.
Experience working with Hadoop and related processing frameworks such as Spark, Hive, etc.
Experience with messaging/streaming/complex event processing tooling and frameworks
Experience with data warehousing concepts, SQL and SQL Analytical functions
Experience with workflow orchestration tools like Apache Airflow
Experience with source code control tools like Github or Bitbucket
Ability to communicate effectively, both verbally and written, with team members
Interest in and ability to quickly pick up new languages, technologies, and frameworks
Experience in Agile/Scrum application development
The following skills and experience are also relevant to our overall environment, and nice to have:
Experience with Databricks, and semantic layer development using Metric Views
Experience working in a public cloud environment, particularly AWS, databricks
Experience with cloud warehouse tools like Snowflake
Experience working with NoSQL data stores such as HBase, DynamoDB, etc.
Experience building RESTful API’s to enable data consumption
Experience with build tools such as Terraform or CloudFormation and automation tools such as Jenkins or Circle CI
Experience with practices like Continuous Development, Continuous Integration and Automated Testing
These are the characteristics that we strive for in our own work. We would love to hear from candidates who embody the same:
Desire to work collaboratively with your teammates to come up with the best solution to a problem
Demonstrated experience and ability to deliver results on multiple projects in a fast-paced, agile environment
Excellent problem-solving and interpersonal communication skills
Strong desire to learn and share knowledge with others
About the company
Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.
Everforth Apex uses a virtual recruiter as part of the application process. Click for more details. By applying for this job, you agree to receive calls, AI-generated calls, text messages, or emails from Everforth Apex and its affiliates, and contracted partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered messages. You can reply STOP to cancel and HELP for help. You can access our privacy policy at, UnitedHealthcare creates and publishes the Transparency in Coverage Machine-Readable Files on behalf of Everforth Apex Systems.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…