Lead Data Engineer

Apex Systems LLC
Boston, MA, United States
5 days ago
Apply on jobs.y-axis.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Applications Architecture Big Data Code Reuse Databases Continuous Integration Information Engineering Extract Transform Load (ETL) Data Stores Data Warehousing Relational Databases Software Design Patterns Dimensional Modeling
+20 more
Distributed Computing Environment Apache Hadoop Python (Programming Language) Machine Learning NoSQL Open Source Technology Standard Sql Software Engineering Web Services Data Logging Apex Code Google Cloud Apache Spark Git Cloudformation Scikit Learn Data Analytics Terraform Docker Jenkins

Job description

Lead Data Engineer needed on-site in Madison, WI or Boston, MA for a large insurance client., * Leads an engineering team to meet project deadlines and priorities.

  • Supervises assigned data engineering team members & activities.
  • Ensures the quality, completeness, security, privacy, and integrity of data throughout the data lifecycle.
  • Documents critical workflows and operational support aspects of team’s responsibilities
  • Develops deep understanding of data sources, granularity, availability, and limitations.
  • Provides proactive technical oversight and advice to application architecture and development teams fostering re-use, design for scale, stability, and operational efficiency of data/analytical solutions.
  • Creates maintainable, scalable code to load and manipulate data in the data warehouse.
  • Facilitates communication upward and across project teams and business stakeholders.

Requirements

  • Demonstrated experience providing customer-driven solutions, support or service.
  • Must have Google Cloud Platform experience for this positon.
  • In-depth knowledge of SQL or NoSQL and experience using a variety of data stores (e.g. RDBMS, analytic database, scalable document stores)
  • Extensive hands-on Python programming experience, with an emphasis towards building ETL workflows and data-driven solutions.
  • Able to employ design patterns and generalize code to address common use cases.
  • Capable of authoring robust, high quality, reusable code and contributing to the division’s inventory of libraries.
  • Expertise in big data batch computing tools (e.g. Hadoop or Spark), with demonstrated experience developing distributed data processing solutions.
  • Knowledge of open source machine learning toolkits, such as sklearn, SparkML, or H2O.
  • Solid data understanding and business acumen in the data rich industries like insurance or financial
  • Applied knowledge of data modeling principles (e.g. dimensional modeling and star schemas).
  • Strong understanding of database internals, such as indexes, binary logging, and transactions.
  • Experience using tools for infrastructure-as-code (e.g. Docker, CloudFormation, Terraform, etc.)
  • Experience with software engineering tools and workflows (i.e. Jenkins, CI/CD, git).
  • Practical experience authoring and consuming web services.

About the company

  • Everforth Apex is a world-class IT services company that serves thousands of clients across the globe. When you join Everforth Apex, you become part of a team that values innovation, collaboration, and continuous learning. We offer quality career resources, training, certifications, development opportunities, and a comprehensive benefits package. Our commitment to excellence is reflected in many awards, including ClearlyRateds Best of Staffing in Talent Satisfaction in the United States and Great Place to Work in the United Kingdom and Mexico.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.y-axis.com
Prepare application

Good distractions

Loading talks and stories from around this role…