Lead Data Engineer - GCP, Python, SQL

BEACON TECHNOLOGIES INC
Boston, MA, United States
about 1 month ago
Apply on www.indeed.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$130,000.0 - $210,000.0
Working hours
Regular working hours
Job source

Tech stack

Clean Code Principles Applications Architecture Big Data Code Reuse Information Engineering Extract Transform Load (ETL) Data Warehousing Software Design Patterns Dimensional Modeling Distributed Systems Apache Hadoop Python (Programming Language)
+17 more
NoSQL Open Source Technology Tensorflow Standard Sql SQL Databases Web Services Google Cloud Apache Spark Git Cloudformation Infrastructure Automation Frameworks Data Analytics Data Management Restful APIs Terraform Docker Jenkins

Job description

The Lead Data Engineer provides technical oversight, architectural direction, and hands-on guidance to an analytics data engineering team. Working directly on high-priority customer and marketing analytics projects, this role ensures high data quality, security, and scalable infrastructure design across Google Cloud Platform environments., * Lead, supervise, and mentor assigned data engineering team members to meet project deliverables.

  • Design, construct, and maintain maintainable, scalable code to load and manipulate data in the enterprise data warehouse.
  • Provide proactive technical oversight to application architecture and development teams to foster code reuse, scalability, and stability.
  • Document critical operational workflows, system dependencies, and data management responsibilities.
  • Ensure data quality, privacy, completeness, and integrity across the entire data lifecycle.
  • Facilitate active communication across project teams, technical leadership, and business stakeholders.

Requirements

  • Hands-on experience developing within Google Cloud Platform (GCP).
  • In-depth knowledge of SQL or NoSQL with practical experience using relational, analytic, or scalable document stores.
  • Extensive Python programming background tailored toward building ETL workflows and data-driven solutions.
  • Strong expertise with big data distributed computing engines such as Apache Spark or Hadoop.
  • Solid grasp of data modeling principles, including dimensional modeling and star schemas.
  • Working knowledge of infrastructure-as-code tools (Docker, Terraform, CloudFormation) and CI/CD pipelines (Git, Jenkins).
  • Proven experience applying software design patterns to author reusable, high-quality code and division libraries.

Preferred Qualifications:

  • Exposure to open-source machine learning frameworks like sklearn, SparkML, or H2O.
  • Direct domain knowledge or business acumen within insurance or financial service industries.
  • Practical experience authoring and consuming web services and REST APIs., * Python: 6 years (Required)
  • SQL: 6 years (Required)
  • Google Cloud Platform: 5 years (Required)

Benefits & conditions

  • 401(k)
  • Dental insurance
  • Health insurance
  • Health savings account
  • Life insurance
  • Referral program
  • Vision insurance

Application Question(s):

  • This is a hybrid position in Boston on Congress Street requiring 2-3 days a week on site. Are you open to this hybrid arrangement for this position?

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com
Prepare application

Good distractions

Loading talks and stories from around this role…