Lead Data Engineer - GCP, Python, SQL
BEACON TECHNOLOGIES INC
Boston, MA, United States
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$130,000.0 - $210,000.0
Working hours
Regular working hours
Job source
Tech stack
Clean Code Principles
Applications Architecture
Big Data
Code Reuse
Information Engineering
Extract Transform Load (ETL)
Data Warehousing
Software Design Patterns
Dimensional Modeling
Distributed Systems
Apache Hadoop
Python (Programming Language)
+17 more
NoSQL
Open Source Technology
Tensorflow
Standard Sql
SQL Databases
Web Services
Google Cloud
Apache Spark
Git
Cloudformation
Infrastructure Automation Frameworks
Data Analytics
Data Management
Restful APIs
Terraform
Docker
Jenkins
Job description
The Lead Data Engineer provides technical oversight, architectural direction, and hands-on guidance to an analytics data engineering team. Working directly on high-priority customer and marketing analytics projects, this role ensures high data quality, security, and scalable infrastructure design across Google Cloud Platform environments., * Lead, supervise, and mentor assigned data engineering team members to meet project deliverables.
- Design, construct, and maintain maintainable, scalable code to load and manipulate data in the enterprise data warehouse.
- Provide proactive technical oversight to application architecture and development teams to foster code reuse, scalability, and stability.
- Document critical operational workflows, system dependencies, and data management responsibilities.
- Ensure data quality, privacy, completeness, and integrity across the entire data lifecycle.
- Facilitate active communication across project teams, technical leadership, and business stakeholders.
Requirements
- Hands-on experience developing within Google Cloud Platform (GCP).
- In-depth knowledge of SQL or NoSQL with practical experience using relational, analytic, or scalable document stores.
- Extensive Python programming background tailored toward building ETL workflows and data-driven solutions.
- Strong expertise with big data distributed computing engines such as Apache Spark or Hadoop.
- Solid grasp of data modeling principles, including dimensional modeling and star schemas.
- Working knowledge of infrastructure-as-code tools (Docker, Terraform, CloudFormation) and CI/CD pipelines (Git, Jenkins).
- Proven experience applying software design patterns to author reusable, high-quality code and division libraries.
Preferred Qualifications:
- Exposure to open-source machine learning frameworks like sklearn, SparkML, or H2O.
- Direct domain knowledge or business acumen within insurance or financial service industries.
- Practical experience authoring and consuming web services and REST APIs., * Python: 6 years (Required)
- SQL: 6 years (Required)
- Google Cloud Platform: 5 years (Required)
Benefits & conditions
- 401(k)
- Dental insurance
- Health insurance
- Health savings account
- Life insurance
- Referral program
- Vision insurance
Application Question(s):
- This is a hybrid position in Boston on Congress Street requiring 2-3 days a week on site. Are you open to this hybrid arrangement for this position?
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦