Senior Data Engineer, Data Platforms and Integrations

Global Partners LP
Newton, MA, United States
8 days ago
Apply on diversityjobs.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
2 years minimum
Compensation
$182,300 - $190,000
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Airflow Amazon Web Services Microsoft Azure Big Data Continuous Delivery Continuous Integration Extract Transform Load (ETL) Github Python (Programming Language) NoSQL
+20 more
Operational Databases Cloud Services Prometheus Standard Sql Systems Integration Snowflake Grafana Backend AWS ECS Cloudformation Fastapi Information Technology AWS Fargate Enterprise Integration Data Management Restful APIs Streamlit Framework Terraform Data Pipelines Docker

Job description

Responsibilities: Architect, build, and operate the Company’s production data ingestion, integration, analytics, and data-platform solutions. Design and orchestrate scalable pipelines in AWS using Dagster, develop tested analytics models and transformation processes in Snowflake and dbt, and deploy containerized platform services on AWS ECS/Fargate using Docker and CloudFormation. Establish CI/CD workflows through GitHub Actions, manage secure configurations and credentials through AWS Secrets Manager, and implement monitoring, alerting, observability, data-quality controls, and privacy safeguards across development, test, and production environments. Build and support source-ingestion, API, reverse-ETL, and backend data applications using tools such as Fivetran, Python, FastAPI, and Streamlit. Develop master data management solutions, governed single sources of truth, and automated data-governance guardrails for key business entities. Apply AI-assisted development tools, contribute reusable AI development capabilities, and build MCP servers and other scalable data products using modern product-development and agile practices. Partner with terminal, wholesale, retail, supply, and trading teams; provide technical leadership and mentorship; maintain architecture documentation and operational runbooks; and champion automation-first engineering standards.

Requirements

Requirements: Master’s degree in Computer Science, Information Technology or a related field and five years of experience as a Data Engineer, Software Developer, Systems Analyst/Architect or related role. Experience must include five years each of the following: designing, developing, and supporting integration solutions; programming in Python on data-intensive applications; working with REST API protocols and Python API frameworks such as FastAPI; and working with SQL and NoSQL databases. Experience must include four years each of the following: building cloud-native data solutions on AWS/Azure; and working with Docker and Kubernetes. Experience must include two years each of the following: building data pipelines with ETL/ELT tools Fivetran, Dagster, dbt and Snowflake; implementing CI/CD using GitHub Actions; authoring infrastructure-as-code using AWS CloudFormation/Terraform; implementing observability and monitoring for data pipelines using tools such as Prometheus, Grafana, or Metaplane; and building and maintaining data pipelines that comply with data privacy and security regulations such as HIPAA/GDPR. Experience may be gained concurrently.

Benefits & conditions

Pay Range $182,300.00 - $190,000.00

The pay range for this position is outlined above. The final amount offered at the start of employment is determined based on factors including, but not limited to, experience level, knowledge, skills, abilities and geographic location, and the Company reserves the right to modify base salary at any time, including for reasons related to individual performance, Company or individual department/team performance and market factors.

Our Commitments to You Competitive Pay - We offer competitive salaries and opportunities for growth within.

Health & Wellness - Medical, Dental, Visions and Life Insurance. Along with additional wellness support.

The Road Ahead - We offer 401k and a match component. We also provide tuition reimbursement; this benefit is offered after 6 months of service.

Professional Development - We value lifelong learning and have many internal development programs and access to other on-demand learning for continued career growth.

These commitments are offered to employees in permanent roles, as part of our support for long-term growth and success

What to Expect From the Hiring Process

We value passion and potential. Please apply if you’re qualified and interested-we’d love to hear from you.

A member of our Talent Acquisition team will review your application and may connect you with the hiring manager if your experience is a strong match.

Interviews are conducted virtually and in person, depending on the role. We’ll provide more details about next steps if selected to move forward.

About the company

At Global Partners, business starts with people. Since 1933, we’ve believed in taking care of our customers, our guests, our communities, and each other-and that belief continues to guide us.

The Global Spirit is the cornerstone of our commitment to success. As a Fortune 500 company with 90+ years of experience, we’re proud to fuel communities-responsibly and sustainably. We show up every day with grit, passion, and purpose-anticipating needs, building lasting relationships, and creating shared value.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on diversityjobs.com
Prepare application

Good distractions

Loading talks and stories from around this role…