> Markdown version of [/jobs/ext/4555857-senior-data-engineer-data-platforms-and-integrations](https://www.wearedevelopers.com/jobs/ext/4555857-senior-data-engineer-data-platforms-and-integrations). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer, Data Platforms and Integrations

- **Company:** Global Partners LP
- **Location:** Newton, MA, United States
- **Experience:** Expert
- **Salary:** $182,300 - $190,000
- **Contract:** Permanent contract
- **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Airflow, Amazon Web Services, Microsoft Azure, Big Data, Continuous Delivery, Continuous Integration, Extract Transform Load (ETL), Github, Python (Programming Language), NoSQL, Operational Databases, Cloud Services, Prometheus, Standard Sql, Systems Integration, Snowflake, Grafana, Backend, AWS ECS, Cloudformation, Fastapi, Information Technology, AWS Fargate, Enterprise Integration, Data Management, Restful APIs, Streamlit Framework, Terraform, Data Pipelines, Docker
- **Published:** November 4, 2026
- **Apply:** https://diversityjobs.com/career/18819054/Senior-Data-Engineer-Data-Platforms-Integrations-Massachusetts-Newton

## About the Role

Requirements: Master's degree in Computer Science, Information Technology or a related field and five years of experience as a Data Engineer, Software Developer, Systems Analyst/Architect or related role. Experience must include five years each of the following: designing, developing, and supporting integration solutions; programming in Python on data-intensive applications; working with REST API protocols and Python API frameworks such as FastAPI; and working with SQL and NoSQL databases. Experience must include four years each of the following: building cloud-native data solutions on AWS/Azure; and working with Docker and Kubernetes. Experience must include two years each of the following: building data pipelines with ETL/ELT tools Fivetran, Dagster, dbt and Snowflake; implementing CI/CD using GitHub Actions; authoring infrastructure-as-code using AWS CloudFormation/Terraform; implementing observability and monitoring for data pipelines using tools such as Prometheus, Grafana, or
Metaplane; and building and maintaining data pipelines that comply with data privacy and security regulations such as HIPAA/GDPR. Experience may be gained concurrently.

## Description

Responsibilities: Architect, build, and operate the Company's production data ingestion, integration, analytics, and data-platform solutions. Design and orchestrate scalable pipelines in AWS using Dagster, develop tested analytics models and transformation processes in Snowflake and dbt, and deploy containerized platform services on AWS ECS/Fargate using Docker and CloudFormation. Establish CI/CD workflows through GitHub Actions, manage secure configurations and credentials through AWS Secrets Manager, and implement monitoring, alerting, observability, data-quality controls, and privacy safeguards across development, test, and production environments. Build and support source-ingestion, API, reverse-ETL, and backend data applications using tools such as Fivetran, Python, FastAPI, and Streamlit. Develop master data management solutions, governed single sources of truth, and automated data-governance guardrails for key business entities. Apply AI-assisted development tools, contribute
reusable AI development capabilities, and build MCP servers and other scalable data products using modern product-development and agile practices. Partner with terminal, wholesale, retail, supply, and trading teams; provide technical leadership and mentorship; maintain architecture documentation and operational runbooks; and champion automation-first engineering standards.