> Markdown version of [/jobs/ext/1949109-data-engineer](https://www.wearedevelopers.com/jobs/ext/1949109-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Openmind Technologies
- **Location:** Boston, MA, United States (Remote available)
- **Contract:** Temporary to permanent
- **Skills:** Microsoft Azure, Big Data, Cloud Computing, Information Engineering, Data Governance, Data Integration, Data Warehousing, DevOps, Distributed Systems, Python (Programming Language), Machine Learning, Performance Tuning, SQL Databases, Data Streaming, Unstructured Data, Data Ingestion, Azure Data Factory, Snowflake, Apache Spark, Data Lakes, Apache Kafka, Spark Streaming, Data Pipelines
- **Published:** August 6, 2026
- **Apply:** https://www.dice.com/job-detail/9a50d510-e4c6-40df-a2b1-aa28fabdf3b7

## About the Role

We are seeking a highly skilled Data Engineer to join our consulting team for a remote engagement with a client headquartered in Boston, MA. The ideal candidate will have extensive experience working with large-scale data pipelines, real-time streaming technologies, and cloud-based big data platforms. This role requires strong expertise in Apache Spark, Apache Kafka, Python, Machine learning and data ingestion frameworks, along with hands-on experience in Azure, SQL, and Snowflake., * 12+ years of professional experience as abig Data Engineer or similar role.

 * Strong expertise in Apache Spark (batch and streaming) and Apache Kafka.
 * Proven experience with large-scale data ingestion and processing.
 * Hands-on experience with Azure Data Services (e.g., Data Lake, Data Factory, Synapse).
 * Proficiency in SQL and experience with Snowflake for data warehousing.
 * Solid understanding of distributed systems and scalable architectures.
 * Strong problem-solving skills and ability to work independently in a remote environment., * Experience with performance tuning of big data pipelines.
 * Familiarity with CI/CD pipelines and DevOps practices for data engineering.
 * Exposure to data governance and security best practices.

## Description

* Design, build, and optimize big data ingestion pipelines to handle large volumes of structured and unstructured data.
 * Develop and maintain real-time streaming solutions using Kafka and Spark Streaming.
 * Collaborate with data architects and business stakeholders to define data integration strategies.
 * Implement scalable solutions on Azure cloud services and integrate with Snowflake for analytics and reporting.
 * Ensure data quality, reliability, and performance across distributed systems.
 * Troubleshoot and optimize existing pipelines to improve efficiency and reduce latency.
 * Document technical designs, workflows, and best practices for long-term maintainability.


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [How Cisco embraced a DevOps culture within its network engineering team](https://www.wearedevelopers.com/videos/99-how-cisco-embraced-a-devops-culture-within-its-network-engineering-team)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Hacking AI at the Edge of the Indian Ocean](https://www.wearedevelopers.com/videos/100177-hacking-ai-at-the-edge-of-the-indian-ocean)

## Related Articles

- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers)