> Markdown version of [/jobs/ext/1840736-senior-data-engineer-big-data-and-cloud](https://www.wearedevelopers.com/jobs/ext/1840736-senior-data-engineer-big-data-and-cloud). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer, Big Data and Cloud

- **Company:** Vistar Media
- **Location:** New York, NY, United States
- **Experience:** Expert
- **Salary:** $105,100.0 - $189,600.0
- **Contract:** Permanent contract
- **Skills:** Geographic Information Systems, Airflow, Business Analytics Applications, Big Data, Cloud Computing, Cloud Engineering, Databases, Computer Engineering, Information Engineering, Extract Transform Load (ETL), DevOps, Distributed Computing Environment, Python (Programming Language), NumPy, DataOps, Scala (Programming Language), SciPy, Software Engineering, SQL Databases, Data Streaming, Apache Spark, Pandas, Scikit Learn, Information Technology, Google Bigquery, Apache Kafka, Non-relational Database, Data Pipelines
- **Published:** July 31, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=488613eddf36a539

## About the Role

+ Bachelor's Degree plus 5 years of related work experience OR Advanced degree with 3 years of related experience (Required)
 + Acceptable areas of study include Computer Engineering, Computer Science, a related subject area (Required)
 + 4-7 years Hands-on implementation and architectural familiarity with streaming data, relational and non-relational databases, and distributed processing technologies. (Required)
 + 4-7 years Designing and developing advanced data engineering tasks in Python, SQL, Spark, and related Python libraries (e.g., pandas, scikit-learn, scipy, numpy). (Required)
 + 4-7 years Advanced knowledge in building complex data pipelines and cloud bases services (GCP) to support robust and scalable infrastructure (Airflow, Kafka). (Required)
Knowledge, Skills and Abilities:

 + Strong background in software engineering, large-scale data and algorithms, cloud architecture, and design thinking. (Required)
 + Experience with production-level engineering around GIS and geospatial data processing. (Preferred)
 + Familiarity with DevOps practices and tools for DataOps.
 + Ability to work quickly and precisely, capturing requirements and designing before implementation.
 + Knowledge of Google BigQuery and tools for solving data-centric problems and working with graph datasets and databases.

## Description

+ Design and develop data engineering solutions that enable data pipelines, visualization, and analytical tools to support business requirements.
 + Innovate, implement, support, and iterate on scalable big data pipelines and ETL processes.
 + Write robust, efficient, and highly maintainable code in Python, Spark and Scala.
 + Contribute to team knowledge sharing and drive the advancement of new data engineering capabilities.
 + Assist technical, product, and operational leaders in project definition, including estimating, planning, and scoping work to meet objectives.
 + Also responsible for other duties/projects as assigned by business management as needed


## Related Videos

- [Python Data Visualization @ Deepnote (w/ PyViz overview)](https://www.wearedevelopers.com/videos/113-python-data-visualization-deepnote-w-pyviz-overview)
- [Vectorize all the things! Using linear algebra and NumPy to make your Python code lightning fast.](https://www.wearedevelopers.com/videos/562-vectorize-all-the-things-using-linear-algebra-and-numpy-to-make-your-python-code-lightning-fast)
- [Advanced Typing in TypeScript](https://www.wearedevelopers.com/videos/496-advanced-typing-in-typescript)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Data Science on Software Data](https://www.wearedevelopers.com/videos/162-data-science-on-software-data)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)