> Markdown version of [/jobs/ext/1467951-data-engineer](https://www.wearedevelopers.com/jobs/ext/1467951-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Tatari, Inc. - **Location:** New York, United States - **Experience:** Expert - **Salary:** $170,000.0 - $200,000.0 - **Contract:** Permanent contract - **Skills:** Airflow, Computer Programming, Extract Transform Load (ETL), Software Debugging, Distributed Data Store, Python (Programming Language), Online Analytical Processing, Performance Tuning, Raw Data, SQL Databases, Workflow Management Systems, Apache Spark, Backend, Data Lakes, Pyspark, Front End Software Development, Vertica, Data Pipelines, Databricks - **Published:** July 28, 2026 - **Apply:** https://www.dice.com/job-detail/8d74363e-743f-46b2-8cb6-7390c8eea5e8 ## About the Role As a Senior Data Engineer in our Reporting and Measure pillar, you will design, build and own the large-scale data pipelines that turn high-volume raw data into curated, production-grade datasets powering Tatari's reporting and measurement products. You will be responsible for taking data products from requirements through tech spec, implementation, validation and production rollout-partnering closely with data science on methodology, backend and frontend engineers on serving layers, and product on requirements. The ideal candidate will have deep expertise in building and operating ETL pipelines at scale, a strong data quality and validation mindset, and a proven track record of owning datasets end-to-end in a cross-functional environment. Your skills and experience: * 5+ years of dedicated experience designing, building and operating production ETL pipelines at scale * Strong programming skills in Python (or a similar language) and SQL; deep hands-on experience with Spark/PySpark. We use Databricks and Delta Lake here * Experience with workflow orchestration tools such as Airflow, including DAG design, backfills and failure recovery * Strong data modeling skills for analytics - curated/gold-layer datasets, schema design, partitioning and data contracts consumed by downstream services * Ongoing interest in agentic developer workflows: testing agent harnesses, building them, agent loop engineering, and similar emerging paradigms. You enjoy learning how they're reshaping the way software gets built. * A rigorous approach to data quality: validation, reconciliation and methodology comparison as part of shipping any dataset * Experience debugging distributed data systems - performance tuning, memory issues, and optimizations * Strong written communication and cross-functional collaboration skills, from tech specs to incident writeups * Bonus points if you have experience with OLAP stores (e.g., ClickHouse) ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)