> Markdown version of [/jobs/ext/1679630-data-engineers](https://www.wearedevelopers.com/jobs/ext/1679630-data-engineers). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # data engineers - **Company:** NinjaOne, LLC - **Location:** New York, NY, United States (Remote available) - **Experience:** Expert - **Salary:** $110,000.0 - $200,000.0 - **Contract:** Permanent contract - **Skills:** Airflow, Big Data, Computer Engineering, Data Architecture, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Distributed Systems, Python (Programming Language), SQL Databases, Data Streaming, Data Ingestion, System Availability, Apache Spark, Data Layers, Data Lakes, Information Technology, Apache Kafka, Data Pipelines, Databricks - **Published:** July 31, 2026 - **Apply:** https://www.dice.com/job-detail/e3283feb-a983-40cf-b0c2-596abdbdb76a ## About the Role * Bachelor's degree in Computer Science, Computer Engineering, Information Technology, or equivalent work experience preferred. * 10+ years of experience in data engineering with a strong focus on data platform and distributed systems. * Hands-on experience building and managing lakehouse architectures, including Medallion (Bronze/Silver/Gold) layering patterns. * Deep expertise in Apache Kafka, Apache Spark, and Apache Airflow for both streaming and batch pipeline development. * Proficiency in open table formats - Iceberg, Delta Lake, or Hudi - with the ability to evaluate trade-offs and select the right format for the workload. * Experience with Databricks for large-scale data processing and analytics workloads. * Strong proficiency in Python and SQL. * Experience that will make you a standout candidate: + Hands-on experience with Trino or Starburst for distributed query execution. + Familiarity with hybrid streaming/batch architectures and event-driven data systems. + Experience designing Gold-layer datasets optimized for business intelligence and self-serve analytics. ## Description At NinjaOne, we're looking for a skilled Senior Data Engineer to join our Emerging Products team and help build the foundation of our modern data platform. You'll play a critical role in designing and scaling lakehouse architectures, building robust streaming and batch pipelines, and ensuring data flows reliably to the analysts and data scientists who depend on it. This is an exciting opportunity to work on greenfield infrastructure using a cutting-edge stack - Kafka, Spark, Iceberg, and Databricks - collaborate with cross-functional teams, and help shape how we harness data to power our next generation of products., We hire the best data engineers, but experience in our stack can't hurt: our data platform is built on Kafka, Spark, Airflow, Iceberg, and Databricks; supporting large-scale distributed workloads across hybrid streaming and batch ecosystems. Knowing lakehouse architecture patterns, distributed query engines, and scalable pipeline design will set you up for success. What You'll Be Doing * Lakehouse Architecture: Design and implement Medallion-layer data architectures (Bronze, Silver, Gold), building structured ingestion pipelines and curated data layers that serve downstream analytics and data science workloads. * Pipeline Development: Build and maintain scalable streaming and batch data pipelines using Kafka, Spark, and Airflow, supporting reliable and low-latency data movement across the platform. * Table Format Management: Own and manage open table formats including Iceberg, Delta, and Hudi - selecting the right format for the workload and maintaining performance and reliability at scale. * Query Engine Optimization: Work with Trino/Starburst and Databricks-based environments to optimize large-scale analytics queries and support platform consumers. * Platform Reliability: Monitor pipeline health, troubleshoot data quality and performance issues, and continuously improve the reliability and efficiency of the data platform. * Collaboration: Partner closely with data scientists, analysts, and product teams to understand data requirements and deliver platform solutions that enable data-driven decision-making. * Other duties as needed., *Due to operational policies, NinjaOne is unable to hire for this role within the city limits of Chicago. We will consider all qualified candidates who reside outside of the city proper or are willing to self-relocate. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)