Data Engineer Self Service Analytics and Real Time Data Platforms

Self-Service Analytics & Real-Time Data Platforms

• Design, develop, and maintain scalable batch (ETL/ELT) and near real-time streaming data pipelines. These pipelines will process large-scale structured and unstructured datasets.
• Design and maintain semantic layers, metrics frameworks, and curated data products.
• Enable self-service analytics through governed and reusable business data models.
• Implement monitoring, observability, and operational best practices.
• Develop governed data access patterns for AI, conversational analytics, and MCP-based applications.
• Build AI-ready data products that support machine learning, GenAI, AI agents, and chatbot applications.
• Partner with Product, Analytics, BI, and Engineering stakeholders to deliver trusted data solutions.

Data Modeling & Platform Architecture

• Design scalable data models optimized for analytics, real-time reporting, and AI use cases.
• Develop reusable semantic and transformation layers that provide consistent business definitions.
• Drive best practices for data quality, governance, metadata, and discoverability.

Advanced Data Pipeline & ETL/ELT Expertise

• 24+ years of experience building and scaling ETL/ELT pipelines in production environments.
• Proven experience with workflow orchestration tools such as Airflow, Composer, or similar platforms.
• Working knowledge of distributed data processing concepts.
• SQL & Data Modeling for Analytics & ML
• Expert-level SQL skills for large-scale transformation and analytics.
• Experience designing scalable warehouse schemas and ML-ready data layers.
• Proven experience optimizing complex queries across multi-terabyte datasets.

Programming & ML Data Integration

• Proficiency in Python (or similar language) for data processing and ML pipeline integration.
• Experience with distributed processing frameworks such as Spark.
• Experience integrating data pipelines with ML platforms such as Vertex AI (preferred), Databricks ML, or equivalent. This includes model training, batch/online inference, and pipeline orchestration.

Streaming & Event-Driven Systems

• Experience building real-time data pipelines using Kafka, Pub/Sub, or similar technologies.
• Knowledge of feature streaming, low-latency data processing, and event-driven architectures.
• Ability to work closely with the streaming team to architect and build real-time dashboards using Superset.

Cloud & Modern AI Data Platforms

• Experience designing cloud-native data architectures (GCP preferred).
• Experience with lakehouse architectures and cloud data warehouses.
• Knowledge of vector databases, embeddings pipelines, and AI-serving infrastructure is a plus., * Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field (or equivalent experience).
• 24+ years of experience in data engineering, data pipeline development, or related fields.
• Solid foundation in modern data engineering principles, distributed systems design, and cloud-native architectures.
• Demonstrated ability to design and operate large-scale production data systems.
• Excellent problem-solving skills with the ability to work in dynamic, high-velocity environments.
• Motivated, thorough, and committed to engineering excellence and ongoing improvement.

Hiring Salary Range: $98,400.00 - 147,600.00.

The hiring salary range for this position applies to New York, California, Colorado, Washington state, and most other geographies. Starting pay for the successful applicant depends on a variety of job-related factors, including but not limited to geographic location, market demands, experience, training, and education. The benefits available for this position include medical, dental, vision, 401(k) plan, life insurance coverage, disability benefits, tuition assistance program and PTO or, if applicable, as otherwise dictated by the appropriate Collective Bargaining Agreement.This position is bonus eligible., * Attractive compensation and comprehensive benefits packages. Check out our full list of benefits here (http://www.skydance.com/careers/benefits) .

• Generous paid time off.
• Complimentary subscriptions to HBO Max, Paramount+, and other Skydance streaming services and digital news products.
• Robust employee engagement opportunities, including access to exclusive screenings and events, speaker series, volunteer activities and more.

Skydance is an equal opportunity employer (EOE)

Storytelling is, and will always be, the heart of what we do at Skydance.

Our vision is to build a thriving entertainment ecosystem where stories and worlds are imagined, brought to life and experienced. We create for every age and audience, anchored by the strength of our content and experiences and the depth of our connection with fans. We are creator-first, audience-focused, tech-forward, globally scaled.

Here, youll work with talented teams that move fast, think boldly and collaborate with purpose to deliver results. We aim high, champion the best ideas and win together, earning the trust of our employees, creators, partners and audiences every day.

If youre energized by the opportunity to help build the next-generation global media and entertainment company powered by creativity and technology, wed be thrilled to welcome you aboard. LETS GO!, Paramount Streaming, a division within Paramount Global, is the home to the company’s direct-to-consumer services spanning free and paid in the form of Pluto TV and Paramount+. Pluto TV is the global leader in free ad-supported TV, delivering more than 1,400 global channels and an extensive library of streaming content, including live and original channels. Paramount+, digital subscription video-on-demand and live streaming service, combines live sports, breaking news, and A Mountain of Entertainment. Paramount+ features an expansive library of original series, hit shows and popular movies across every genre from world-renowned brands and production studios, including SHOWTIME.