Sr. Data Engineer (Scala, Spark, Python, Databricks)- No H1B or C2C

The Ads Data team, part of Company's Ad Platforms organization, is focused on transforming the advertising landscape across TV and streaming video through data and AI. The team designs and builds solutions that measure and optimize the advertising lifecycle, including planning, activation, measurement, and insights., * Design, build, and maintain scalable data platform components for real-time and batch processing.

• Own the full software development lifecycle, including requirements gathering, design, implementation, testing, and deployment.
• Drive engineering best practices, including code quality, performance optimization, automated testing, CI/CD, and system reliability.
• Define and evaluate technical architecture, contribute to system-level design discussions, and lead decision-making on key engineering trade-offs.
• Collaborate cross-functionally with product managers, program managers, SDETs, data scientists, engineers, and stakeholders to deliver solutions aligned with business goals.
• Provide technical guidance and mentorship to junior and mid-level engineers while fostering an inclusive, high-performing engineering culture.
• Troubleshoot and resolve complex production issues to ensure system performance, availability, and reliability.
• Evaluate emerging technologies and contribute to innovation efforts across the organization.

• 5+ years of professional programming experience in Scala, Python, or similar languages.
• 3+ years of big data development experience using technologies such as Spark, Flink, Airflow, Singlestore, Kafka, and AWS big data technologies.
• Deep understanding of data modeling, distributed systems, and performance optimization.
• Knowledge of system and application design and architecture.
• Experience building highly available and scalable production-level services.
• Passion for technology and openness to interdisciplinary work.
• Excellent communication and collaboration skills.

Preferred Qualifications:

• Hands-on experience with Databricks for development and deployment of data pipelines.
• Experience with data governance, compliance, or observability tooling.
• Experience with cloud infrastructure technologies, including Terraform, Kubernetes, Spinnaker, IAM, and ALB.
• Experience with Snowflake, Kinesis, Lambda, or similar technologies.
• Experience with microservice frameworks such as Spring Boot, Spring Cloud, FastAPI, or NestJS.
• Experience with Spark, Flink or Spark Streaming, Airflow, Databricks, Scala or Java, Python, and AWS big data technologies.

Required Education:

Bachelor's degree or higher in Computer Science or a related quantitative field, or equivalent practical experience demonstrating advanced technical expertise.

Company Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more, working together to build and advance the technological backbone for Company's media business globally. The team combines technology and creativity to build world-class products, enhance storytelling, and drive velocity, innovation, and scalability across Company's businesses. Ad Platforms is responsible for Company's industry-leading advertising technology and products, driving advertising performance, innovation, and value across Company's sports, news, and entertainment content on all media platforms.