Software Engineer - Ad Data Platform|Ad Intelligence

Ad Platforms organization within this company is fully responsible for building, enhancing and maintaining the high-performance, distributed, microservice-based Advertising Platform across all of the company''s online properties, including streaming services. We build and maintain proprietary technology, ranging from ad serving and ad delivery, campaign management, reporting as well as all the integrations internal and external that come with evolving and maintaining a best-in-class video advertising business. The Ad Intelligence team is under Ad Platforms and its mission is to transform advertising and the company''s Ad platform with data and AI across TV and streaming video. We build solutions to measure and optimize every aspect of the advertising life cycle. Our tenant is a strong cross-domain team to deliver E2E solutions covering tech areas ranging from machine learning, big data, microservices to data visualization., Our team is seeking a senior software engineer who will be a core team member for our advertising data platform engineering group. This engineering group focuses on big data infrastructure, operational data, audience solution, inventory forecasting and full funnel measurements as a foundation layer for this company''s addressable Ad Platforms., * Build components of large-scale data platform for real-time and batch processing, and own features of big data applications to fit evolving business needs

• Build next-gen cloud based big data infrastructure for batch and streaming data applications, and continuously improve performance, scalability and availability
• Contribute to the best engineering practices, including the use of design patterns, CI/CD, code review and automated test
• Chip in ground-breaking innovation and apply the state-of-the-art technologies
• As a key member of the team, contribute to all aspects of the software lifecycle: design, experimentation, implementation and testing.
• Collaborate with program managers, product managers, SDET, and researchers in an open and innovative environment

The right person for this role should have extensive experience on big data as well as solid expertise on backend services or full stack. If you are someone who is proactive, hardworking, and enthusiastic in these domains, this is a phenomenal role for you!, * 4+ years of professional programming in Java, Scala, Python, and etc.

• 3+ years of big data development experience with technical stacks like Spark, Flink, Singlestore, Kafka, Nifi and AWS big data technologies
• Knowledge of system, application design and architecture
• Experience of building industry level high available and scalable service
• Passion about technologies, and openness to interdisciplinary work
• Experience with processing large amount of data at petabyte level
• Demonstrated ability with cloud infrastructure technologies, including Terraform, K8S, Spinnaker, IAM, ALB, and etc.
• Experience with ClickHouse, Druid, Snowflake, Impala, Presto, Kinesis, etc.
• Experience in widely used Web frameworks (SpringBoot, React.js, Vue.js, Angular, etc.)

Required Core Technical Skills: Strong experience in:

• Building and maintaining data pipelines
• Integrating multiple source systems
• Exposure to large data warehouses or data lakes.
• Proficiency in SQL and Python:
• SQL described as foundational and critical.
• Python is increasingly important due to a planned migration away from Scala.
• Experience with PySpark is highly relevant, especially for pipeline development.
• Databricks experience is preferred but not mandatory if PySpark experience exists elsewhere.
• Prior exposure to cloud platforms (AWS, Google Cloud Platform, or Azure) is required, but deep AWS administration skills are not expected.

Required Education: STEM BA Degree + 5 years relevant experience