Dr. Qiyang Duan
Alibaba Big Data and Machine Learning Technology
#1about 4 minutes
How e-commerce scale drives Alibaba's big data technology
Alibaba's big data platform evolved to handle massive transaction volumes from events like the Double 11 festival, processing petabytes of data daily.
#2about 4 minutes
Exploring Alibaba's big data and AI product portfolio
The platform is structured around a typical data flow, including tools for data ingestion, storage, processing, visualization, and a dedicated AI platform called PAI.
#3about 4 minutes
Comparing core data processing engines on Alibaba Cloud
A look at key processing tools including MaxCompute for massive-scale SQL, E-MapReduce for Hadoop migrations, and Flink for real-time stream processing.
#4about 5 minutes
Using DataWorks as a unified IDE for big data
DataWorks provides a single environment for data development and operations, integrating various engines like MaxCompute and Hadoop and including data governance tools.
#5about 7 minutes
Developing models with the Platform for AI (PAI)
The PAI platform supports both visual drag-and-drop model building with PAI Studio and code-based development using the Data Science Workshop (DSW) with JupyterLab.
#6about 2 minutes
Announcing the Alibaba Cloud AI Champion 2020 competition
An overview of the AI Champion 2020 competition, which offers cash prizes and cloud credits for innovative projects built on the PAI platform.
#7about 5 minutes
Live demo of data analysis with DataWorks
A walkthrough of the DataWorks interface, demonstrating how to write and execute SQL queries, visualize results, and manage data integration jobs.
#8about 8 minutes
Live demo of building models on the PAI platform
A demonstration of building a recommendation model using the drag-and-drop PAI Studio and running a deep learning example in the PAI-DSW JupyterLab environment.
Related jobs
Jobs that call for the skills explored in this talk.
Featured Partners
Related Videos
43:26PySpark - Combining Machine Learning & Big Data
Ayon Roy
46:43Convert batch code into streaming with Python
Bobur Umurzokov
29:37Detecting Money Laundering with AI
Stefan Donsa & Lukas Alber
45:58Data Fabric in Action - How to enhance a Stock Trading App with ML and Data Virtualization
Andreas Christian
1:09:49Inside the AI Revolution: How Microsoft is Empowering the World to Achieve More
Simi Olabisi
41:13Serverless on Cloud
Cheng Zhang
58:21Data Science in Retail
Julian Joseph
26:12AI in Africa: How can we bounce back?
Ayoub Alouane
From learning to earning
Jobs that call for the skills explored in this talk.
ML & Data Engineer - GenAI & Cloud Infra - Pur Player Data IA ML
WAKE IT UP
Paris, France
Python
Ansible
Terraform
Continuous Integration