Dr. Qiyang Duan
Alibaba Big Data and Machine Learning Technology
#1about 4 minutes
How e-commerce scale drives Alibaba's big data technology
Alibaba's big data platform evolved to handle massive transaction volumes from events like the Double 11 festival, processing petabytes of data daily.
#2about 4 minutes
Exploring Alibaba's big data and AI product portfolio
The platform is structured around a typical data flow, including tools for data ingestion, storage, processing, visualization, and a dedicated AI platform called PAI.
#3about 4 minutes
Comparing core data processing engines on Alibaba Cloud
A look at key processing tools including MaxCompute for massive-scale SQL, E-MapReduce for Hadoop migrations, and Flink for real-time stream processing.
#4about 5 minutes
Using DataWorks as a unified IDE for big data
DataWorks provides a single environment for data development and operations, integrating various engines like MaxCompute and Hadoop and including data governance tools.
#5about 7 minutes
Developing models with the Platform for AI (PAI)
The PAI platform supports both visual drag-and-drop model building with PAI Studio and code-based development using the Data Science Workshop (DSW) with JupyterLab.
#6about 2 minutes
Announcing the Alibaba Cloud AI Champion 2020 competition
An overview of the AI Champion 2020 competition, which offers cash prizes and cloud credits for innovative projects built on the PAI platform.
#7about 5 minutes
Live demo of data analysis with DataWorks
A walkthrough of the DataWorks interface, demonstrating how to write and execute SQL queries, visualize results, and manage data integration jobs.
#8about 8 minutes
Live demo of building models on the PAI platform
A demonstration of building a recommendation model using the drag-and-drop PAI Studio and running a deep learning example in the PAI-DSW JupyterLab environment.
Related jobs
Jobs that call for the skills explored in this talk.
Matching moments
08:23 MIN
Exploring the serverless ecosystem on Alibaba Cloud
Serverless: Past, Present and Future
15:52 MIN
Showcasing real-time AI application examples
Convert batch code into streaming with Python
25:11 MIN
The production architecture and technology stack for AML AI
Detecting Money Laundering with AI
37:57 MIN
Q&A on AI adoption, tools, and challenges
Navigating the AI Wave in DevOps
08:07 MIN
Building a self-service data and AI workbench
Beyond GPT: Building Unified GenAI Platforms for the Enterprise of Tomorrow
1:03:09 MIN
Q&A on data, learning resources, and algorithms
Machine Learning in ML.NET
10:01 MIN
Exploring Alibaba Cloud's serverless product landscape
Serverless on Cloud
03:13 MIN
Understanding the modern cloud data platform
Modern Data Architectures need Software Engineering
Featured Partners
Related Videos
45:58Data Fabric in Action - How to enhance a Stock Trading App with ML and Data Virtualization
Andreas Christian
1:09:49Inside the AI Revolution: How Microsoft is Empowering the World to Achieve More
Simi Olabisi
41:13Serverless on Cloud
Cheng Zhang
58:21Data Science in Retail
Julian Joseph
22:41Empowering Retail Through Applied Machine Learning
Christoph Fassbach & Daniel Rohr
43:26PySpark - Combining Machine Learning & Big Data
Ayon Roy
26:12AI in Africa: How can we bounce back?
Ayoub Alouane
58:06From Syntax to Singularity: AI’s Impact on Developer Roles
Anna Fritsch-Weninger
From learning to earning
Jobs that call for the skills explored in this talk.
Manager Data Warehouse Lakehouse Developer / Big Data Engineer
ALDI Nord Group
Remote
GIT
Azure
Python
PySpark
+1