Adrian Schmitt

Overview of Machine Learning in Python

Garbage in, garbage out. Your model is only as good as your data. Learn the essential data prep and evaluation workflow in Python.

Overview of Machine Learning in Python
#1about 2 minutes

Understanding the main paradigms of machine learning

Learn the distinctions between supervised, unsupervised, semi-supervised, and reinforcement learning based on data and goals.

#2about 1 minute

Differentiating between regression and classification tasks

Supervised learning is broken down into predicting continuous variables with regression and discrete labels with classification.

#3about 3 minutes

Why data preparation is a critical first step

The principle of 'garbage in, garbage out' highlights the need to analyze and clean data before training any model.

#4about 2 minutes

Converting categorical data into numerical features

Transform non-numerical string data into a machine-readable format using label, ordinal, and one-hot encoding techniques.

#5about 2 minutes

Standardizing numerical data with scaling techniques

Handle large or small numerical values that can negatively impact training by applying scaling methods like min-max or Z-score normalization.

#6about 2 minutes

Choosing a strategy for handling missing data

Address missing values in a dataset by either deleting the affected rows/columns or using imputation to replace them.

#7about 3 minutes

Analyzing a dataset for potential bias and imbalance

A practical example using the adult census dataset demonstrates how to identify and understand biases related to age, sex, and race.

#8about 5 minutes

Splitting data for model training and evaluation

Properly divide your dataset into training and testing sets using strategies like holdout, cross-validation, and stratification to avoid data leakage.

#9about 2 minutes

Using metrics to evaluate model performance

Measure classification model success with accuracy, precision, and F1 score, and regression model success with mean absolute or squared error.

#10about 3 minutes

Understanding overfitting and the bias-variance tradeoff

Find the optimal model complexity by balancing the training error and test error to avoid underfitting or overfitting.

#11about 3 minutes

Tuning hyperparameters and selecting the right algorithm

Optimize model performance by searching for the best parameters with grid search or randomized search, and explore meta-learning for algorithm selection.

#12about 3 minutes

Introduction to decision trees and random forests

Decision trees offer a transparent, white-box model, but random forests typically provide better performance by combining multiple trees.

#13about 7 minutes

Code demo: Preprocessing and training a classifier

A step-by-step Python example shows how to preprocess data, handle missing values, and train decision tree and random forest classifiers using scikit-learn.

#14about 4 minutes

Fundamentals of neural networks and perceptrons

Explore the basic building block of neural networks, the perceptron, and see how they are combined into multi-layer perceptron (MLP) architectures.

#15about 2 minutes

Overview of deep neural networks and architectures

Go beyond simple MLPs to understand deep neural networks and specialized architectures like CNNs for images and RNNs for language.

#16about 2 minutes

Common pitfalls and solutions for neural networks

Address common issues like overfitting with techniques such as dropout and regularization, and tackle the black box problem with model explainers.

#17about 2 minutes

Q&A: Scaling machine learning for large datasets

Handle large datasets by using parallelization to train smaller models simultaneously or by leveraging pre-trained components with transfer learning.

#18about 3 minutes

Q&A: Using scikit-learn for model evaluation

Effectively compare models in scikit-learn by using the built-in metrics module and visualizing results with tools like confusion matrices.

#19about 2 minutes

Q&A: Handling imbalanced datasets during training

Correct for imbalanced target labels in a classification problem by applying oversampling to duplicate instances of the minority class.

#20about 2 minutes

Q&A: Advantages of scikit-learn over other libraries

Scikit-learn is ideal for beginners due to its ease of use and wide variety of algorithms, though specialized libraries offer deeper customization.

#21about 2 minutes

Q&A: Identifying red flags in datasets

Watch for red flags like poor quality data, excessive missing values, and sensitive information that can compromise model performance and ethics.

Related jobs
Jobs that call for the skills explored in this talk.

Matching moments

How AI can create more human moments in HR
03:13 MIN

How AI can create more human moments in HR

The Future of HR Lies in AND – Not in OR

How the HR function has evolved over three decades
05:10 MIN

How the HR function has evolved over three decades

The Future of HR Lies in AND – Not in OR

Shifting from talent acquisition to talent architecture
03:28 MIN

Shifting from talent acquisition to talent architecture

The Future of HR Lies in AND – Not in OR

Balancing business, technology, and people for holistic success
06:51 MIN

Balancing business, technology, and people for holistic success

The Future of HR Lies in AND – Not in OR

Understanding global differences in work culture and motivation
06:10 MIN

Understanding global differences in work culture and motivation

The Future of HR Lies in AND – Not in OR

Moving from 'or' to 'and' thinking in HR strategy
06:59 MIN

Moving from 'or' to 'and' thinking in HR strategy

The Future of HR Lies in AND – Not in OR

Navigating ambiguity as a core HR competency
04:22 MIN

Navigating ambiguity as a core HR competency

The Future of HR Lies in AND – Not in OR

The importance of a fighting spirit to avoid complacency
06:04 MIN

The importance of a fighting spirit to avoid complacency

The Future of HR Lies in AND – Not in OR

Featured Partners

Related Videos

See all videos
Machine learning 101: Where to begin?26:25

Machine learning 101: Where to begin?

Lutske De Leeuw

Getting Started with Machine Learning44:11

Getting Started with Machine Learning

Alexandra Waldherr

Multilingual NLP pipeline up and running from scratch52:37

Multilingual NLP pipeline up and running from scratch

Kateryna Hrytsaienko

Machine Learning for Software Developers (and Knitters)49:45

Machine Learning for Software Developers (and Knitters)

Kris Howard

The pitfalls of Deep Learning - When Neural Networks are not the solution32:54

The pitfalls of Deep Learning - When Neural Networks are not the solution

Adrian Spataru & Bohdan Andrusyak

PySpark - Combining Machine Learning & Big Data43:26

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Data Science in Retail58:21

Data Science in Retail

Julian Joseph

A beginner’s guide to modern natural language processing56:46

A beginner’s guide to modern natural language processing

Jodie Burchell

Related Articles

View all articles
DC
Daniel Cranney
The State of WebDev AI 2025 Results: What Can We Learn?
Introduction The 2025 edition of The State of WebDev AI offers a detailed snapshot of how developers are using AI today, which tools have gained the most traction over the past year, and what these trends suggest about the future of the industry. In...
The State of WebDev AI 2025 Results: What Can We Learn?
CH
Chris Heilmann
With AIs wide open - WeAreDevelopers at All Things Open 2025
Last week our VP of Developer Relations, Chris Heilmann, flew to Raleigh, North Carolina to present at All Things Open . An excellent event he had spoken at a few times in the past and this being the “Lucky 13” edition, he didn’t hesitate to come and...
With AIs wide open - WeAreDevelopers at All Things Open 2025

From learning to earning

Jobs that call for the skills explored in this talk.