Konstantin Bespalov

How to implement convenient Python bindings to C++

How do you make a C++ library feel truly Pythonic? Learn to create high-performance bindings with full IDE support, intuitive syntax, and multiprocessing compatibility.

How to implement convenient Python bindings to C++
#1about 4 minutes

The business case for Python bindings to a C++ library

A C++ financial pricing library required a Python interface for quantitative analysts to perform research and development.

#2about 2 minutes

Evaluating an initial approach using .NET integration

The first attempt used a .NET assembly with pythonnet, but it suffered from poor performance and a lack of IDE support.

#3about 4 minutes

Choosing pybind11 for direct C++ to Python bindings

Pybind11 was selected over the Python/C API for its ability to minimize boilerplate code when creating direct C++ bindings.

#4about 2 minutes

Identifying usability gaps in the initial pybind11 bindings

The initial pybind11 implementation still lacked crucial features like type hints, Pythonic collections, and pickling support for multiprocessing.

#5about 2 minutes

Adding IDE support and type hints with stub files

PEP 484 and .pyi stub files provide a type interface for the C++ extension module, enabling autocompletion and navigation in IDEs.

#6about 2 minutes

Creating a Pythonic API with variants and magic methods

Using std::variant simplifies function arguments and implementing magic methods like __iter__ makes C++ collections behave like native Python ones.

#7about 1 minute

Enabling multiprocessing with custom pickling support

The copy_reg module is used to register custom serialization and deserialization functions, making C++ objects picklable for multiprocessing.

#8about 1 minute

Summarizing the solution and using code generation

The final solution combines pybind11 with several enhancements, and a code generator is recommended to maintain the bindings for large projects.

#9about 2 minutes

Q&A on exceptions, SWIG, and code generation tooling

The speaker answers audience questions about propagating C++ exceptions, comparing pybind11 to SWIG, and the specific code generator used.

Related jobs
Jobs that call for the skills explored in this talk.

Matching moments

Proposing new patterns for enterprise Python development
23:07 MIN

Proposing new patterns for enterprise Python development

Enterprise Python: Software That Lives Long And Prosper

Accelerating language support with numba-cuda and nupack
14:53 MIN

Accelerating language support with numba-cuda and nupack

CUDA in Python

Navigating language-specific binding challenges
13:40 MIN

Navigating language-specific binding challenges

How AWS Generates Polyglot Libraries Based on a Single TypeScript Codebase

A progressive approach to programming GPUs in Python
28:27 MIN

A progressive approach to programming GPUs in Python

Accelerating Python on GPUs

Leveraging vernacular developers for faster innovation
17:39 MIN

Leveraging vernacular developers for faster innovation

Enterprise Python: Software That Lives Long And Prosper

Adopting a philosophy of configuration without configuration files
06:33 MIN

Adopting a philosophy of configuration without configuration files

Automagic Configuration in Python

Overcoming challenges in automotive software deployment
30:10 MIN

Overcoming challenges in automotive software deployment

Intelligent Data Selection for Continual Learning of AI Functions

Key benefits of using Python-native streaming frameworks
36:33 MIN

Key benefits of using Python-native streaming frameworks

Python-Based Data Streaming Pipelines Within Minutes

Featured Partners

Related Videos

See all videos
CUDA in Python21:02

CUDA in Python

Andy Terrel

Python: Behind the Scenes25:29

Python: Behind the Scenes

Diana Gastrin

The best of both worlds: Combining Python and Kotlin for Machine Learning26:28

The best of both worlds: Combining Python and Kotlin for Machine Learning

Nils Kasseckert

Python-Based Data Streaming Pipelines Within Minutes39:04

Python-Based Data Streaming Pipelines Within Minutes

Bobur Umurzokov

Enjoying SQL data pipelines with dbt26:53

Enjoying SQL data pipelines with dbt

Matthias Niehoff

101 brilliant things of C++45:27

101 brilliant things of C++

Andreas Fertig

C++ in constrained environments1:00:16

C++ in constrained environments

Bjarne Stroustrup

Designing gRPC APIs - The things they don't tell you27:17

Designing gRPC APIs - The things they don't tell you

Bastian Eicher

Related Articles

View all articles
DN
Dr. Andy R. Terrel - NVIDIA
What’s the latest in NVIDIA CUDA Python
Python and NVIDIA CUDA have long been friends. Over the last year, NVIDIA teams are working to improve the Pythonista’s experience. This means a top-to-bottom update to the CUDA Platform is fueling the GenAI movement, e.g. llama3, gpt and nemo. These...
What’s the latest in NVIDIA CUDA Python
BB
Benedikt Bischof
PyLadies Vienna
‍What is Pyladies Vienna all about?‍Pyladies is an international movement that aims to encourage more women to get into IT. There are many local chapters and the organization is still growing. Even though Vienna and Austria are modern there is still ...
PyLadies Vienna

From learning to earning

Jobs that call for the skills explored in this talk.

Python Quant Developer

Python Quant Developer

Clerkenwell
Charing Cross, United Kingdom

Senior
R
Python
Grafana
Data analysis
Machine Learning