WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
World Congress 2021 • Jul 30, 2021

Data Science on Software Data

Markus Harrer

Struggling to convince management to fix technical debt? Discover how to use Python and Jupyter to turn version control history into data-driven arguments for structural investments.

Pause
Mute Enter Fullscreen
#1 about 2 min

Analyzing legacy systems using software data

Applying data analysis approaches to extract insights and improve decisions regarding legacy software architecture.

#2 about 3 min

Competing priorities between technical improvements and feature development

Competing business priorities cause necessary architectural updates to struggle for budget against highly visible feature requests and defect resolution.

#3 about 6 min

Transferability challenges in standard software analytics models

Early empirical software engineering research demonstrated the inability to transfer quality metrics across different unique IT projects.

#4 about 5 min

Choosing software analytics over standard static analysis tools

Moving beyond standard style checkers involves building specific analytical views that address unique project problems.

#5 about 2 min

Baseline developer skills for software data science

Standard software developers already possess the required quantitative, programming, and domain expertise to perform data science.

#6 about 3 min

Establishing reproducible data science with openness and automation

Integrating data tools into the continuous delivery pipeline achieves transparent and automated code analysis.

#7 about 6 min

Extracting insights from various types of software data

Mining static, runtime, chronological, and community development data exposes abandoned code and structural hotspots.

#8 about 6 min

Building a data analysis stack with Python and Jupyter

Utilizing Python, pandas, and computational notebooks documents and executes analytical assumptions transparently.

#9 about 7 min

Analyzing production code coverage data using pandas

Reading Jacoco execution traces into data frames visualizes unused application packages via grouped bar charts.

#10 about 3 min

Utilizing graph analytics and Neo4j for structural dependencies

Querying an interconnected code base modeled inside a graph database identifies code smells and architectural bounds.

#11 about 2 min

Core takeaways for adopting software data analytics workflows

Effective data analysis relies on custom tooling and verifiable, action-driven results rather than generating unapplied metrics.

#12 about 8 min

Resolving real-world performance bottlenecks through targeted data analysis

Custom dependency graphing isolated the exact Java object duplications that choked application scalability in production.

Matching moments

56 sec

Introduction to analytical data formats for software developers

Matthias Niehoff Matthias Niehoff · World Congress 2026 Europe

3:40 min

Identifying core challenges in modern software development

Markus Eisele Markus Eisele · World Congress 2024

3:27 min

Transitioning away from dominant management with objective analytics

Laura Möller Laura Möller +3 · World Congress 2024

5:19 min

Unifying core software principles for better team performance

Richard Bown · World Congress 2023

5:39 min

Managing legacy infrastructure and distributed software systems

Daniel Geisel Daniel Geisel +1 · World Congress 2026 Europe

6:14 min

Historical evolution of software delivery and agile methodologies

More from World Congress 2021

Micro Frontends with Module Federation: Why and How? thumbnail
45:40
about 5 years ago

Micro Frontends with Module Federation: Why and How?

Manfred Steyer

The journey from developer to devops - what i've learnt along the way thumbnail
42:44
about 5 years ago

The journey from developer to devops - what i've learnt along the way

Liam Hurrel, Alireza Chegini

How Data is Shaping our Games thumbnail
43:30
about 5 years ago

How Data is Shaping our Games

Johanna Pirker

Cross platform Augmented Reality development with React Native thumbnail
40:50
about 5 years ago

Cross platform Augmented Reality development with React Native

Vladimir Novick

How to Build a Monetization Strategy Based on User's in-app Behavior thumbnail
38:59
about 5 years ago

How to Build a Monetization Strategy Based on User's in-app Behavior

Natalie Sieradzki

Angular <> Angular CDK - Awesomeness Combined thumbnail
35:49
about 5 years ago

Angular <> Angular CDK - Awesomeness Combined

Muhammad Ahsan Ayaz

Upcoming sessions on this topic

Open session

World Congress 2026 North America

September 23, 2026 · 15:40–16:10

Stage 2

Lean Intelligence: Lessons from GitHub Copilot Data Science Efforts

Rahul Pandita

Researcher and Technical Advisor at Microsoft

Rahul Pandita
Open session

World Congress 2026 North America

September 25, 2026 · 12:55–13:25

Stage 7

The spectrum of agentic coding: From vibe coding to high-quality software engineering

YK Sugi

Developer Experience Manager at Eventual

YK Sugi
Open session

World Congress 2026 North America

September 25, 2026 · 14:10–14:40

Stage 1

The Broken Rung: How AI is Rebuilding Software Development from the Ground Up

Tomislav Tipurić

Chief Technology Officer, Nephos

Tomislav Tipurić
Open session

World Congress 2026 North America

September 25, 2026 · 11:40–12:10

Stage 9

You Can’t Re-Run Sunlight: Designing ML Data Architectures for Physical AI

An Phan

Senior Data Infrastructure Engineer @ Hippo Harvest

An Phan
Open session

World Congress 2026 North America

September 24, 2026 · 15:30–16:00

Stage 3

The New Bottleneck in Software Development

Aditya Jayaprakash

Co-Founder & CEO at Blacksmith

Aditya Jayaprakash
Open session

World Congress 2026 North America

September 25, 2026 · 16:50–17:20

Stage 4

Engineering Moneyball: How We Benchmarked Google vs Meta

Jirka Bachel

Co-Founder & CEO

Jirka Bachel

Related videos

Getting to Know Your Legacy (System) with AI-Driven Software Archeology thumbnail
29:18
World Congress 2025 • about 1 year ago

Getting to Know Your Legacy (System) with AI-Driven Software Archeology

Markus Harrer

Modern Data Architectures need Software Engineering thumbnail
29:25
World Congress 2024 • about 2 years ago

Modern Data Architectures need Software Engineering

Matthias Niehoff

Grappling With Clunky Old Software? Start by Understanding What’s Inside! thumbnail
30:23
World Congress 2024 • about 2 years ago

Grappling With Clunky Old Software? Start by Understanding What’s Inside!

Luc Perard

Confessions of a Software Archaeologist: What I Did Wrong in 10 Years of Restructuring Software thumbnail
27:50
World Congress 2026 Europe • 2 months ago

Confessions of a Software Archaeologist: What I Did Wrong in 10 Years of Restructuring Software

Hendrik Lösch

Your Code as a Crime Scene thumbnail
20:18
Coffee With Developers • over 1 year ago

Your Code as a Crime Scene

Adam Tornhill

From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail
31:15
World Congress 2026 Europe • 2 months ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

Related articles

From learning to earning

Jobs that call for the skills explored in this talk.