Daniel Raniz Raneland

CI/CD Patterns and Antipatterns - Things your Pipeline Should (Not) Do

Is your CI pipeline a slow, frustrating ritual? Learn the patterns to eliminate flaky builds, reduce developer wait times, and ship code faster.

CI/CD Patterns and Antipatterns - Things your Pipeline Should (Not) Do
#1about 2 minutes

The hidden costs of slow and frustrating CI/CD pipelines

Slow, frustrating, and wasteful CI/CD pipelines interrupt developer flow and have a negative environmental impact.

#2about 3 minutes

Antipattern: Running the same pipeline for every trigger

The 'ritual' antipattern involves wastefully running identical, comprehensive pipelines for pull requests, merges, and nightly schedules.

#3about 3 minutes

Use conditional logic to run only necessary steps

Create context-specific pipelines for different triggers and use path filtering to run only the jobs relevant to the code that has changed.

#4about 2 minutes

Antipattern: Stop hoarding unnecessary build artifacts

The 'hoarding' antipattern wastes storage and makes navigation difficult by keeping every build artifact indefinitely instead of using automated cleanup.

#5about 2 minutes

Antipattern: Order pipeline steps for the fastest feedback

Prioritize tests that are most likely to fail, such as integration tests, to get feedback faster instead of following a conventional testing pyramid order.

#6about 3 minutes

Antipattern: Break monolithic pipelines into parallel jobs

Replace a single, long-running sequential pipeline with multiple parallel jobs for independent components like frontend and backend to significantly reduce wall-clock time.

#7about 7 minutes

Antipattern: Use caching and tooling images to avoid redundant work

Leverage caching for dependencies, build outputs, and Docker layers, and use pre-built tooling images to avoid starting from scratch on every run.

#8about 2 minutes

Antipattern: Prevent pipeline interference with unique identifiers

Avoid race conditions where concurrent pipelines overwrite shared resources like a 'latest' tag by using unique identifiers like the Git SHA for artifacts.

#9about 4 minutes

Antipattern: Properly size your build agents and runners

Ensure build agents are at least as powerful as developer machines to prevent resource-related failures, and consider self-hosted runners for full control over hardware.

#10about 1 minute

Recap of key CI/CD patterns and antipatterns

A summary of common pipeline pitfalls and the corresponding best practices for creating faster, more reliable, and efficient CI/CD workflows.

Related jobs
Jobs that call for the skills explored in this talk.

Featured Partners

Related Articles

View all articles
DC
Daniel Cranney
Dev Digest 159: AI Pipelines, 10x Faster TypeScript, How to Interview
Inside last week’s Dev Digest 159 . 🤖 How to use LLMs to help you write code ⚡ How much electricity does AI need? 🔒 Is your API secure? Learn all about hardening it… 🟦 TypeScript switches to go and gets 10 times faster 🖼️ An image cropper in your ap...
Dev Digest 159: AI Pipelines, 10x Faster TypeScript, How to Interview
DC
Daniel Cranney
Why Attend a Developer Event?
Modern software engineering moves too fast for documentation alone. Attending a world-class event is about shifting from tactical execution to strategic leadership. Skill Diversification: Break out of your specific tech stack to see how the industry...
Why Attend a Developer Event?
DC
Daniel Cranney
Dev Digest 188: CfP time, the risks of NPM and IKEA algorithms
Inside last week’s Dev Digest 188 . 🤖 GitHub Copilot CLI is now in public review 💻 Microsoft is bringing ‘vibe working’ to office apps 🎣 Attackers abuse AI tools to generate captchas in fishing attacks ⚠️ When LLMs autonomously attack 🧠 Common cause...
Dev Digest 188: CfP time, the risks of NPM and IKEA algorithms

From learning to earning

Jobs that call for the skills explored in this talk.

Solution Architect

ING
Amsterdam, Netherlands

Senior
Java
Solution Architecture
Business Process Management (BPM)
Software Engineer

Code Healers LLC
Hinesville, United States of America

Remote
40-50K
Intermediate
Senior
PHP
.NET
React
+2