> Markdown version of [/jobs/ext/227278-senior-data-engineer-python-ci-cd](https://www.wearedevelopers.com/jobs/ext/227278-senior-data-engineer-python-ci-cd). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - Python, CI/CD - **Company:** Clickhouse Inc - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $84,000.0 - $143,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Business Logic, Code Review, Continuous Integration, Data Architecture, Extract Transform Load (ETL), Data Mart, Data Migration, Data Warehousing, Dimensional Modeling, Github, Integrated Development Environments, Python (Programming Language), Standard Sql, DataOps, SQL Databases, Information Technology, Enterprise Integration, Vertica, Data Pipelines - **Published:** May 14, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=e080fd03b67aa874 ## About the Role Do you have experience in SQL?, Do you have a Bachelor's degree?, Required: * Exceptional SQL skills - this is non-negotiable. * Strong hands-on experience with Airflow, dbt, and Python. * Proven track record building and optimizing large-scale, high-throughput data pipelines. * Solid understanding of data warehousing fundamentals: ETL/ELT, dimensional modeling, and data quality. * Bachelor's degree in Computer Science or a related field. * Comfortable thriving in a fast-paced startup environment - exciting and dynamic, but sometimes wonderfully chaotic. Preferred: * Hands-on experience with ClickHouse - a significant advantage. * Familiarity with AWS or other cloud platforms. * Experience with CI/CD development, especially using GitHub Actions. ## Description * DWH Platform Development * Design and develop reusable Airflow components - operators, connectors, and hooks - along with custom integrations tailored to our data architecture. * Build reusable dbt macros and abstractions: incremental strategies, ETL building blocks, and generic data quality tests, all optimized for ClickHouse-specific behavior and our data patterns. * Develop DataOps tooling - CI pipelines, data migration frameworks, and security controls - with a strong focus on reliability, self-service usability, and scale. * Team contributions * Conduct thorough code reviews for team members and other team contributors. * Actively participate in technical and architectural design discussions. * Drive technical leadership in specific areas of our stack. * Continuously improve the team's development environment, with a focus on automation - including AI-assisted workflows. * Contribute to platform stability through proactive troubleshooting and timely incident resolution. * Data modeling * Develop, refactor, and optimize business data models in line with our modeling standards and ClickHouse best practices. * Mentor and support contributors through code reviews and technical guidance. * Lead the design and implementation of the most technically demanding data marts - particularly those involving high data velocity, large volumes, or complex business logic. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Python-Based Data Streaming Pipelines Within Minutes](https://www.wearedevelopers.com/videos/1233-python-based-data-streaming-pipelines-within-minutes) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) - [Bringing AI Model Testing and Prompt Management to Your Codebase with GitHub Models](https://www.wearedevelopers.com/videos/1536-bringing-ai-model-testing-and-prompt-management-to-your-codebase-with-github-models) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)