Senior Software Engineer - Clickpipes (CDC/Streaming)

As a member of this team, you will be solving complex database-related challenges and distributed systems problems, such as understanding database internals to optimize snapshotting strategy, handling schema evolution during live replication, managing data type compatibility across systems, maintaining low end-to-end latency under unpredictable loads, and leveraging durable execution frameworks to ensure data consistency over unreliable networks. We work in the open - our database integrations are built on PeerDB, an open-source CDC platform we actively maintain and contribute to.

See some of our recent work:

• ClickPipes for Postgres now supports failover replication slots
• MongoDB CDC to ClickHouse with Native JSON Support
• Under the Hood: Building MySQL Change Data Capture in ClickPipes

What You’ll Do:

• Build data-intensive systems
• Design and develop high-throughput integrations with databases (Postgres, MySQL, MongoDB), data lakes (Iceberg, Delta Lake), and data warehouses (BigQuery, Snowflake).
• Handle edge cases in real-world production scenarios: unconventional database setups, internals of data types, database upgrades/failovers, large transactions, etc.

• Design integration solutions to enable users to fully harness ClickHouse’s performance and throughput. Own end-to-end reliability

• Debug complex issues in production leveraging runtime diagnostics (e.g. pprof, parca) and observability tools (e.g. metrics, logging, tracing).
• Build and improve infrastructure and tools to increase system reliability, reduce incident response time, and simplify/automate operations.
• Write clear documentation, both publicly and internally.

• Participate in on-call rotation. Drive product innovation

• Work directly with customers to understand integration requirements and discover gaps in existing product.
• Collaborate cross-functionally with internal teams to ensure operational efficiency.
• Lead technical discussions and influence product roadmaps., * Work on challenging problems at the intersection of database technologies, distributed systems, and cloud-native architecture.
• Work on a team that builds software in the open (PeerDB), and that cares about the craft of engineering, documentations, and continuous learning.
• Be part of a high-visibility team that delivers meaningful impact to customers in a dynamic, hyper-growth environment.

• 5+ years of industry experience building data-intensive software solutions.
• Proficient in Go, or experienced in systems programming with willingness to ramp up quickly in Go.
• Cloud-native experience deploying and operating services on at least one major cloud platform (AWS/GCP/Azure).
• Practical experience with Kubernetes.
• Strong problem solver and solid production debugging skills.
• Clear communication in writing (design docs, code review) and verbally (technical discussions, customer calls, incident response).

Bonus Points

• Experience with database replication technologies (CDC, logical replication).
• Experience with durable execution frameworks (Temporal).
• Experience with data formats and protocols (Avro, Parquet, Protobuf).
• Experience with modern data processing frameworks (e.g. Kafka, Spark, Flink).
• Experience with maintaining/contributing to open-source software.

• Time off - Flexible time off in the US, generous entitlement in other countries.
• A USD$500 Home office setup if you’re a remote employee.
• Global Gatherings - We believe in the power of in-person connection and offer opportunities to engage with colleagues at company-wide offsites.

Culture - We All Shape It

As part of a rapidly scaling start-up, you will be instrumental in shaping our culture.

Are you interested in finding out more about our culture? Learn more about our values here. Check out our blog posts or follow us on LinkedIn to find out more about what’s happening at ClickHouse. Equal Opportunity & Privacy

• Flexible work environment - ClickHouse is a globally distributed company and remote-friendly. We currently operate in over 25 countries.