Senior Backend Engineer (CDP Engineering)

CDP Customer Profile Platform Design and operate the unified customer profile layer - the core of client CDP - supporting 400M+ profiles with high-throughput ingestion, identity resolution, and real-time enrichment. Architect and build scalable customer profile services supporting 400M+ profiles with sub-second access patterns Implement identity resolution and profile stitching across first-party and third-party data sources - a critical CDP capability Support high-volume batch ingestion, incremental processing, and near real-time profile updates driven by behavioral events Evaluate and implement storage technologies including Cassandra, DynamoDB, ScyllaDB, MongoDB, and PostgreSQL for distinct workload profiles Build attribute enrichment pipelines that continuously improve profile completeness and accuracy Implement data governance controls including consent management, data suppression, and regulatory compliance hooks (CCPA, TCPA) Real-Time Data Ingestion & Event Processing Build the event-driven infrastructure that keeps customer profiles synchronized with what's happening right now - the heartbeat of a modern CDP. Design and build event-driven architectures using Kafka and event streaming platforms for real-time profile updates Implement change data capture (CDC) pipelines to propagate updates from source systems into the CDP profile store Build data synchronization services supporting multi-source fan-in and downstream fan-out to activation channels Implement dead-letter queues, retry strategies, and failure recovery for mission-critical data pipelines Ensure event ordering guarantees and exactly-once processing semantics where required Audience Segmentation Engine Build the high-performance segmentation engine that enables marketers to define and generate audiences of any complexity at scale. Design and build an audience generation service capable of evaluating complex nested filter logic across 400M+ profiles Support attribute-based filtering, hierarchical attribute traversal, AND/OR conditional logic, inclusion and exclusion criteria Implement dynamic audience generation with real-time estimation to support pre-activation reach planning Optimize query execution using columnar storage, pre-aggregation, and intelligent caching strategies Build audience snapshot and version management to support reproducibility and campaign history Integrate with the CDP profile store to ensure segmentation reflects the most current available profile state Campaign Management & Lifecycle Services Build the durable, consistent services that manage campaign definitions from creation through execution. Develop APIs for campaign creation, versioning, configuration, approval, scheduling, and lifecycle transitions Persist campaign definitions, segmentation rules, targeting criteria, and execution metadata with full audit support Implement campaign versioning and change tracking to support rollback, comparison, and governance requirements Build approval workflow services supporting configurable multi-stage review before campaign activation Analytics & Audience Insights Build the analytical layer that gives users visibility into audience composition, campaign reach, and performance - a defining capability of enterprise CDPs. Build services providing real-time audience size estimation, reachability calculations, and channel eligibility analysis Implement segment distribution analytics - demographic breakdowns, attribute frequency distributions, overlap analysis Support both real-time query serving and scheduled batch analytical workloads Build historical campaign reporting infrastructure for performance analysis and optimization feedback loops Expose analytical APIs that the UI layer can leverage for interactive exploration Activation & Multi-Channel Delivery Implement the delivery layer that gets audience segments into activation channels reliably and at scale. Build file-based delivery to Amazon S3, Azure Blob Storage, and Google Cloud Storage for downstream consumption Implement API-based delivery to internal and external partner systems via REST and event-based integrations Build event-based delivery using Kafka topics, Event Hubs, and Pub/Sub systems Implement delivery monitoring, configurable retry policies, and failure recovery with full observability Support delivery SLAs with alerting and automated escalation for time-sensitive campaign activations Campaign Execution Orchestration Build the orchestration layer that reliably executes campaign activations on schedule and at scale. Design and build an orchestration service supporting one-time, recurring, and scheduled campaign activations Implement distributed scheduling with fault tolerance, retry, and idempotent execution guarantees Build execution monitoring with real-time status tracking, alerting, and SLA enforcement Support parallel execution across large audience segments with configurable concurrency and rate limiting Security, Multi-Tenancy & Governance Implement Role-Based Access Control (RBAC) with fine-grained permissions at workspace, campaign, and data levels Build multi-workspace architecture with strict data isolation and cross-workspace access controls Implement audit logging for all data access, mutation events, and system actions Integrate data governance controls supporting consent flags, data suppression lists, and regulatory requirements Build security monitoring and anomaly detection for sensitive customer data access patterns Platform Reliability & Observability Build observability solutions including metrics, structured logging, distributed tracing, and alerting Define and instrument SLIs, SLOs, and SLAs across all platform services Implement capacity planning tooling and auto-scaling patterns for traffic variability Conduct regular chaos engineering and failure mode analysis to improve platform resilience TECHNICAL SKILLS Languages Databases Java / Kotlin (primary) Cassandra / ScyllaDB Python DynamoDB Go MongoDB SQL PostgreSQL / Aurora Scala (preferred) Redis / ElastiCache Streaming & Messaging Cloud & Infrastructure Apache Kafka AWS (primary) Event Streaming Platforms Azure Message Queues (SQS, Pub/Sub) Google Cloud Platform Change Data Capture (Debezium) Kubernetes / Docker CI/CD Pipelines Architecture Patterns Data & Observability Microservices Architecture Spark / Flink (batch/stream) Event-Driven Architecture dbt / Data Modeling REST APIs / gRPC OpenTelemetry / Jaeger Distributed Systems Prometheus / Grafana

Mandatory Areas: Senior Backend Engineer with Audience Builder Platform and CDP Must have Skills Java, API, Kafka, CDP Skill 1 7Yrs of Exp Cassandra, DynamoDB, ScyllaDB Skill 2 7Yrs of Exp MongoDB, and PostgreSQL Skill 3 5Yrs of Exp in IT Role: Senior Backend Engineer (Audience Builder Platform - Customer Data Platform Engineering), CDP & MARKETING TECHNOLOGY EXPERIENCE Customer Data Platform (CDP) design and implementation at scale Identity resolution, profile unification, and customer graph management Real-time segment evaluation engines with sub-second SLAs Consent management and data governance for regulatory compliance (CCPA, TCPA, GDPR) Campaign Management System or Marketing Automation Platform engineering Customer profile platforms supporting 100M+ profiles PLATFORM & SYSTEMS EXPERIENCE High-throughput distributed data ingestion pipelines (billions of events/day)

• $91,700-163,700 per year Optum is a global organization that delivers care, aided by technology, to help millions of people live healthier lives. The work you do with our team will directly improve health …

• 1 day ago

Bright Vision Technologies + Little Elm, TX + $100,000-150,000 per year Bright Vision Technologies is a forward-thinking software development company dedicated to building innovative solutions that help businesses automate and optimize their operations… + 2 days ago