Lead Data Engineer

Georgia Tek Systems

San Francisco, CA, United States

11 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Working hours

Regular working hours

Job source

www.careerbuilder.com

Tech stack

Adobe Creative Cloud Artificial Intelligence Automation of Tests Microsoft Azure Big Data Cloud Computing Cloud Engineering Software Quality Continuous Delivery Continuous Integration Software Design Patterns DevOps

+17 more

Distributed Systems Apache Hive Python (Programming Language) Scala (Programming Language) Software Engineering SQL Databases Workflow Management Systems Data Processing Scripting Azure Data Factory Adobe Campaign Spark Streaming Data Management Machine Learning Operations Data Pipelines Databricks Programming Languages

Job description

Lead endtoend MarTech engineering initiatives across orchestration, data processing, and activation pipelines.
Architect scalable, eventdriven systems that power realtime marketing experiences and automated customer journeys.
Design and implement orchestration workflows using Adobe Campaign or equivalent enterprisegrade tools. Develop highperformance bigdata applications using Scala, Databricks, Spark SQL, Spark Streaming, and Python. Build and optimize cloudnative data pipelines on Azure, including ADFbased ingestion, transformation, and orchestration.
Apply modern design patterns to ensure reliability, maintainability, and scalability across distributed systems.
Drive AIassisted engineering practices including Vibe Coding and other generativeAI development accelerators.
Collaborate with product, marketing, and data teams to translate business needs into robust technical solutions.
Mentor engineers and elevate engineering standards, code quality, and operational excellence within the POD.

Requirements

Deep expertise in MarTech platforms with handson experience in Adobe Campaign or similar orchestration tools.
Strong proficiency in bigdata technologies: Scala, Databricks, Spark SQL, Spark Streaming, Python.
Cloud engineering experience with Azure services, including Azure Data Factory. Advanced system design capabilities including eventdriven architectures and distributed design patterns.
Experience with AIaugmented development such as Vibe Coding or comparable frameworks.
Proven ability to lead engineering teams in a fastpaced, crossfunctional environment.
Strong communication and stakeholder alignment skills with the ability to translate technical concepts into business impact.
Preferred Qualifications Experience in largescale marketing ecosystems (ESP, CDP, personalization engines, realtime decisioning).
Background in highvolume data processing supporting customer engagement or growth marketing. Familiarity with DevOps practices including CI/CD, observability, and automated testing.
Exposure to modern AI/ML pipelines for personalization, segmentation, or content automation.

Skills: Adobe Product Family, Artificial Intelligence (AI), Automation, Campaigns, Cloud Computing, Communication Skills, Continuous Deployment/Delivery, Continuous Integration, Customer Support/Service, Data Management, Data Processing, Design Patterns Programming Methodologies, DevOps, Distributed Computing, Ecosystems, Engagement Marketing, Engineering, Leadership, Marketing, Mentoring, Microsoft Windows Azure, Product Marketing, Python Programming/Scripting Language, SQL (Structured Query Language), Scala Programming Language, Software Development, Systems Scalability, Team Lead/Manager, Test Automation