Data Engineer(Google Cloud Platform / Airflow / SQL / Python

Factspan Inc
Atlanta, GA, United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Adobe Experience Manager Agile Methodology Airflow BigQuery Continuous Integration Data Validation Information Engineering Extract Transform Load (ETL) Data Profiling DevOps Data Flow Control Python (Programming Language)
+15 more
Oracle (Applications) Performance Tuning Scrum Methodology Responsive Web Design SAS (Software) SQL Databases Data Streaming Data Logging Google Cloud Data Ingestion Delivery Pipeline Adobe Data Lakes Information Technology Data Pipelines

Job description

This role is part of the MarTech Data Engineering POD supporting a large-scale ESP (Email Service Provider) migration program from Oracle Responsys to Adobe Journey Optimizer. The initiative aims to build a scalable, real-time marketing data foundation integrating customer journeys, preference orchestration, and omnichannel personalization across email, mobile, and direct channels., The offshore team will focus on designing, building, and maintaining data pipelines across SAS, OES, Wunderkind, and AEP (Adobe Experience Platform), enabling real-time campaign execution and advanced targeting capabilities., Design and develop data ingestion, transformation, and orchestration pipelines using Google Cloud Platform (BigQuery, Dataflow, Cloud Composer) and Airflow. Implement and maintain data integrations between AEP and data lake, ensuring high performance and scalability. Build and optimize ETL/ELT workflows to support campaign orchestration, preference logic, and audience segmentation. Implement data quality checks, monitoring, and exception handling frameworks to ensure clean and reliable data. Work closely with Lead DE and SME to translate campaign archetypes into data pipelines and orchestration rules. Support performance tuning, data reconciliation, and defect resolution during testing and hypercare phases. Collaborate with QA team for end-to-end test validation and ensure production readiness. Participate in daily Agile ceremonies, sprint reviews, and deployment planning.

Requirements

Strong hands-on experience in Google Cloud Platform services: BigQuery, Dataflow, GCS, Cloud Composer (Airflow). Proficiency in SQL for data profiling, transformation, and performance optimization. Proficiency in Python for pipeline automation, scripting, and orchestration. Experience building batch and streaming data pipelines. Exposure to working with marketing or customer engagement platforms is a plus. Understanding of data quality, logging, monitoring, and alerting best practices.

Preferred Skills Experience in Airflow DAG development for complex data pipelines. Familiarity with MarTech platforms such as Adobe Experience Platform or similar ESPs. Knowledge of data modeling for campaign orchestration and audience segmentation. Experience with CI/CD and DevOps principles for data deployments. Strong troubleshooting and performance tuning skills. Soft Skills & Attributes Strong problem-solving skills and attention to detail. Ability to work effectively in a distributed global POD model (onsite + offshore). Proactive communication and ownership mindset. Comfortable working in fast-paced agile environments with tight timelines. Excellent verbal and written communication skills.

Education Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field. Google Cloud Platform certifications (e.g., Professional Data Engineer) preferred but not mandatory.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

1:17 min

Eco-friendly factory operations and generative AI image errors

Chris Heilmann +1 · LIVE

2:17 min

Mapping the maturity roadmap for scaled devops adoption

Dominik Krichbaum Dominik Krichbaum · WWC Europe 2026

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

59 sec

Evaluating intrusive system modifications by enterprise software

Chris Heilmann +2 · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

Videos

See all

Related articles

See all