WeAreDevelopers Logo WeAreDevelopers
Sign in
For You LIVE
Back

Data Engineer II

IntraEdge, Inc.
United States
3 days ago
Apply on jobs.intraedge.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source
jobs.intraedge.com

Tech stack

Airflow Data Analysis BigQuery Cloud Storage Continuous Integration Data Governance Database Design Github Apache Hive Python (Programming Language) Standard Sql Cloudera
+4 more
Google Cloud Data Ingestion Pyspark Data Management

Requirements

  • Experience building, deploying, supporting data ingestion and batch applications on Cornerstone / Google Cloud / LUMI using capabilities such as BigQuery, Cloud Storage, Dataproc, Cloud Composer/Airflow.
  • Strong SQL, Python, PySpark, Hive
  • Must have good knowledge of data management principles, data governance and database design concepts
  • Internal Amex experience with Cornerstone/Lumi
  • Strong understanding of governance processes
  • Strong Data Analysis skills
  • Clear and effective communicator
  • Strong collaborator with multiple business and technology teams
  • Preferred hands-on experience with CI/CD tools such as XLR, GitHub Actions
  • Able to guide technical teams for delivery across time zones
  • Prior experience in American Express Technology is a SIGNIFIC

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.intraedge.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

Moments

Explore playlists

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · World Congress 2023

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all
From Messy Queries to Scalable Systems - How Data Engineering actually works thumbnail
31:15
World Congress 2026 Europe • about 2 months ago

From Messy Queries to Scalable Systems - How Data Engineering actually works

Sandhya Menon

PySpark - Combining Machine Learning & Big Data thumbnail
43:26
LIVE • almost 6 years ago

PySpark - Combining Machine Learning & Big Data

Ayon Roy

Data Science in Retail thumbnail
58:21
LIVE • over 3 years ago

Data Science in Retail

Julian Joseph

Innovating Developer Tools with AI: Insights from GitHub Next thumbnail
42:38
LIVE • over 1 year ago

Innovating Developer Tools with AI: Insights from GitHub Next

Krzystof Czieslak

Empowering Retail Through Applied Machine Learning thumbnail
22:41
World Congress 2024 • about 2 years ago

Empowering Retail Through Applied Machine Learning

Christoph Fassbach, Daniel Rohr

Enjoying SQL data pipelines with dbt thumbnail
26:53
World Congress 2023 • almost 3 years ago

Enjoying SQL data pipelines with dbt

Matthias Niehoff

Related articles

See all