Data Engineer II
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+25 more
Job description
The Data Engineer II plays an important role within , focused on delivering engineering innovation within , helping to execute the delivery of key business initiatives. S/he acts as a βuniversal translatorβ between IT, business, software engineers and data scientists, collaborating with these multi-disciplinary teams. The Data Engineer II will contribute to the adherence of technical standards for data engineering, including the selection and refinements of foundational technical components. S/he will work on those aspects of the platform that govern the ingestion, transformation, and pipelining of data assets, both to end users within FedEx and into data products and services that may be externally facing. Day-to-day, s/he will be deeply involved in code development and medium-scale deployments., * Build and operate data pipelines on GCP: implement batch and streaming workflows using Dataflow (Beam), Dataproc/Spark, Pub/Sub, Transfer Service, and Cloud Storage.
- Develop and maintain BigQuery datasets and ETL/ELT jobs: design schemas, implement partitioning/clustering, write performant SQL, and create materialized views where appropriate.
- Implement data ingestion patterns and CDC integrations (Datastream, Pub/Sub connectors, or Kafka bridging) and handle schema evolution and backfills.
- Author reliable, testable pipeline code and artifacts (Python/Java/Scala), implement unit/integration tests, and enforce schema/versioning practices.
- Instrument pipelines and jobs for observability: add logging, metrics, traces; configure Cloud Monitoring/Logging alerts and data-SLIs for freshness/completeness.
- Implement data quality checks and validation (Great Expectations, custom checks) and escalate data incidents; participate in runbook creation and incident response.
- Apply security and compliance controls in day-to-day work: follow dataset IAM patterns, use Workload Identity/Service Accounts, integrate Secret Manager and Cloud KMS/CMEK where needed, and apply DLP patterns for PII.
- Collaborate in design reviews and follow architecture/playbooks defined by senior architects/advisors; propose practical improvements and flag risks.
- Contribute to CI/CD and deployment for data workloads: templated Dataflow deployments, Airflow/Composer DAG management, Terraform basics for provisioning data resources.
- Optimize cost and performance at the implementation level: query tuning, storage format choices (Parquet/Avro), lifecycle policies for Cloud Storage, and recommend reservation/slot sizing for BigQuery.
- Produce clear documentation and runbooks for owned pipelines, mentor junior engineers and hand off operational ownership where applicable.
Requirements
- 2-3 years of professional data engineering experience (or equivalent), with hands-on ownership of data pipelines and analytics workloads.
- 1-2 years working with GCP data services: BigQuery, Dataflow (Beam), Pub/Sub, Cloud Storage, Dataproc, and Cloud Composer (Airflow).
- Strong SQL skills and practical programming experience in Python, Java, or Scala; production experience with Spark or Beam preferred.
- Familiarity with streaming patterns, CDC, and at least one message/streaming system (Pub/Sub, Kafka).
- Experience with data quality/testing frameworks (Great Expectations, Deequ) and observability tooling (Cloud Monitoring/Logging, tracing for Dataflow/Dataproc).
- Working knowledge of GCP security features relevant to data (dataset IAM, VPC Service Controls awareness, Secret Manager, Cloud KMS basics).
- Experience with version control (Git), CI/CD pipelines, and basic infrastructure-as-code (Terraform) for provisioning and reproducible deployments.
- Good problem-solving and collaboration skills; able to communicate technical issues and tradeoffs to peers and stakeholders.
- Google Professional Data Engineer certification or similar cloud/data cert is a plus but not required. *
Minimum Education
Bachelorβs Degree in Computer Science, Information Systems, a related quantitative field such as Engineering or Mathematics or equivalent formal training or work experience.
Minimum Experience
Two (2) years equivalent work experience in measurement and analysis, quantitative business problem solving, simulation development and/or predictive analytics. Strong knowledge in data engineering and machine learning frameworks including design, development and implementation of highly complex systems and data pipelines. Strong knowledge in Information Systems including design, development and implementation of large batch or online transaction-based systems. Strong understanding of the transportation industry, competitors, and evolving technologies. Experience as a member of multi-functional project teams. Strong oral and written communication skills. A related advanced degree may offset the related experience requirements.
Preferred Qualifications:
Pay Transparency
Benefits & conditions
Pay: US: $7,094.23/mo - $15,607.31/mo, CO: $7,094.23/mo - $14,957.01/mo, MD: $7,488.36/mo - $15,607.31/mo, NJ: $7,488.36/mo - $15,607.31/mo, NY: $7,488.36/mo - $15,607.31/mo, NYC: $9,064.85/mo - $15,607.31/mo, WA: $7,488.36/mo - $15,607.31/mo
Additional Details
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦