Data Engineer

ICAT Logistics
United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$68,510.0 - $80,600.0
Working hours
Regular working hours
Job source

Tech stack

Microsoft Word Microsoft Excel Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Architectural Patterns Microsoft Azure Business Intelligence Development BigQuery Information Systems Databases Data Architecture
+30 more
Data Validation Information Engineering Data Governance Data Integrity Extract Transform Load (ETL) Data Structures Data Warehousing Relational Databases UN Electronic Data Interchange for Administration Commerce and Transport Python (Programming Language) PostgreSQL Meta-Data Management Microsoft Office Radio-Frequency Identification Performance Tuning Cloud Services SQL Databases Data Processing File Transfer Protocol (FTP) Warehouse Management Systems System Availability Snowflake Indexer Data Lakes Information Technology SAP TM Api Design Azure Synapse Analytics Data Pipelines Amazon Redshift

Job description

The Data Engineer is responsible for designing, building, and maintaining the data pipelines, models, and storage systems that power analytics, reporting, and AI-driven solutions across the logistics lifecycle. This role ensures data from TMS, WMS, ERP, CRM, carrier integrations, and customer systems is accurate, accessible, well-structured, and ready for insight generation. The ideal candidate understands how logistics businesses operate and has hands-on experience building scalable data lake and data warehouse architectures., Data Modeling & Data Architecture

  • Design, build, and maintain dimensional and relational data models optimized for logistics workflows (shipments, quotes, invoices, routings, tracking events, carrier performance, etc.)
  • Define data standards, naming conventions, and schema documentation to ensure consistency across the enterprise
  • Align data warehouse structures with operations, finance, sales, and compliance reporting needs
  • Work with outsourced development teams

Data Pipeline Development

  • Develop scalable ETL/ELT pipelines to ingest data from:
  • Transportation Management Systems (e.g., CargoWise, Magaya, MercuryGate, Descartes)
  • Warehouse systems, yard systems, and barcode/RFID sources
  • Carrier EDI/API feeds (air, ocean, LTL, TL, parcel)
  • Customer integrations (via API, FTP, SFTP, VAN, SCAC matching, etc.)
  • Implement automated workflows to ensure near-real-time visibility and reliable data refresh cycles

Data Lake & Data Warehouse Ownership

  • Manage cloud data lake storage layers (raw, refined, curated zones)
  • Design and optimize data warehouse schemas for analytics and BI consumption
  • Implement partitioning, indexing, compression, and performance tuning strategies

Data Quality & Governance

  • Develop automated data validation, error handling, audit, and reconciliation processes
  • Ensure data integrity and traceability across ingestion, transformation, and publishing layers
  • Work with compliance teams to align data handling with ITAR, CMMC, CTPAT, ITAR, SOC2, GDPR, and customer contractual requirements

Cross-Functional Collaboration

  • Partner with data analysts, BI developers, AI/ML engineers, and product teams to support dashboards, operational insights, and predictive analytics use cases
  • Work with business teams (operations, finance, sales, customer service) to translate business rules into data logic
  • Provide technical guidance on data availability, meaning, lineage, and usage best practices

Other duties as assigned

Requirements

Do you have experience in SQL?, Do you have a Bachelor’s degree?, * Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or related field

  • 3+ years of direct experience building data pipelines in production environments within transportation, logistics, or supply chain industries
  • Strong experience with:
  • SQL, Python, and ETL/ELT frameworks
  • Cloud data platforms (AWS, Azure, or GCP)
  • Data warehouse technologies (Snowflake, Redshift, BigQuery, Synapse, or PostgreSQL)
  • Data lake architecture patterns (object storage, Delta/Iceberg/Hudi formats, metadata management)
  • Familiarity with logistics or supply chain systems and data structures
  • Preferred experience with:
  • TMS/WMS system databases (CargoWise, Magaya, WorldTrak, Descartes, MercuryGate, SAP TM, Manhattan, Blue Yonder, etc.)
  • integrating EDI (X12, EDIFACT), API-driven vendors, or telematics data
  • understanding of shipment lifecycle events, cost allocation, and carrier/payables workflows
  • Exposure to MDM, data cataloging, or data governance frameworks
  • Advanced skills with Microsoft Office products (with an emphasis on Word, PPT and Excel)

Key Competencies

  • Strong system thinking and architectural leadership
  • Strong Troubleshooting & Data Integrity Mindset
  • Continuous Improvement & Optimization Focus
  • Lead by example, a highly motivated team player with an outgoing and positive work attitude
  • Strong problem-solving, negotiation, and decision-making skills
  • Ability to work in a time-sensitive environment
  • Desire and drive to learn and grow
  • Well organized, able to plan and effectively set priorities for implementation
  • Ability to be flexible as priorities shift
  • Demonstrated ability to work in a client centric environment
  • Ability to relate to and successfully interact across a variety of settings and work well with a broad and diverse workforce throughout the organization
  • Outstanding communication skills - Excellent verbal and written with an emphasis on listening
  • Understanding and responsive to situations that require a sense of urgency
  • Consistent in follow-up and follow-through
  • Credible with a high level of personal integrity
  • Adaptive to ICAT’s core values

Supervisory Responsibilities: No direct supervision but lead project teams

Benefits & conditions

3.93.9 out of 5 stars United States Remote $68,510 - $80,600 a year - Full-time

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:36 min

Analyzing limitations with PostgreSQL bitmap heap scans

Dharin Shah Dharin Shah · World Congress 2025

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph · LIVE

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

1:32 min

Generating functional runtime database columns using indexer properties

Halil İbrahim Kalkan Halil İbrahim Kalkan · World Congress 2026 Europe

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:27 min

Explaining query execution overhead and caching limitations in BigQuery

Adnan Rahic · JS Congress

Videos

See all

Related articles

See all