Data Engineer

Copart, Inc.
Dallas, United States of America
10 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Dallas, United States of America

Tech stack

Java
Artificial Intelligence
Airflow
Amazon Web Services (AWS)
Business Analytics Applications
Azure
Big Data
Google BigQuery
Databases
Data Infrastructure
ETL
Data Transformation
Data Warehousing
Data Flow Control
Python
Microsoft SQL Server
MySQL
Oracle Business Intelligence Enterprise Edition
Oracle Applications
Pentaho Data Integration
Power BI
Scala
SQL Databases
Data Streaming
Tableau
Workflow Management Systems
Data Logging
Data Processing
Google Cloud Platform
Netezza
Snowflake
Build Management
Information Technology
Google BigQuery
Kafka
Vertica
Stream Processing
Looker Analytics
Data Pipelines
MemSQL
Redshift

Job description

  • Design and build the next-generation AI ready data platform.
  • Develop and automate data processing systems leveraging DBT to deliver data insights at an enterprise scale.
  • Design and implement workflow orchestration using Airflow / Cloud Composer for seamless data pipeline execution and scheduling across multiple systems.
  • Develop logging, metrics, and alerts for active monitoring of processes.
  • Collaborate with Product Managers and Application teams to create data models and schemas for easy access to complex datasets.
  • Maintain data integrity in production systems.
  • Balance and prioritize multiple conflicting requirements with high attention to detail.

Requirements

  • Bachelor's degree or higher in Computer Science, Engineering, or related field.
  • 3-5 years of experience designing, developing, testing, and implementing scalable, high-performing data warehouse and BI solutions.
  • Enterprise development experience with databases (SQL Server, Oracle, MySQL, Vertica, MemSQL, Netezza, Redshift, Google BigQuery.
  • Hands-on experience with real-time data pipelines (Pub/Sub, Kinesis, Kafka) and database architecture (including MPP).
  • Experience with ETL/ELT and data transformation tools (DBT, DataFlow, Informatica).
  • Hands-on experience with workflow orchestration platforms (Apache Airflow, Prefect, Dagster, Cloud Composer).
  • Proficiency in BI/Analytical tools (Tableau, Looker, OBIEE, Power BI).
  • Strong analytical skills to translate complex business problems into actionable insights.
  • Exceptional communication and analytical skills with demonstrated ability to engage both technical and business audiences.

Technical Skills

  • Programming: Python, SQL, Java, Scala
  • Cloud Platforms: AWS, Google Cloud Platform, Azure
  • Data Warehousing: BigQuery, Redshift, Snowflake
  • Stream Processing: Apache Kafka, AWS Kinesis, Google Pub/Sub
  • Workflow Orchestration: Apache Airflow, Prefect, Dagster, Cloud Composer
  • BI Tools: Tableau, Pentaho, Looker, Power BI, Thoughtspot

About the company

Copart, Inc. a technology leader and the premier online vehicle auction platform globally, with over 200 facilities located across the world, Copart links vehicle sellers to more than 750,000 buyers in over 190 countries. We believe in providing an unmatched experience, every day and everywhere, driven by our people, processes, and technology.

Apply for this position