Data Engineer

Home Depot USA Inc.
Atlanta, GA, United States
about 1 month ago
Apply on dejobs.org
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$110,000.0 - $125,000.0
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Apache HTTP Server BigQuery Cloud Database Databases Extract Transform Load (ETL) Data Stores Data Warehousing Dimensional Modeling Data Flow Control R (Programming Language) Apache Hadoop
+14 more
MATLAB Message Oriented Middleware SAS (Software) Data Streaming Apex Code Data Processing Data Ingestion Apache Spark KSQL Apache Flink Apache Kafka Vertica Data Pipelines Apache Beam

Job description

For this role, we are looking for someone who can design, build, and maintain the data models, transformations, and pipelines that turn raw contact center data into trusted metrics and datasets in a cloud-based data warehouse. This person will own metric logic and data quality, partner with operations and enterprise data teams, and hold source system owners to quality standards in support of Customer Solutions and Data Science initiatives that drive better customer experiences and more profitable outcomes., * 20% Implement a real time streaming data ingestion and processing pipeline using Google Dataflow (Apache Beam)

  • 20% Interface with business intelligence analyst and others in IT (i.e. data engineers, architects, WebOps) in frequent whiteboard sessions to discuss the design, implementation, and testing of data pipelines
  • 20% Maintain data architecture standards and ETL/ELT best practices consistent with a column oriented data store in an analytic use case
  • 20% Active and engaged participation in the Scrum delivery process
  • 20% Support solutions in production

Direct Manager/Direct Reports:

  • Position Reports to Sr Mgr. of EDW
  • This position has 0 direct reports

Travel Requirements:

  • Typically requires overnight travel less than 10% of the time.

Physical Requirements:

  • Most of the time is spent sitting in a comfortable position and there is frequent opportunity to move about. On rare occasions there may be a need to move or lift light articles.

Requirements

  • Must be eighteen years of age or older.
  • Must be legally permitted to work in the United States.

Preferred Qualifications:

  • Familiarity with Agile methodologies
  • Experience with Spark dataframes, SparkSQL, Kafka, KSQL, real-time streaming, and message bus technologies
  • Experience with data science technologies such as SAS, R, Matlab, or similar
  • Experience with data warehousing and dimensional modeling

Minimum Education:

  • The knowledge, skills and abilities typically acquired through the completion of a bachelor’s degree program or equivalent degree in a field of study related to the job.

Preferred Education:

  • No additional education

Minimum Years of Work Experience:

  • 6

Preferred Years of Work Experience:

  • No additional years of experience, * Experience in building real time streaming data ingestion and processing pipeline using Apache Beam (running on either Google Datflow or Apache (Apex, Flink, or Spark) or Kafka in an analytics or data science use case
  • Experience with data processing tools (e.g. Hadoop, Spark, Dataflow, etc.)
  • Experience building ETL/ELT pipelines
  • Experience with column-oriented databases (e.g Redhift, BigQuery, Vertica)
  • Ability to go from whiteboard discussion to code
  • Ability to effectively communicate with technical and non-technical audiences
  • Strong programming ability
  • Success in a highly dynamic environment and ability to shift priorities with agility
  • Ability to act independently with minimal supervision
  • Willingness to explore and implement new ideas and technologies
  • Experience working directly with subject matter experts in both business and technology domains
  • Experience as a team lead

Benefits & conditions

  • Located in a comfortable indoor area. Any unpleasant conditions would be infrequent and not objectionable., We are an Equal Opportunity Employer and do not discriminate against any employee or applicant for employment because of race, color, sex, age, national origin, religion, sexual orientation, gender identity, status as a veteran, and basis of disability or any other federal, state or local protected class. - $110,000.00 - $125,000.00

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dejobs.org
Prepare application

Good distractions

Loading talks and stories from around this role…