Data Engineer

THE JUDGE GROUP, INC.
Plano, United States of America
5 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 156K

Job location

Plano, United States of America

Tech stack

Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Bash
Big Data
Cloud Computing
Computer Programming
Databases
Data Definition Language
Data Integrity
ETL
Data Profiling
Data Visualization
Data Warehousing
Relational Databases
Distributed Computing Environment
Identity and Access Management
Python
Korn Shell
NoSQL
Power BI
PL-SQL
SQL Databases
Tableau
Teradata
Unstructured Data
Scripting (Bash/Python/Go/Ruby)
Data Storage Technologies
Cloud Platform System
Snowflake
Spark
Information Technology
Amazon Web Services (AWS)
Non-relational Database
Data Pipelines
Databricks
Programming Languages

Job description

Description: Our client is currently seeking a Data Engineer with strong experience in data modeling, data warehousing, and cloud-based data platforms. The ideal candidate will have hands-on experience with AWS services and a strong foundation in SQL and big data technologies. You will play a key role in building and optimizing scalable data pipelines and ensuring data quality across systems., * Design, develop, and maintain scalable data pipelines and ETL processes

  • Perform data profiling and quality checks to ensure data integrity
  • Work with large datasets in both batch and distributed processing environments
  • Collaborate with cross-functional teams to gather and deliver data requirements
  • Optimize data storage, processing, and querying for performance efficiency

By providing your phone number, you consent to: (1) receive automated text messages and calls from the Judge Group, Inc. and its affiliates (collectively "Judge") to such phone number regarding job opportunities, your job application, and for other related purposes. Message & data rates apply and message frequency may vary. Consistent with Judge's Privacy Policy, information obtained from your consent will not be shared with third parties for marketing/promotional purposes. Reply STOP to opt out of receiving telephone calls and text messages from Judge and HELP for help.

Requirements

  • 5+ years of experience in data modeling, data warehousing, data analysis, and data profiling

  • Strong ability to identify trends, patterns, and anomalies in large datasets

  • Hands-on experience with AWS services, including:

  • S3

  • AWS Glue

  • EMR

  • IAM roles and permissions

Proficiency in one or more query/programming languages:

  • SQL, PL/SQL, DDL
  • SparkSQL, Scala

Experience working with relational databases (e.g., Teradata)

Experience handling both structured and unstructured data

Preferred Qualifications

  • Strong programming skills in SQL and Python

  • Experience with NoSQL / non-relational databases such as:

  • Document stores

  • Key-value databases

  • Graph or column-family databases

Hands-on experience with Snowflake and Databricks

Nice to Have

  • Experience with visualization tools such as Tableau or Power BI
  • Understanding of financial services industry data and business processes
  • AWS certifications (e.g., Cloud Practitioner, Developer Associate)

Education & Additional Skills

  • Bachelor's or Master's degree in Computer Science, Data Science, Statistics, Mathematics, or related field (or equivalent experience)
  • Experience with scripting languages such as Python or Shell (KornShell/Bash)

Apply for this position