Senior Data Engineer

HTC Global Services, Inc.
Dearborn, MI, United States
12 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Application Programming Interfaces (APIs) Amazon Web Services Application Performance Management Microsoft Azure Big Data BigQuery Cloud Computing Cloud Engineering Continuous Delivery Continuous Integration Data as a Services
+34 more
Data Architecture Information Engineering Data Integrity Extract Transform Load (ETL) Data Systems Data Warehousing Database Design Github Apache Hadoop Python (Programming Language) Machine Learning NoSQL Software Architecture Standard Sql Software Engineering Data Streaming Strategies of Testing Data Processing Google Cloud Test-Driven Development (TDD) Sql Optimization Apache Spark Backend Git Data Lakes Kubernetes Apache Flink Deployment Automation Apache Kafka Software Version Control Data Pipelines Docker Service Stack Microservices

Job description

We are seeking an experienced Senior Data Engineer to design, develop, test, and maintain scalable data solutions that support business and customer needs. This role is responsible for designing data architectures, building robust data pipelines, optimizing large-scale data systems, and collaborating with cross-functional teams throughout the software development lifecycle., * Design, develop, test, and maintain scalable software applications and data solutions.

  • Engage with stakeholders to understand business requirements and translate them into effective technical solutions.
  • Design and implement scalable data architectures, including data warehouses, data lakes, and streaming platforms.
  • Develop, maintain, and optimize ETL/ELT pipelines for processing large volumes of data from multiple sources.
  • Assess application requirements and determine appropriate technology stacks, deployment strategies, and integration methods.
  • Create high-level software architecture designs, including system components and interfaces.
  • Collaborate with product owners, architects, designers, and cross-functional teams.
  • Define and implement software testing strategies, policies, and processes.
  • Improve application performance and development efficiency by adopting new technologies and best practices.
  • Apply modern software engineering practices, including test-driven development, continuous integration, and continuous delivery.
  • Support security practices to protect data through encryption and anonymization.
  • Develop user-friendly interfaces where applicable.
  • Develop and maintain backend services, APIs, and microservices.
  • Evaluate emerging technologies and contribute to continuous improvement initiatives.
  • Ensure data integrity, quality, scalability, and performance across all data pipelines.

Requirements

  • Bachelor’s degree.
  • 5+ years of progressive experience in Data Engineering or a related field with a strong focus on large-scale data systems.
  • Expert proficiency in Python or Scala.
  • Advanced SQL skills, including complex querying, data manipulation, and database design.
  • Experience with big data technologies such as Apache Spark, Hadoop, Kafka, and Flink.
  • Experience with cloud platforms including AWS, Azure, or Google Cloud Platform (GCP) and their associated data services.
  • Strong understanding of data warehousing concepts, data modeling (dimensional and relational), and ETL/ELT processes.
  • Experience with NoSQL databases.
  • Experience with Kubernetes, Docker, and cloud infrastructure technologies.
  • Experience with version control systems such as Git.
  • Strong analytical, problem-solving, and critical thinking skills.
  • Excellent communication and interpersonal skills with the ability to present technical information clearly. Preferred Skills

  • GitHub
  • Machine Learning Technical Skills

  • Python
  • Java
  • SQL
  • Apache Spark
  • Apache Hadoop
  • Kafka
  • BigQuery
  • Google Cloud Platform (GCP)
  • Kubernetes
  • Docker
  • NoSQL
  • Cloud Architecture
  • Data Architecture
  • Cloud Infrastructure
  • Big Data

Benefits & conditions

HTC Global Services wants you to join our team. Come build new things with us and advance your career. At HTC Global, you’ll collaborate with experts, work alongside clients, and be part of high-performing teams driving success together. You’ll have long-term opportunities to grow your career and develop skills in the latest emerging technologies.

At HTC Global Services, our employees have access to a comprehensive benefits package. Benefits can include Group Health (Medical, Dental, and Vision), Paid Time Off, Paid Holidays, 401(k) matching, Group Life and Disability insurance, Professional Development opportunities, Wellness programs, and a variety of other perks.

Our success as a company is built on inclusion and diversity. HTC Global Services is committed to providing a workplace free from discrimination and harassment, where every employee is treated with dignity and respect. We celebrate differences and believe that diverse cultures, perspectives, and skills drive innovation and success. HTC is an Equal Opportunity Employer and a proud National Minority Supplier. We seek to empower each individual, fostering an environment where everyone feels valued, included, and respected.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.mitalent.org

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

6:36 min

Funding open source through GitHub Accelerator and Sponsors

Stormy Peters · WWC 2023

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all