Software Engineer III (Data Engineering)

Epitec, Inc.

Dearborn, MI, United States

about 1 month ago

Apply on www.indeed.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Compensation

$112,320.0

Working hours

Shift work

Job source

www.indeed.com

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Amazon Web Services Software Applications Application Performance Management Microsoft Azure Big Data BigQuery Cloud Computing Cloud Database Cloud Engineering Data Architecture

+23 more

Information Engineering Extract Transform Load (ETL) Data Security Data Warehousing Database Design Database Queries Github Apache Hadoop Python (Programming Language) Machine Learning NoSQL Software Architecture Software Engineering Strategies of Testing Google Cloud Sql Optimization Apache Spark Kubernetes Deployment Automation Data Management Data Pipelines Docker Microservices

Job description

We’re looking for an experienced Software Engineer III with a strong background in Data Engineering to help design, build, and optimize large-scale data platforms and applications. This role will focus on data architecture, cloud technologies, big data systems, and scalable data pipelines supporting enterprise-level solutions., * Design, develop, test, and maintain software applications and data platforms.

Lead the design and implementation of scalable data architectures, including data lakes, data warehouses, and streaming platforms.
Develop, optimize, and maintain complex ETL/ELT pipelines for large-scale data processing.
Build and support APIs, microservices, and cloud-based solutions.
Collaborate with cross-functional teams including product owners, architects, and designers.
Create high-level software architecture and deployment strategies.
Improve application performance, scalability, and reliability.
Implement software testing strategies and best practices.
Support data security, governance, encryption, and privacy initiatives.
Continuously evaluate and adopt new technologies to improve development efficiency.

Requirements

5+ years of progressive experience in Data Engineering or a related field.
Strong experience with:
Python
Apache Spark
Hadoop
Kafka
Kubernetes
Docker
NoSQL Databases
Google Cloud Platform (GCP)
BigQuery
Cloud Infrastructure & Cloud Architecture
Data Architecture & Data Management
Advanced SQL skills, including complex queries and database design.
Experience building and supporting large-scale data pipelines and data platforms.
Strong understanding of data modeling, data warehousing, and ETL/ELT processes.
Experience with cloud-based data services and platforms.
Excellent problem-solving, analytical, and communication skills.
Experience working within Agile development environments., * GitHub experience
Machine Learning experience
Experience with AWS or Azure cloud platforms
Experience leading technical discussions and mentoring team members