Data Engineer

Select Minds LLC
Dallas, United States of America
4 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English

Job location

Remote
Dallas, United States of America

Tech stack

Kubernetes Security
Agile Methodologies
Amazon Web Services (AWS)
Business Analytics Applications
Unit Testing
Big Data
Cloud Computing
Software Quality
Continuous Integration
Information Engineering
Data Infrastructure
Data Integrity
ETL
Data Systems
JSON
Simple Data Format
SQL Databases
XML
Parquet
Reliability of Systems
Servicebus
Data Lake
Data Management
Data Delivery
Data Pipelines

Job description

Work with limited supervision to design, develop, and support data engineering and analytics solutions while providing guidance on end-to-end analytic solution implementation. Collaborate with cross-functional teams to create customized data infrastructure, run comprehensive tests to isolate and resolve errors, and ensure system reliability. Continuously update and enhance data systems to adapt to changing business requirements, ensuring scalability, efficiency, and accuracy across analytics platforms. Responsibilities Design, assemble, and manage large, complex datasets that fulfill both functional and non-functional business requirements. Develop and implement process improvements, including infrastructure redesign for scalability, optimized data delivery, and automation of manual workflows. Build robust data infrastructure for efficient extraction, transformation, and loading (ETL) from multiple sources using AWS and SQL technologies. Create analytical tools and data pipelines that provide actionable insights into key business metrics such as operational efficiency and customer acquisition. Collaborate with cross-functional teams-including Data, Product, Design, and Executive leadership-to support data infrastructure needs and resolve data-related technical challenges. Innovate and adapt technology or tools to address evolving business and user needs. Perform additional duties as assigned by leadership.

Requirements

Intermediate-level expertise in cloud infrastructure and Data Lake environments Strong ETL experience ensuring end-to-end source-to-target data integrity Proficiency with multiple file formats, including Delimited Text, Fixed Width, XML, JSON, and Parquet Experience with ServiceBus configuration (ingress/egress) or equivalent AWS cloud service administration Hands-on experience with unit testing, code quality tools, CI/CD technologies, and container security practices Background in Agile development with active participation in Agile ceremonies and practices Flexible work from home options available.

Apply for this position