Data Engineer

Select Minds LLC

Dallas, TX, United States

3 days ago

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Working hours

Regular working hours

Job source

www.wayup.com

Tech stack

Kubernetes Security Agile Methodology Amazon Web Services Business Analytics Applications Unit Testing Big Data Cloud Computing Software Quality Continuous Integration Information Engineering Data Infrastructure Data Integrity

+13 more

Extract Transform Load (ETL) Data Systems JSON Simple Data Format SQL Databases Extensible Markup Language (XML) Parquet Reliability of Systems Servicebus Data Lakes Data Management Data Delivery Data Pipelines

Job description

Work with limited supervision to design, develop, and support data engineering and analytics solutions while providing guidance on end-to-end analytic solution implementation. Collaborate with cross-functional teams to create customized data infrastructure, run comprehensive tests to isolate and resolve errors, and ensure system reliability. Continuously update and enhance data systems to adapt to changing business requirements, ensuring scalability, efficiency, and accuracy across analytics platforms. Responsibilities Design, assemble, and manage large, complex datasets that fulfill both functional and non-functional business requirements. Develop and implement process improvements, including infrastructure redesign for scalability, optimized data delivery, and automation of manual workflows. Build robust data infrastructure for efficient extraction, transformation, and loading (ETL) from multiple sources using AWS and SQL technologies. Create analytical tools and data pipelines that provide actionable insights into key business metrics such as operational efficiency and customer acquisition. Collaborate with cross-functional teams-including Data, Product, Design, and Executive leadership-to support data infrastructure needs and resolve data-related technical challenges. Innovate and adapt technology or tools to address evolving business and user needs. Perform additional duties as assigned by leadership.

Requirements

Intermediate-level expertise in cloud infrastructure and Data Lake environments Strong ETL experience ensuring end-to-end source-to-target data integrity Proficiency with multiple file formats, including Delimited Text, Fixed Width, XML, JSON, and Parquet Experience with ServiceBus configuration (ingress/egress) or equivalent AWS cloud service administration Hands-on experience with unit testing, code quality tools, CI/CD technologies, and container security practices Background in Agile development with active participation in Agile ceremonies and practices Flexible work from home options available.