Senior Data Engineer

APLOMB Technologies
Dallas, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 114K

Job location

Dallas, United States of America

Tech stack

Java
Agile Methodologies
Amazon Web Services (AWS)
Azure
Bash
Big Data
Cloud Computing
Data Architecture
Data Infrastructure
ETL
Data Systems
Data Warehousing
Relational Databases
Database Design
Electronic Data Interchange (EDI)
Hadoop
Hive
Python
Linked Data
Shell
Machine Learning
Microsoft SQL Server
Oracle Applications
Azure
Shell Script
SQL Databases
Talend
Unstructured Data
Data Processing
Scripting (Bash/Python/Go/Ruby)
Data Storage Technologies
Informatica Powercenter
Spark
Vba Programming Language
REST
Looker Analytics
Data Pipelines

Job description

We are seeking a highly skilled and motivated Senior Data Engineer to lead the design, development, and maintenance of our enterprise data infrastructure. In this dynamic role, you will harness the power of big data technologies and cloud platforms to enable insightful analytics and data-driven decision-making. Your expertise will drive the creation of scalable data pipelines, optimize data storage solutions, and support advanced analytics initiatives. Join us to empower our organization with innovative data solutions that fuel growth and strategic insights., * Design, develop, and optimize robust ETL (Extract, Transform, Load) processes to integrate data from diverse sources such as AWS, Azure Data Lake, Hadoop, and on-premises systems.

  • Build scalable data pipelines utilizing Apache Spark, Hadoop ecosystem components (e.g., Hive), and Python scripting to process large volumes of structured and unstructured data efficiently.
  • Develop and maintain data warehouses leveraging SQL Server, Oracle, and other relational databases; ensure high performance and security standards.
  • Collaborate with cross-functional teams to implement data models, database designs, and linked data architectures that support analytics and reporting needs.
  • Utilize tools like Talend, Informatica, and Shell Scripting to automate workflows and streamline data processing tasks.
  • Integrate RESTful APIs for seamless data exchange between systems; support model training activities for machine learning initiatives.
  • Work within Agile methodologies to deliver continuous improvements in data infrastructure while maintaining documentation for compliance and knowledge sharing.

Requirements

  • Proven experience as a Data Engineer or similar role with a focus on big data technologies such as Hadoop, Spark, Hive, and Azure Data Lake.
  • Strong proficiency in SQL (including Microsoft SQL Server and Oracle), Python, Java, Bash (Unix shell), Shell Scripting, and VBA for automation and analysis tasks.
  • Hands-on experience designing scalable data warehouses and implementing ETL pipelines using tools like Talend or Informatica.
  • Familiarity with cloud platforms such as AWS and Azure for deploying large-scale data solutions.
  • Knowledge of database design principles, linked data concepts, RESTful API integration, and model training techniques for machine learning applications.
  • Excellent analysis skills with the ability to interpret complex datasets; experience with Looker or similar BI tools is a plus.
  • Strong understanding of Agile development practices to facilitate iterative project delivery in fast-paced environments. Join us as a Senior Data Engineer to shape the future of our organization's data landscape! Bring your passion for innovation, technical expertise in big data ecosystems, cloud platforms, and analytics to help us unlock valuable insights that drive strategic success. We're committed to fostering an inclusive environment where your skills can thrive-empowering you every step of the way!

Benefits & conditions

Pay: $50.00 - $55.00 per hour

Apply for this position