Data Engineer

Apidel Technologies
United States
29 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Amazon Web Services JIRA Cloud Database Continuous Integration Information Engineering Data Governance Extract Transform Load (ETL) Data Systems DevOps Python (Programming Language) PostgreSQL
+10 more
Software Engineering SQL Databases Apache Spark Git Information Technology Data Lineage Data Pipelines Docker Jenkins Databricks

Job description

· Design, develop, and maintain data pipelines, infrastructure, and systems using AWS, Python, Databricks, Spark, and PostgreSQL

· Collaborate with cross-functional teams to translate business requirements into technical solutions

· Provide technical guidance and mentorship to junior data engineers

· Develop and implement data engineering standards and best practices

· Monitor and troubleshoot data pipelines to ensure data quality, integrity, and availability

· Research industry trends and evaluate new data technologies

· Build and maintain data lakes to support analytics and business intelligence

· Manage the software development life cycle and DevOps activities

Requirements

· Bachelor’s degree in computer science, information technology, or a related field

· Five or more years of experience in data engineering or a related role

· Expert proficiency in Python, SQL, Databricks, and Spark

· Experience building cloud-based data pipelines in AWS

· Knowledge of data governance, security, privacy, and retention practices

· Strong communication, collaboration, and problem-solving skills

· Experience working in agile environments using tools such as Jira

· Proficiency with Git, Docker, and CI tools such as Jenkins

· Passion for data and continuous improvement

Preferred qualifications:

· Ability to work independently and proactively

· Experience optimizing ETL workflows in Databricks

· Knowledge of data lineage and data quality practices

· Experience supporting data science and machine learning solutions

· Prior experience in the energy or utility industry

Master’s degree in a relevant STEM field

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:05 min

Integrating an assistant application with Jira software

Felix Augenstein · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

2:57 min

Core technical practices for robust data engineering

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all