Data Engineer III 4P/598

4P Consulting Inc.
Birmingham, AL, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours

Tech stack

Application Programming Interfaces (APIs) Agile Methodology Artificial Intelligence Business Analytics Applications Data Analysis Microsoft Azure Big Data Cloud Computing Cloud Database Continuous Integration Information Engineering Data Security
+37 more
Relational Databases DevOps Apache Hadoop Apache Hive Python (Programming Language) Key Management Machine Learning Microsoft SQL Server Microsoft Business Intelligence NoSQL OpenShift Oracle (Applications) Systems Development Life Cycle Power BI DataOps Azure Data Lake Software Engineering SQL Databases SQL Server Integration Services SQL Server Analysis Services Web Services Azure Data Factory Informatica Powercenter Snowflake Apache Spark Containerization Data Lakes Star Schema Oracle Golden Gate Data Management Machine Learning Operations Api Design Stream Processing Azure Synapse Analytics Data Pipelines Docker Databricks

Job description

The Data Engineer III is responsible for designing, building, and optimizing scalable data pipelines and analytics solutions across relational databases, NoSQL systems, and cloud-based data lake environments. This role focuses on transforming raw data into reliable, structured, and machine-readable formats that support enterprise analytics, AI/ML initiatives, and operational reporting.

The ideal candidate brings strong experience in SQL, big data frameworks, cloud platforms, and modern data engineering best practices., * Design and implement data models (star schema, snowflake, relational, NoSQL)

  • Implement data access strategies and storage optimization techniques
  • Develop functional and technical designs for data engineering solutions
  • Support diverse data source integration and enrichment

Big Data & Cloud Technologies

  • Develop solutions using Spark, Hive, Hadoop
  • Build and maintain solutions using Azure ecosystem tools:
  • Azure Data Lake
  • Azure Data Factory
  • Azure Databricks
  • Azure Synapse
  • Azure Key Vault
  • Power BI
  • Work with MSBI tools (SSIS, SSAS), Informatica, Oracle Golden Gate

AI/ML & Advanced Analytics Support

  • Support statistical models and AI/ML solutions using Python and/or R
  • Prepare data pipelines to enable machine learning workflows

DevOps & Modern Engineering Practices

  • Implement CI/CD pipelines for data engineering deployments
  • Work within Agile development environments
  • Utilize containerization tools (Docker, OpenShift)
  • Develop API and web service integrations for data sourcing and delivery

Requirements

NoSQL, Data Management, Cloud Computing, Data Lake, Artificial Intelligence (AI), Relational Databases (RDBMS), Scalable System Development, Data Analysis, Software Engineering, Best Practices, * 5-10 years of hands-on data engineering experience

  • Advanced SQL expertise
  • Strong experience with Spark, Hive, Hadoop
  • Hands-on experience with Azure cloud data tools
  • Experience building Databricks pipelines
  • Experience with MSBI (SSIS/SSAS), Informatica, Oracle, SQL Server
  • Experience with batch and real-time data processing frameworks
  • Experience with data modeling and schema design
  • Experience working with APIs and web services

Preferred Qualifications

  • Experience supporting AI/ML workflows
  • Experience with containerization (Docker, OpenShift)
  • Strong background in DevOps and CI/CD practices
  • Experience working in enterprise-scale environments

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…