Senior Data Engineer (Databricks & Snowflake )

PROLIM Global Corporation
Springfield, IL, United States
4 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Airflow Microsoft Azure Big Data Cloud Computing Cloud Database Information Systems Databases Continuous Integration Information Engineering Extract Transform Load (ETL) Data Warehousing Dimensional Modeling
+27 more
Github Python (Programming Language) Systems Development Life Cycle Power BI Data Mesh SQL Databases Tableau (Software) Azure Service Bus Scripting Azure Data Factory Great Expectations (Foster Youth College-readiness and Support Program) Snowflake Apache Spark Git Microsoft Fabric Data Lakes Pyspark Information Technology Star Schema Apache Kafka Data Management Machine Learning Operations Terraform Azure Synapse Analytics Looker Analytics Data Pipelines Databricks

Job description

We are seeking a Senior Data Engineer with 10+ years of experience and strong production-level expertise in Databricks and Snowflake. The candidate will design and develop scalable data pipelines, cloud data warehouse solutions, and data models for enterprise analytics., * Design and optimize ETL/ELT pipelines using Databricks, PySpark, Python, SQL, and Delta Lake.

  • Develop and maintain Snowflake/Azure Synapse data warehouse solutions, including fact/dimension tables and star schemas.
  • Build logical and physical data models and implement SCD Type 2 and dimensional modeling.
  • Optimize Spark jobs, SQL queries, partitioning, and large-scale data processing.
  • Implement data quality, governance, monitoring, and lineage using Great Expectations/Unity Catalog.
  • Develop workflows using Airflow, Azure Data Factory, or Prefect.
  • Implement CI/CD using Azure DevOps/GitHub Actions, Git, and Terraform.
  • Collaborate with architects, analysts, product managers, and engineering teams to deliver scalable data solutions.

Requirements

Snowflake Schema, Snowflake Schema, Scalable System Development, Cloud Computing, Data Management, Data Modeling, Data Warehousing, Database Extract Transform and Load (ETL), Python Programming/Scripting Language, SQL (Structured Query Language), * 10+ years of Data Engineering experience.

  • Mandatory: Strong production experience with Databricks and Snowflake.
  • Expert Python, SQL, PySpark, and Apache Spark.
  • Strong experience with Delta Lake, Unity Catalog, ETL/ELT, and Data Modeling.
  • Experience with SCD Type 2, dimensional modeling, and cloud data warehousing.
  • Experience with Airflow/Azure Data Factory/Prefect.
  • Strong Git and CI/CD experience.

Preferred

  • Kafka, Event Hubs, or Kinesis.
  • dbt, Terraform, Power BI/Tableau/Looker.
  • Data Mesh/Data Fabric.
  • Databricks certification or MLflow/MLOps experience.

Education: Bachelor’s/Master’s degree in Computer Science, Information Systems, Engineering, or related field.

About the company

PROLIM Global Corporation (www.prolim.com) is currently seeking Senior Data Engineer - Databricks & Snowflake for location, Chicago, IL, United State location for one of our Top clients., PROLIM is a leading provider of end-to-end IT, PLM and Engineering Services and Solutions for Global 1000 companies. They understand business as much as technology, and help their customers improve their profitability and efficiency by providing high value technology consulting, staffing, and project management outsourcing services.

Their IT and PLM consulting offerings include; Advisory, PLM Software/Services, Program Management, Solution Architecture Training/Staffing, Cloud Solutions, Servers/Networking, Infrastructure, ERP Practices and QA Services. Engineering services include Data Translation, CAD/CAM/CAE, Process & Product Engineering, Prototyping, and Testing/Validation within a wide range of markets and industries.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…