Data Engineer

Vertex, Inc.

Minneapolis, MN, United States

2 months ago

Apply on dice.com

Prepare application

Role details

Contract type

Temporary to permanent

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

7 years minimum

Working hours

Regular working hours

Job source

dice.com

Tech stack

Airflow Amazon Web Services Microsoft Azure Cloud Computing Continuous Integration Data Architecture Data Validation Information Engineering Github Python (Programming Language) Cloud Services Standard Sql

+14 more

Azure Data Lake SQL Databases Workflow Management Systems Parquet Google Cloud Azure Data Factory Snowflake Microsoft Fabric Data Lakes Pyspark Data Management Software Version Control Data Pipelines Databricks

Job description

Senior, handson data engineering contractor to support Modern data platform delivery across Health Payer Domains. This role requires independent ownership of endtoend data pipelines using modern cloud and Lakehouse architecture. This is a hitthegroundrunning role with minimal rampup., * Design, build, and operate endtoend data pipelines

Source ingestion transformation analyticsready datasets
Develop transformations and data models using SQL and Python
Implement automated data quality checks and validations
Follow Gitbased development
Collaborate with business/domain stakeholders on data rules and definitions
Ensure solutions are secure, auditable, reliable, and supportable
Produce clear technical documentation and operational notes

Required Technologies (MustHave)

Candidates must have strong, recent handson experience with most of the following:

Languages:

SQL
Python (PySpark preferred)

Data Platforms / Storage:

Cloud data platforms (Azure preferred; AWS/Google Cloud Platform acceptable)
Azure Data Lake Storage Gen2 (ADLS Gen2) or equivalent
Object storage based data lakes
Parquet format
Lakehouse concepts (Iceberg and/or Delta)

Transformation & Modeling:

dbt (dbt Core and/or dbt Cloud)

Source Control, GitOps & CI/CD:

GitHub
Pull request based development
CI/CD pipelines (GitHub Actions or equivalent)

Compute (one or more):

Snowflake
Microsoft Fabric
Databricks

Preferred / NicetoHave Technologies:

Microsoft Fabric Data Factory / Azure Data Factory
Fabric or Databricks Notebooks
Orchestration tools (Airflow, Dagster, or similar)
Healthcare / payer domain experience (Clinical, Claims, Provider)

Requirements

heavy Azure experience with that Lakehouse, Data Lake and SQL and Python experience necessary to be successful. Also must have the dbt experience as well!, * 7+ years of handson data engineering experience

Proven delivery of productiongrade data pipelines
Experience working independently with minimal supervision
Strong understanding of data quality, reliability, and operational readiness, * Senior, handson data engineer
Engineering generalist (not toolonly or reportingonly)
Comfortable working in ambiguous, fastmoving environments
Strong delivery and ownership mindset