Databricks Data Engineer

INSYSTECH, INC.

St. Louis, MO, United States

5 days ago

Apply on www.careerjet.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

6 years minimum

Compensation

$85,500.0 - $130,000.0

Working hours

Regular working hours

Job source

www.careerjet.com

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Cloud Computing Data Architecture Information Engineering Data Governance Data Infrastructure Data Warehousing Software Design Patterns Dimensional Modeling Python (Programming Language)

+16 more

Meta-Data Management Data Streaming Enterprise Data Management Cloud Platform System Azure Data Factory Sql Optimization Snowflake Git Data Lakes Pyspark Collibra Data Management Cloud Migration Data Pipelines Service Stack Databricks

Job description

Lead design and delivery of comprehensive data platform architectures leveraging Databricks, Snowflake, Delta Lake, and cloud platforms (AWS/Azure).
Senior architectural role combining deep hands-on expertise across multiple data technologies.
Design scalable, secure, and cost-optimized solutions for enterprise health insurance operations., * Establish data architecture standards, best practices, and frameworks
Lead design of Databricks and Snowflake integrated ecosystems
Architect Unified Data Platforms (UDP) and modern data stacks
Design cloud infrastructure on AWS or Azure for data workloads
Develop data governance, security, and compliance frameworks
Establish cost optimization strategies across data platforms

Deliverables

Lead technical strategy and platform modernization initiatives
Mentor and guide data engineering teams
Conduct architecture reviews and optimization assessments
Support cloud migrations and complex data transformations

Requirements

Security Clearance: Visa Independent (Green Card holder or US Citizen) Must Haves

Visa Independent: Green Card holder or US Citizen
6-8+ years of enterprise-scale data architecture experience
Demonstrated hands-on implementation experience (not just design)
Architectural thinking and design patterns knowledge
Experience designing solutions for multiple technology stacks
Strong leadership and stakeholder management skills
Excellent communication and presentation abilities
Ability to work hybrid, flexible location from list above, * Deep expertise in at least 3 of: Databricks, Snowflake, Delta Lake, Python, PySpark
Advanced SQL and data warehouse design patterns (dimensional modeling, star schemas)
Cloud platform expertise: AWS or Azure (architecture and optimization)
Experience designing Unified Data Platform (UDP) and modern data stack architectures
Python and PySpark for data engineering framework development
Experience with both batch and streaming data architectures
Data governance, security, and compliance framework design
Git and CI/CD pipeline expertise

Nice-to-Have

Healthcare or insurance industry experience
Certifications: Databricks, Snowflake, AWS Solutions Architect, Azure Data Engineer
Experience leading data platform transformation or modernization projects
Knowledge of data governance tools and metadata management
ML/AI pipeline architecture experience
Enterprise data mesh or data fabric architecture experience
Experience with Fivetran, dbt, or similar modern data tools
Published architecture patterns or thought leadership