Databricks Architect - Remote / Telecommute

CYNET SYSTEMS INC.

Bolingbrook, IL, United States

3 days ago

Apply on www.dice.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Experienced

Experience required

3 years minimum

Compensation

$114,400.0 - $124,800.0

Working hours

Regular working hours

Job source

www.dice.com

Tech stack

Amazon Web Services Microsoft Azure Information Systems Continuous Integration Information Engineering Data Governance Data Infrastructure Data Integration Extract Transform Load (ETL) Data Warehousing DevOps Identity and Access Management

+17 more

Power BI DataOps SQL Databases Data Streaming Tableau (Software) Google Cloud Apache Spark Data Lakes Pyspark Kubernetes Information Technology Apache Kafka Data Management Machine Learning Operations Data Lakehouse Stream Processing Databricks

Job description

Design and implement scalable data lakehouse architectures using Databricks.
Define enterprise data models, governance standards, and security controls.
Lead migration of legacy data warehouses and ETL workloads to Databricks.
Architect batch and real-time data processing solutions using Spark.
Optimize performance, scalability, reliability, and cost efficiency.
Collaborate with business stakeholders, data engineers, data scientists, and cloud architects.
Establish CI/CD, monitoring, and operational best practices for data platforms.
Provide technical leadership and mentor engineering teams.

Requirements

8+ years of data engineering and data platform experience.
3+ years of hands-on Databricks architecture experience.
Strong expertise in Apache Spark, PySpark, SQL, and Delta Lake.
Experience with Azure Databricks, AWS Databricks, or Google Cloud Platform Databricks.
Strong expertise in streaming platforms: Google Cloud Platform Pub/Sub, Azure Event Hubs, AWS Kinesis, Apache Kafka.
Hands-on experience with producer/consumer architecture decisions and trade-offs.
Knowledge of data lakehouse architecture and data governance.
Experience with data integration tools and orchestration frameworks.
Strong understanding of security, access management, and compliance requirements., * Databricks Certified Data Engineer Professional or equivalent.
Experience with Unity Catalog, Delta Live Tables, and Databricks Workflows.
Experience with Power BI, Tableau, or other BI platforms.
Knowledge of DataOps, DevOps, and MLOps practices.
Master s degree preferred.

Skills:

Databricks.
Apache Spark.
PySpark.
SQL.
Delta Lake.
Azure.
AWS.
Google Cloud Platform.
Google Cloud Platform Pub/Sub.
Azure Event Hubs.
AWS Kinesis.
Apache Kafka.
Data Lakehouse.
ETL.
CI/CD.

Qualification And Education:

Bachelor s degree in Computer Science, Engineering, Information Systems, or related field.

Benefits & conditions

Our Benefits Include:

Medical, Dental, and Vision Insurance
401(k) Retirement Plan
Health Savings Account (HSA)
Disability Insurance (Short-Term and Long-Term)
Life and AD&D Insurance
Paid Sick Leave (where required by applicable state or local law)
Supplemental Insurance Plans
Identity Theft Protection
Pet Insurance
Employee Wellness Programs
Employee Assistance Program (EAP)
Career Growth and Professional Development Opportunities

About the company

Founded in 2010 and headquartered in the Washington, DC metro area, Cynet Systems Inc. is a leading technology staffing and workforce solutions company serving Fortune 500 companies, government agencies, and enterprise organizations across the United States and Canada. We deliver agile, scalable talent solutions across IT, engineering, life sciences, clinical, and professional staffing, powered by a high-performing recruitment engine operating across North America and Asia.