TELECOMMUTE Databricks Architect

Allwyn Corporation
United States
21 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Business Analytics Applications Cloud Computing Cloud Engineering Continuous Integration Data Architecture Information Engineering Data Integration Extract Transform Load (ETL) Distributed Systems Python (Programming Language)
+22 more
Machine Learning Systems Development Life Cycle Cloud Services Azure Machine Learning SQL Databases Data Streaming Enterprise Data Management Data Lakes Semi-structured Data Kubernetes Infrastructure Automation Frameworks Data Analytics Apache Kafka Spark Streaming Data Management Video Streaming Terraform Stream Processing Stream Analytics Data Pipelines Docker Databricks

Job description

We are seeking an experienced Solutions Architect to design and deliver scalable, cloud-native data solutions that support real-time analytics and enterprise data processing. The ideal candidate will have deep expertise in Databricks, AWS, Kafka, and modern Data Engineering practices, with experience building high-performance streaming and batch data platforms. Exposure to AI/ML solutions is a strong plus.

The Solution Architect will work closely with business stakeholders, engineering teams, and technical leadership to define solution architecture, establish best practices, and drive successful implementation of enterprise data initiatives., * Design end-to-end cloud-native data architectures using AWS and Databricks.

  • Architect scalable batch and real-time data processing solutions using Apache Kafka and streaming technologies.
  • Lead the design and implementation of enterprise data engineering pipelines and data platforms.
  • Define architecture standards, best practices, and governance for data integration and analytics solutions.
  • Collaborate with business stakeholders to translate business requirements into scalable technical solutions.
  • Provide technical leadership and architectural guidance to development teams throughout the SDLC.
  • Optimize data pipelines for performance, scalability, security, and cost efficiency.
  • Design data models and integration strategies for structured and semi-structured data.
  • Ensure solutions adhere to enterprise security, compliance, and reliability standards.
  • Evaluate emerging technologies and recommend innovative solutions to improve business capabilities.
  • Support cloud migration and modernization initiatives.
  • Mentor engineers and conduct architecture and design reviews.

Requirements

  • 8+ years of experience in software, data engineering, or solution architecture.
  • Strong experience designing enterprise data platforms on AWS.
  • Hands-on expertise with Databricks and the Lakehouse architecture.
  • Experience implementing Apache Kafka for real-time event streaming.
  • Strong background in Data Engineering, including ETL/ELT pipeline development.
  • Experience building scalable real-time and streaming data processing solutions.
  • Strong understanding of distributed systems and cloud architecture principles.
  • Experience with SQL, Python, or Scala.
  • Knowledge of CI/CD, Infrastructure as Code, and cloud-native development practices.
  • Excellent communication and stakeholder management skills.
  • Databricks Certified Data Engineer Professional, * Experience with AI/ML platforms or deploying machine learning solutions into production.
  • Experience with Delta Lake, Spark Structured Streaming, or similar technologies.
  • AWS Certification (Solutions Architect or Data Analytics) is preferred.
  • Experience with Terraform, Kubernetes, or Docker is a plus.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

1:34 min

Essential commands for running and testing Terraform configurations

Hennie Francis · LIVE

2:27 min

Managing traffic and tracking costs with Databricks Unity Catalog

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

1:59 min

Key takeaways and accessing the Databricks developer toolkit

Viktoria Semaan Viktoria Semaan · World Congress 2026 Europe

3:38 min

Architecting a unified data and machine learning workbench

Kapil Gupta Kapil Gupta · World Congress 2025

Videos

See all

Related articles

See all