Data Scientist - Databricks Architect

TechVirtue LLC
United States
9 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Temporary contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Microsoft Azure Big Data Continuous Integration Data Architecture Data Cleansing Information Engineering Data Governance Python (Programming Language) Machine Learning Natural Language Processing
+18 more
Azure Machine Learning SQL Databases Unstructured Data Google Cloud Cloud Platform System Feature Engineering Large Language Models Apache Spark Deep Learning Generative AI Data Lakes Pyspark Kubernetes Information Technology Machine Learning Operations Data Pipelines Docker Databricks

Job description

We are seeking an experienced Data Scientist / Data Science Architect with strong expertise in Databricks, advanced analytics, machine learning, and cloud-based data platforms. The ideal candidate will have hands-on experience designing scalable data science solutions and architecting end-to-end machine learning and analytics platforms using Databricks.

The candidate will work closely with data engineering, analytics, and business teams to develop and implement enterprise-grade data science solutions., * Design and architect scalable Data Science and Machine Learning solutions using Databricks.

  • Develop and implement advanced analytics, predictive modeling, and machine learning solutions.
  • Provide technical leadership for Databricks-based data science and ML platforms.
  • Build and optimize data pipelines, feature engineering workflows, and ML workflows.
  • Work with Apache Spark, PySpark, Python, SQL, and Databricks for large-scale data processing and analytics.
  • Design end-to-end ML solutions including data preparation, model development, training, validation, deployment, and monitoring.
  • Collaborate with Data Engineers, Data Architects, ML Engineers, and business stakeholders.
  • Apply best practices for data governance, security, scalability, performance, and cost optimization.
  • Work with MLflow and MLOps practices for model lifecycle management.
  • Evaluate new technologies and recommend appropriate data science and analytics architectures.
  • Provide technical guidance and mentorship to data science and engineering teams.

Requirements

  • 12+ years of experience in Data Science, Machine Learning, Advanced Analytics, or related fields.
  • Strong experience with Databricks and cloud-based data platforms.
  • Architect-level experience designing data science / machine learning solutions.
  • Strong hands-on experience with Python, PySpark, SQL, and Apache Spark.
  • Strong understanding of machine learning algorithms, statistical modeling, and predictive analytics.
  • Experience with MLflow, MLOps, model deployment, and model lifecycle management.
  • Experience working with large-scale structured and unstructured datasets.
  • Strong understanding of data engineering and modern data architecture concepts.
  • Experience with cloud platforms such as AWS, Azure, or Google Cloud Platform.
  • Strong communication, problem-solving, and technical leadership skills.

Preferred Skills

  • Databricks certifications.
  • Experience with Delta Lake, Unity Catalog, Delta Live Tables (DLT), and Databricks Workflows.
  • Experience designing enterprise-level AI/ML platforms.
  • Knowledge of Generative AI, LLMs, NLP, or deep learning.
  • Experience with CI/CD, Docker, Kubernetes, and automated ML deployment.
  • Experience with data governance, security, access control, and compliance., Bachelor’s or Master’s degree in Computer Science, Data Science, Statistics, Mathematics, Engineering, or a related field preferred.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:07 min

Inspecting default bridge architectures and custom Docker networks

Oliver Seitz Oliver Seitz · World Congress 2025

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

3:04 min

Pre-built algorithms and further learning resources

Ayon Roy · LIVE

Videos

See all

Related articles

See all