> Markdown version of [/jobs/ext/1108565-senior-application-architect-databrick](https://www.wearedevelopers.com/jobs/ext/1108565-senior-application-architect-databrick). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Application Architect-Databrick - **Company:** HCSC, L.P. - **Location:** Chicago, IL, United States - **Experience:** Expert - **Salary:** $112,200.0 - $202,600.0 - **Contract:** Permanent contract - **Skills:** Airflow, Amazon Web Services, Business Analytics Applications, Applications Architecture, Microsoft Azure, Big Data, Cloud Engineering, Information Systems, Computer Programming, Data Architecture, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Security, Data Systems, Data Warehousing, Distributed Systems, Monitoring of Systems, Python (Programming Language), Machine Learning, Performance Tuning, SQL Databases, Azure Data Factory, Apache Spark, Git, Data Lakes, Infrastructure Automation Frameworks, Information Technology, Data Management, Machine Learning Operations, Data Delivery, Terraform, Software Version Control, Data Pipelines, Databricks - **Published:** June 23, 2026 - **Apply:** https://dejobs.org/x/x/EBD09CC4FDC74340A9B1728833194081/job/ ## About the Role * Bachelor's degree in Computer Science, Information Systems, or related field (or equivalent experience) * 3+ years of experience in data engineering or big data platforms * Hands-on experience with Databricks and Apache Spark * Strong programming skills in Python, SQL, and/or Scala * Experience with cloud platforms (Azure preferred, but AWS or GCP acceptable) * Understanding of data warehousing concepts and ETL/ELT processes * Experience with distributed computing and large-scale data processing * Familiarity with version control systems (e.g., Git), * Databricks certifications (e.g., Databricks Certified Associate/Professional) * Experience with Delta Lake and Lakehouse architecture * Knowledge of data orchestration tools (e.g., Airflow, Azure Data Factory) * Experience with machine learning workflows on Databricks * Familiarity with infrastructure-as-code tools (e.g., Terraform), * Data pipeline development and optimization * Performance tuning and troubleshooting * Cloud architecture and integration * Data governance and security * Analytical thinking and problem-solving * Strong communication and collaboration skills __________________________________________________ Success Metrics * Reliability and uptime of data systems * Performance improvements in data pipelines * Cost optimization of Databricks workloads * Timely resolution of system issues * Stakeholder satisfaction with data delivery, * Bachelor degree and 5 years Information Technology experience OR Technical Certification and/or College Courses and 7 year Information Technology experience OR 9 years Information Technology experience. * 3+ years of experience in data engineering or big data platforms * Hands-on experience with Databricks and Apache Spark * Strong programming skills in Python, SQL, and/or Scala * Experience with cloud platforms (Azure preferred, but AWS or GCP acceptable) * Understanding of data warehousing concepts and ETL/ELT processes * Experience with distributed computing and large-scale data processing * Familiarity with version control systems (e.g., Git) * Problem solving / analytical thinking. * Teamwork and collaboration. Preferred Job Qualifications: * Bachelor degree in Computer Science or Information Technology * Product-specific application architecture. * Ability to tie together solutions across systems. ## Description We are seeking a skilled Databricks Architect to design, implement, optimize, and support data platforms built on Databricks. This role focuses on managing large-scale data processing systems, ensuring performance, reliability, and scalability of data pipelines, and enabling advanced analytics and machine learning workloads., * Configure and manage Databricks workspaces, clusters, and jobs * Optimize data workflows for performance, cost, and scalability * Integrate Databricks with cloud platforms (Azure, AWS) and external data sources * Monitor system performance and troubleshoot issues in production environments * Implement data security, governance, and access controls * Collaborate with data engineers, data scientists, and business stakeholders * Support CI/CD pipelines for data and analytics solutions * Maintain documentation for architecture, processes, and workflows * Stay up to date with new Databricks features and best practices ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)