> Markdown version of [/jobs/ext/4361784-data-engineer-platform-administrator-azure-databricks](https://www.wearedevelopers.com/jobs/ext/4361784-data-engineer-platform-administrator-azure-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer / Platform Administrator (Azure Databricks) - **Company:** Vanderbilt University Medical Center - **Location:** Nashville, TN, United States (Remote available) - **Salary:** $111,100.0 - $185,100.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Amazon Web Services, Build Automation, Microsoft Azure, Bash Shell, Business Systems, Cloud Engineering, Databases, Continuous Integration, Data as a Services, Information Engineering, Data Infrastructure, Data Mart, Data Warehousing, Github, Python (Programming Language), Object-Oriented Software Development, Windows PowerShell, Cloud Services, SQL Databases, Systems Architecture, Enterprise Data Management, Cloud Platform System, Gitlab, Data Lakes, Data Analytics, Performance Monitor, Terraform, Data Pipelines, Docker, Databricks, Microservices - **Published:** October 6, 2026 - **Apply:** https://www.careerjet.com/job/us88e673bdbc76d90708598fcf9a2256f9/eaa ## About the Role * Bachelor's degree * 1+ year of experience with Databricks (certifications are a plus) * 2+ years of Python in an object-oriented paradigm * 2+ years implementing cloud solutions with Azure, AWS, or GCP * 1+ year of SQL experience Preferred Qualifications * Experience with Infrastructure as Code solutions such as Terraform * Experience with CI/CD automation in GitLab, GitHub, or Azure DevOps * Experience with REST data services, APIs, and microservices * Experience with containerization using Docker or Podman Bonus Qualifications * Experience with PowerShell and/or Bash * A link to your GitHub profile or other personal code examples TECHNICAL CAPABILITIES * CORPORATE SYSTEMS ARCH STANDARDS (PROFICIENT): Has basic knowledge of the architecture of the systems which support more than one core business area. Demonstrates knowledge of how the core business areas' applications and support systems are structured, how various components and parts interact, as well as what protocols and interfaces are used for communications and cooperation between modules and components. Participates in the overall planning and design of the specific core business systems. Able to train and educate others in the structure and components of systems architecture for those core business areas. * BUSINESS ARCHITECTURE (PROFICIENT): Has basic knowledge of the architecture of the business systems which support more than one core business area. Demonstrates knowledge of how the core business areas' applications and support systems are structured, how various components and parts interact, as well as what protocols and interfaces are used for communications and cooperation between components. * CLOUD ARCHITECTURE (PROFICIENT): Has basic knowledge of leveraging cloud-based architecture to support the life cycle of a data lake. Demonstrates an understanding of when and how to scale cloud components to provide the required level of performance and support of a data lake. * DATA LAKES (PROFICIENT): Demonstrates a basic understanding of the effective application, operation, or practice in complex data lakes. Experienced in all core features and functions. Demonstrates a thorough understanding of advanced concepts. Applies concepts and tools consistently in delivering data lakes. May have successfully completed training in advanced techniques, features, and tools. * DATA MARTS (PROFICIENT): Proficient understanding of fundamental data mart concepts, encompassing their purpose, significance within data warehousing, and the advantages they provide in supporting data analytics efforts. * DATA WAREHOUSING (PROFICIENT): Demonstrates a foundational understanding of data warehousing and its role within an organization. Possesses knowledge of basic corporate data warehouse models and their purposes. Understands the core components of data warehousing systems. Familiar with fundamental data warehouse structures both in theory and basic practical application. Capable of basic performance considerations for data warehousing components. ## Description Job Summary: The Data Platform Services team is looking for a Data Engineer / Platform Administrator with an inquisitive, analytical mindset who wants to deepen their technical skills. About 80% of your time will go to administering our Azure Databricks platform of 100+ workspaces: building automation, monitoring performance and costs, managing configuration, testing new features, and promoting best practices. The remaining 20% will be spent as a data engineer, building and optimizing data pipelines alongside the rest of the team. You'll own defined areas of the platform from the start, with support from senior engineers and room to take on broader scope as you grow. Note: This role can be performed fully remote from most US locations ., Platform Administration (~80%) * Administer our Azure Databricks environment of 100+ workspaces, including compute policies, access controls, and governance, working with senior team members on larger architectural decisions * Build automation and Infrastructure as Code to provision and manage workspaces at scale * Build solutions for proactive monitoring of platform health, performance, and costs * Test new Databricks features and promote best practices to teams across the organization * Develop tools and services that other teams use to create, test, and deliver data-related assets Data Engineering (~20%) * Design and develop performance-focused data pipelines that support a variety of source systems (flat files, APIs, databases, and more) * Troubleshoot issues with production pipelines and work with internal stakeholders to deploy fixes * Build reusable solutions for recurring problems and help ensure data accuracy and integrity * Work with stakeholders to identify data needs and look for opportunities to improve platform scalability, Organizational Impact: Executes job responsibilities with the understanding of how output would affect and impact other areas related to own job area/team with occasional guidance. Problem Solving/ Complexity of work: Analyzes moderately complex problems using technical experience and judgment. Breadth of Knowledge: Has expanded knowledge gained through experience within a professional area. Team Interaction: Provides informal guidance and support to team members. Core Capabilities : Supporting Colleagues:- Develops Self and Others: Invests time, energy, and enthusiasm in developing self/others to help improve performance e and gain knowledge in new areas.- Builds and Maintains Relationships: Maintains regular contact with key colleagues and stakeholders using formal and informal opportunities to expand and strengthen relationships.- Communicates Effectively: Recognizes group interactions and modifies one's own communication style to suit different situations and audiences. Delivering Excellent Services:- Serves Others with Compassion: Seeks to understand current and future needs of relevant stakeholders and customizes services to better address them.- Solves Complex Problems: Approaches problems from different angles; Identifies new possibilities to interpret opportunities and develop concrete solutions.- Offers Meaningful Advice and Support: Provides ongoing support and coaching in a constructive manner to increase employees' effectiveness. Ensuring High Quality: - Performs Excellent Work: Engages regularly in formal and informal dialogue about quality; directly addresses quality issues promptly.- Ensures Continuous Improvement: Applies various learning experiences by looking beyond symptoms to uncover underlying causes of problems and identifies ways to resolve them. - Fulfills Safety and Regulatory Requirements: Understands all aspects of providing a safe environment and performs routine safety checks to prevent safety hazards from occurring. Managing Resources Effectively: - Demonstrates Accountability: Demonstrates a sense of ownership, focusing on and driving critical issues to closure.- Stewards Organizational Resources: Applies understanding of the departmental work to effectively manage resources for a department/area.- Makes Data Driven Decisions: Demonstrates strong understanding of the information or data to identify and elevate opportunities. Fostering Innovation:- Generates New Ideas: Proactively identifies new ideas/opportunities from multiple sources or methods to improve processes beyond conventional approaches.- Applies Technology: Demonstrates an enthusiasm for learning new technologies, tools, and procedures to address short-term challenges.- Adapts to Change: Views difficult situations and/or problems as opportunities for improvement; actively embraces change instead of emphasizing negative elements.