Azure Databricks Engineer

The Azure Databricks Engineer will partner with the State's business data governance team and a group of engineers to support enterprise data initiatives. This role will focus on enabling and scaling the use of the Databricks platform across business units by identifying use cases, driving data ingestion, and ensuring efficient, cost-effective data processing. This individual will play a key role in empowering teams to leverage Databricks effectively, while also contributing to data strategy, governance alignment, and platform optimization.

• Collaborate with business stakeholders and data governance teams to identify and define data use cases
• Demonstrate and promote effective use of the Databricks platform across teams
• Design, build, and maintain data ingestion pipelines within Databricks
• Support the development and implementation of state-level data policies and standards
• Perform performance tuning, optimization, and ongoing platform maintenance to control costs and improve efficiency
• Provide recommendations for improving performance, reducing costs, and increasing scalability
• Develop and maintain clean, well-documented Databricks notebooks
• Participate in stakeholder meetings to gather requirements and provide technical guidance

Applicants must be legally authorized to work in the United States. Sponsorship not available., * Azure Databricks, including Delta Live Tables

• Apache Spark (Spark API) and PySpark / Databricks SQL
• Data engineering fundamentals, including:
• Data lakes, data warehouses, and Delta Lake architecture
• ETL development and data ingestion processes
• Strong understanding of OLTP and OLAP systems
• Experience with streaming technologies (e.g., Azure Service Bus)
• Strong problem-solving and analytical mindset
• Naturally curious, with an interest in understanding data sources and meanings
• Comfortable working outside of a narrowly defined role ("not in one lane")
• Ability to ask thoughtful questions and translate business needs into technical solutions
• Strong collaboration and communication skills
• Exposure to Azure DevOps (backlog management, commits, pull requests)
• Understanding of SDLC (Software Development Life Cycle)
• Background in software development (e.g., Python, Java, C++)
• Experience working in cross-functional or project-based environments

The final salary or hourly wage, as applicable, paid to each candidate/applicant for this position is ultimately dependent on a variety of factors, including, but not limited to, the candidate's/applicant's qualifications, skills, and level of experience as well as the geographical location of the position.

This position is a contract/temporary role where Hays offers you the opportunity to enroll in full medical benefits, dental benefits, vision benefits, 401K and Life Insurance ($20,000 benefit). Why Hays? You will be working with a professional recruiter who has intimate knowledge of the industry and market trends. Your Hays recruiter will lead you through a thorough screening process in order to understand your skills, experience, needs, and drivers. You will also get support on resume writing, interview tips, and career planning, so when there's a position you really want, you're fully prepared to get it. Nervous about an upcoming interview? Unsure how to write a new resume? Visit the Hays Career Advice section to learn top tips to help you stand out from the crowd when job hunting. Hays is committed to building a thriving culture of diversity that embraces people with different backgrounds, perspectives, and experiences. We believe that the more inclusive we are, the better we serve our candidates, clients, and employees. We are an equal employment opportunity employer, and we comply with all applicable laws prohibiting discrimination based on race, color, creed, sex (including pregnancy, sexual orientation, or gender identity), age, national origin or ancestry, physical or mental disability, veteran status, marital status, genetic information, HIV-positive status, as well as any other characteristic protected by federal, state, or local law. One of Hays' guiding principles is 'do the right thing'. We also believe that actions speak louder than words. In that regard, we train our staff on ensuring inclusivity throughout the entire recruitment process and counsel our clients on these principles. If you have any questions about Hays or any of our processes, please contact us. In accordance with applicable federal, state, and local law protecting qualified individuals with known disabilities, Hays will attempt to reasonably accommodate those individuals unless doing so would create an undue hardship on the company. Any qualified applicant or consultant with a disability who requires an accommodation in order to perform the essential functions of the job should call or text 813.336.5570.