Principal Databricks Engineer

EXOS, LLC
Orient, OH, United States
8 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours

Tech stack

Computer Vision Microsoft Azure Data Architecture Information Engineering Data Structures Data Systems Data Warehousing Dimensional Modeling Python (Programming Language) NoSQL Agentic-AI Data Layers
+5 more
Pyspark Data Management Azure Synapse Analytics Data Pipelines Databricks

Job description

Our client is seeking a hands-on Principal Databricks Engineer to help lead the customer’s data engineering discipline and strengthen a modern analytics platform. The role combines complex engineering delivery with technical direction, data architecture, and practical guidance on standards and future capabilities. The environment is being modernized on Databricks in Microsoft Azure, with workloads migrating from Azure Synapse Analytics. The engineer will partner with data engineering and data science teams to make data reliable, well modeled, documented, and ready for analytics and downstream use. Remote work is acceptable for the contract engagement. A local candidate and a contract-to-hire path may also be considered. Any full-time hire must be willing to relocate to Tulsa, Oklahoma, and work onsite daily., · Design, build, and productionize data pipelines and curated data layers on Databricks in Microsoft Azure. · Model data using Kimball dimensional modeling principles and establish practical, reusable modeling standards. · Solve complex engineering challenges involving integrations and data structures, and recommend designs that support timely analytics and insight generation. · Provide technical leadership for data engineering by setting direction for new capabilities and documenting architecture, standards, and implementation practices. · Support the migration from Azure Synapse Analytics to Databricks, including assessing legacy procedures and modernizing workflows. · Partner with data scientists and other stakeholders to support data science use cases and evaluate relevant platform capabilities, including Databricks artificial intelligence features. · Contribute to emerging initiatives such as agentic engineering workflows and computer vision as priorities evolve. · During the first 90 days, learn the customer’s data landscape, models, platform, engineering standards, and roadmap, then begin owning near-term work. · Continue modeling approximately 80 petroleum data tables currently in development and prepare them for production. · Take ownership of computer vision-related data engineering work and build context on the Databricks environment, the Synapse migration, and existing team practices.

Requirements

Work From Home, Data Science, Microsoft Windows Azure, Customer/Client Research, Data Management, Data Modeling, Dimensional Modeling, Data Structures, Time Management, Technical Leadership, · Strong hands-on data engineering experience, including the ability to independently deliver complex technical work. · Experience designing and developing data solutions with Databricks. · Proficiency with Python and PySpark. · Experience working in Microsoft Azure cloud environments. · Practical experience with Kimball dimensional modeling and data modeling standards. · Ability to contribute to architecture and technical direction while remaining actively involved in implementation. · Strong communication and documentation skills, including the ability to explain design choices and collaborate across engineering and data science teams. Preferred Qualifications: · Experience with Azure Synapse Analytics or other data warehouse modernization and migration work. · Familiarity with normalized data models and NoSQL concepts. · Experience supporting data science teams or data science use cases from a data engineering perspective. · Exposure to Databricks artificial intelligence capabilities, computer vision initiatives, or agentic workflows.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…