Analyst Databricks
Role details
Job location
Tech stack
Job description
The Databricks Engineer is responsible for designing, building, and maintaining scalable data pipelines and lakehouse architectures using the Databricks Data Intelligence Platform. This role combines data engineering and analytics capabilities, enabling the development of scalable data pipelines, governed data assets, and actionable insights through advanced analytics, reporting, and visualization., * Design, develop, and maintain batch and streaming data pipelines using Delta Live Tables, Auto Loader, and medallion architecture (Bronze/Silver/Gold layers).
- Write, optimize, and maintain advanced SQL queries within Databricks SQL Warehouses to transform and analyze large-scale datasets.
- Optimize Apache Spark workloads for performance, scalability, and cost efficiency.
- Build and manage curated, analytics-ready datasets to support BI, reporting, machine learning, and AI initiatives.
- Implement and maintain data governance, security, and lineage through Unity Catalog, including access controls and PII protections.
- Develop and maintain dashboards and reports using Databricks AI/BI tools and integrations such as Power BI and Tableau.
- Perform deep-dive and ad-hoc analysis to uncover trends, answer business questions, and support forecasting efforts.
- Configure Databricks Jobs and Workflows to ensure data pipeline reliability, SLA adherence, and automated monitoring/alerting.
- Support machine learning and AI use cases by preparing datasets and integrating with tools such as MLflow and vector embeddings.
- Develop and deploy code through CI/CD pipelines using Databricks Asset Bundles (DABs) and source control systems (GitHub/GitLab).
- Translate complex data findings into clear, actionable insights for business stakeholders and executive audiences.
- Collaborate with Data Engineering, Analytics, Product, and Business teams to deliver scalable, high-impact data solutions.
- Embodies the Hilton Grand Vacations Values of Hospitality, Integrity, Leadership, Teamwork, Ownership, Now,
- Completes all required Company training/compliance courses assigned.
- Adheres to Company standards and maintains compliance with all policies and procedures.
- Performs other related duties as assigned.
Requirements
Do you have experience in Version control?, To fulfill this role successfully, you must possess the following minimum qualifications and experience:
- Advanced proficiency in Python (PySpark) and SQL.
- Strong expertise in Databricks ecosystem, including Delta Lake, Apache Spark, and Unity Catalog.
- Hands-on experience building both data pipelines and analytical reporting solutions in a cloud-based environment.
- Deep understanding of data engineering best practices, including ETL/ELT pipelines, data warehousing, and medallion architecture.
- Knowledge of CI/CD practices and tools for data engineering workflows.
- Strong analytical thinking with the ability to interpret complex data and deliver actionable insights.
- Excellent communication skills to translate technical concepts into business-friendly outputs.
It would be advantageous in this position for you to demonstrate the following capabilities and distinctions:
- Experience supporting machine learning or AI workflows.
- Familiarity with streaming data and real-time architectures.
- Experience with data governance frameworks and regulatory compliance.
- Domain experience in marketing, product analytics, or financial analytics.
- Databricks certifications (Data Engineer or Data Analyst).
Benefits & conditions
Pulled from the full job description
- Tuition reimbursement
- Health insurance
- 401(k) matching
- Employee discount
- Vision insurance
- Dental insurance
- Paid sick time, * Recognition Programs and Rewards
- Excellent health care options, including medical, dental, and vision
- A people-first culture
- Go Hilton: Travel Discounts Program Hilton hotel rates worldwide.
- Perks at work: Employee Pricing platform
- Employee Assistance Program that supports your physical and mental well-being.
- Paid Vacation Time and Paid Sick Days
- 401(k) program with company match
- Tuition reimbursement programs
- Numerous learning and advancement opportunities
- And more!