Databricks Engineers
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+16 more
Job description
Databricks Engineers build the pipelines enterprise customers run their business on. You will work under a senior engineer or architect, taking a defined piece of an engagement and owning it end to end: ingesting from systems that were not designed to be ingested from, transforming data through Medallion layers, and getting it to a state analysts and ML workloads can actually use. You will be client-facing - standups, working sessions, occasionally explaining to a stakeholder why something is harder than it looked. This is where most of our engineers start, and the certification roadmap is built around moving you up from it., * Build and maintain batch and streaming ETL pipelines using PySpark, SQL, and Delta Lake on Databricks
- Implement Medallion architecture layers
- Deploy and manage data resources on AWS, Azure, or GCP
- Write and automate data validation and quality checks
- Tune Spark jobs and SQL queries for performance and cost
- Structure and clean enterprise datasets for downstream analytics and AI workloads
- Troubleshoot pipeline failures and data quality issues, including in production, Remote United States Senior level Senior level Artificial Intelligence * Information Technology * Machine Learning * Generative AI * Big Data Analytics Lead customer-facing data engineering engagements from architecture through production handover. Build and optimize batch and streaming Lakehouse pipelines on Databricks using PySpark, SQL, and Delta Lake. Establish Medallion architecture conventions, implement data quality and automated testing, optimize Spark performance and platform costs, and mentor engineers. Partner with architects and explain technical trade-offs to customers. Top Skills: AirflowSparkAWSAzureCi/CdDatabricksDatabricks Asset BundlesDbtDelta LakeGCPGitLakeflowPysparkPythonSQLUnity Catalog IDeaS
Product Manager
2 Hours Ago Remote United States Senior level Senior level Software * Analytics * Hospitality Leads product planning and execution for assigned clients, translating client and market requirements into product features, business requirements, statements of work, and roadmaps. Partners with technology, development, analytics, support, marketing, and account teams throughout delivery. Acts as a product subject-matter expert, manages client communications, supports beta programs, monitors project KPIs, and helps define product vision, positioning, and customer value. IDeaS
Requirements
- 8+ years in data engineering/architecture or analytics platform development
- Demonstrated ownership of end-to-end architecture for at least two enterprise-scale data platforms, from design through production
- Deep experience migrating legacy data warehouses or ETL estates to a modern cloud platform (Teradata, Informatica, Hadoop, Netezza, or equivalent)
- Strong proficiency in Python and SQL; working knowledge of Apache Spark and distributed processing fundamentals
- Experience with data modeling across dimensional, normalized, and Lakehouse patterns, and the judgment to know when each applies
- Experience with CI/CD and DevOps practices for data platform deployment
Preferences
- Healthcare or life sciences experience preferred but not required
- Databricks Certified Data Engineer Professional or a Platform Architect
- Hands-on Databricks experience at scale: Unity Catalog, Delta Lake, Lakeflow, Asset Bundles
- Experience with MLOps or productionizing machine learning workloads
- Prior professional services, consulting, or customer-facing architecture background
- Experience contributing to pre-sales scoping or technical proposals
Benefits & conditions
- Unlimited PTO
- Health Care Plan (Medical, Dental & Vision)
- Retirement Plan (401k, IRA)
- Life Insurance (Basic, Voluntary & AD&D)
- Family Leave (Maternity, Paternity)
- Short Term & Long Term Disability
- Training & Development
- Remote/WFH, Remote United States Mid level Mid level Software * Analytics * Hospitality Own the vision, roadmap, development, evaluation, commercialization, and adoption of customer-facing Generative AI capabilities for hospitality software. Lead customer discovery, define intuitive and trustworthy AI experiences, establish quality and safety standards, and partner with engineering, design, security, legal, marketing, and commercial teams. Drive product delivery from experimentation through launch while measuring adoption, answer quality, customer outcomes, reliability, and business impact. Top Skills: APIsConversational AiGenerative AiGroundingGuardrailsHuman-In-The-Loop DesignIdentity And Access ManagementLarge Language ModelsLlm EvaluationMulti-Tenant SaasPromptingRetrieval-Augmented GenerationSemantic Layers
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦