> Markdown version of [/jobs/ext/2710642-data-platform-engineer](https://www.wearedevelopers.com/jobs/ext/2710642-data-platform-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Platform Engineer - **Company:** Ellipsis Health, Inc. - **Location:** San Francisco, CA, United States - **Experience:** Expert - **Salary:** $150,000.0 - $170,000.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Business Analytics Applications, Data Analysis, Automation of Tests, Batch Processing, Big Data, BigQuery, Data as a Services, Information Engineering, Data Governance, Extract Transform Load (ETL), Data Security, Data Warehousing, DevOps, Distributed Computing Environment, Github, Python (Programming Language), Machine Learning, Performance Tuning, Standard Sql, SQL Databases, Tableau (Software), Unstructured Data, Data Storage Technologies, Cloud Platform System, Fast Healthcare Interoperability Resources, Large Language Models, Snowflake, Apache Spark, Gitlab, Event Driven Architecture, Debezium, Kubernetes, Information Technology, Health Level Seven International, Data Management, Machine Learning Operations, Streamlit Framework, Terraform, Stream Processing, Looker Analytics, Data Pipelines, Amazon Redshift, Databricks - **Published:** September 4, 2026 - **Apply:** https://startup.jobs/senior-data-platform-engineer-ellipsis-health-8344053 ## About the Role * Bachelor's or Master's Degree in Computer Science or equivalent experience * 5+ years of industry experience in designing and building large-scale data platforms * Strong expertise in SQL, Data Modeling, and Data Warehousing (Databricks, Snowflake, Redshift, BigQuery, etc.) * Proficiency in writing Advanced SQLs and performance tuning * Strong proficiency in Python for building, optimizing, automating and maintaining data pipelines and services * Deep experience with Apache Spark and distributed data processing frameworks * Hands-on experience with modern ETL/Orchestration frameworks such as Airflow, dbt, and others * Knowledge of business intelligence tools such as Sigma, Metabase, Tableau, and Looker * Strong familiarity with cloud-based infrastructure and managed data services in GCP and AWS Cloud * Experience with CI/CD pipelines to automate testing, deployment and release of data engineering and analytics workflows using GitLab, GitHub etc * Experience with tools like Kubernetes, Terraform, Pubsub, Debezium * Exposure building data quality frameworks and automation * Understanding of data governance, privacy, and regulatory frameworks (HIPAA, SOC-2, HITRUST) Nice to Have: * Experience working with ML Ops platforms and supporting Data Science teams * Experience with ML Ops tools such as MLflow, Streamlit, and vector databases * Familiarity with healthcare data standards (FHIR, HL7) * Experience in real-time data processing and event-driven architectures * Expertise in implementing data access controls and anonymization techniques ## Description * Lead the design, development, and operation of a scalable and secure data platform to support analytics, ML Ops, and business intelligence * Collaborate closely with Data Science, Machine Learning, Application and DevOps teams to implement end-to-end ML Ops pipelines * Architect and manage data warehousing solutions using Databricks, Dbt, and Spark * Develop and maintain ETL/data pipelines that handle structured and unstructured data across diverse sources * Optimize data storage, access, and processing for cost-efficiency and performance in GCP and AWS Cloud environments * Build and maintain dashboards and analytics solutions using tools such as Sigma, Metabase, and other BI platforms * Ensure compliance with data governance, security, and privacy best practices, including HIPAA, SOC-2, and other regulatory requirements * Evaluate and integrate third-party anonymization and security solutions to protect sensitive data * Provide strategic guidance on the evolution of the data platform to meet the company's growth and technical needs * Design and implement scalable infrastructure for Large Language Model (LLM) operations, including training, fine-tuning, and inference workflows * Collaborate with AI/ML teams to build and optimize LLM serving platforms for real-time and batch processing * Develop monitoring and observability solutions for LLMs, ensuring model performance, cost-efficiency, and compliance with ethical AI guidelines * Evaluate and integrate state-of-the-art LLM technologies into existing data platforms to enhance analytics and decision-making ## Related Videos - [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Innovating Developer Tools with AI: Insights from GitHub Next](https://www.wearedevelopers.com/videos/1268-innovating-developer-tools-with-ai-insights-from-github-next) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Enabling automated 1-click customer deployments with built-in quality and security](https://www.wearedevelopers.com/videos/83-enabling-automated-1-click-customer-deployments-with-built-in-quality-and-security) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)