> Markdown version of [/jobs/ext/1320282-data-engineer](https://www.wearedevelopers.com/jobs/ext/1320282-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Data Engineer

- **Company:** Rad Ai
- **Location:** San Francisco, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Artificial Intelligence, Amazon Web Services, Big Data, Databases, Data Architecture, Data Validation, Information Engineering, Data Infrastructure, Data Systems, Distributed Data Store, Amazon DynamoDB, Elasticsearch, PostgreSQL, Machine Learning, NoSQL, Software Engineering, SQL Databases, Apache Spark, Containerization, Amazon Elastic Mapreduce (EMR), Docker
- **Published:** July 17, 2026
- **Apply:** https://www.dice.com/job-detail/a82658b2-b06d-405e-8cbc-92480c16ba84

## About the Role

* 5+ years relevant experience in data engineering.
 * Expertise in designing and developing distributed data pipelines using big data technologies on large scale data sets.
 * Deep and hands-on experience designing, planning, productionizing, maintaining and documenting reliable and scalable data infrastructure and data products in complex environments.
 * Solid experience with big data processing and analytics on AWS, using services such as Amazon EMR and AWS Batch.
 * Experience in large scale data processing technologies such as Spark.
 * Expertise in orchestrating workflows using tools like Metaflow.
 * Experience with various database technologies including SQL, NoSQL databases (e.g., AWS DynamoDB, ElasticSearch, Postgresql).
 * Hands-on experience with containerization technologies, such as Docker and Kubernetes.
 * Prior Software Engineering experience is a big plus.

Nice to Haves:

 * Experience working at an early stage startup.
 * Experience in a HIPAA compliant environment.
 * Experience working on machine learning or healthcare related projects.

Join our world-class team as we build and deploy AI solutions that empower physicians and transform patient care-making a meaningful impact on millions of lives. Driven by our mission, we prioritize transparency, inclusion, and close collaboration, bringing together exceptional people to revolutionize healthcare. If you're passionate about driving innovation and delivering impactful healthcare solutions, we'd love to hear from you!

## Description

* Design and implement the data architecture, ensuring scalability, flexibility, and efficiency using pipeline authoring tools like Metaflow and large-scale data processing technologies like Spark.
 * Define and extend our internal standards for style, maintenance, and best practices for a high-scale data platform.
 * Collaborate with researchers and other stakeholders to understand their data needs including model training and production monitoring systems and develop solutions that meet those requirements.
 * Take ownership of key data engineering projects and work independently to design, develop, and maintain high-quality data solutions.
 * Ensure data quality, integrity, and security by implementing robust data validation, monitoring, and access controls.
 * Evaluate and recommend data technologies and tools to improve the efficiency and effectiveness of the data engineering process.
 * Continuously monitor, maintain, and improve the performance and stability of the data infrastructure.


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers)

## Related Articles

- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts)