Databricks - Data Engineer

We are looking for a Senior Data Engineer with 7+ years of experience to support the newly launched VI Train Command Center. VI Train Command Center is a new internal platform designed to create one shared, current view of antibody campaigns, connecting data and work across teams to improve visibility into priorities, capacity, readiness, and progress.

This person will own a data engineering stream end-to-end, from designing the solution and building data pipelines through processing and preparing datasets for use within Databricks applications. This is a highly independent role for someone who can not only execute technically, but also think ahead, identify potential gaps, and build scalable solutions that support future functionality., * Front-end development experience with React, JavaScript, or similar technologies

• Experience supporting data for user-facing applications
• Experience designing solutions with scalability, extensibility, and different user/access needs in mind

Day-to-Day

This person will take full ownership of a stream within the VI Train Command Center. The role is approximately 80% backend/data engineering, focused on designing and building end-to-end pipelines, processing and preparing data, creating datasets, and making that data available within Databricks applications.

The engineer will be responsible for understanding the required inputs and outputs, developing the technical design, presenting that design to the team for alignment, and then independently implementing the solution.

Since VI Train is a new and evolving platform, the team needs someone who thinks beyond the immediate requirement and anticipates future needs. This includes considering scalability, flexibility, and how functionality or access requirements may differ across users as the platform grows.

• 7+ years of Data Engineering experience
• Strong hands-on Databricks experience
• Advanced Python and SQL skills
• Experience designing and building end-to-end data pipelines and datasets
• Cloud experience with AWS strongly preferred; Azure or GCP experience is also applicable
• Ability to independently design data solutions, including data mapping, transformations, expected outputs, and overall pipeline architecture
• Excellent communication skills with the ability to present technical designs, explain decisions, and collaborate with the broader team