ML Engineer

Our vision is to bring adaptive innovation to support our nation’s most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility-leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests. We are currently looking for an ML Engineer to support our contract with the DRAID CDAO ADA IR Program.

As an ML Engineer at Agile Defense, you will be joining a team of professionals that secure, scalable data architectures and AI/ML pipelines. This role will support data science and engineering activities, partnering with product teams, data engineers, mission stakeholders, and technologists to unlock the value of structured and unstructured data in support of national defense priorities. You will implement data engineering activities and develop and deploy pipelines and platforms that organize and make complicated data meaningful.

Responsibilities/Duties:

Build Scalable Data & ML Infrastructure

· Design and implement medallion architecture (Bronze/Silver/Gold) using Databricks for reliable data processing and ML model training

· Develop automated data pipelines that process structured and unstructured data from multiple sources into analytics-ready formats

· Create robust ETL/ELT workflows using Apache Spark and modern data engineering practices for both batch and streaming data

· Build and maintain data quality monitoring and validation systems across the entire data and ML lifecycle

Drive ML Platform Excellence

· Implement MLOps best practices including automated model training, validation, deployment, and monitoring using MLflow and Databricks workflows

· Design scalable ML inference systems that handle high-volume, low-latency predictions in production environments

· Create comprehensive monitoring and alerting systems for model performance, data drift, and system health

· Build self-service ML capabilities that enable data scientists to deploy and monitor their own models efficiently

Enable Advanced Analytics & Business Intelligence

· Design and maintain data models that support both machine learning workloads and business intelligence requirements

· Create integration points between ML systems and business intelligence platforms (Tableau, PowerBI, Qlik Sense)

· Implement data governance standards and metadata management systems that ensure data quality and compliance

· Collaborate with analysts and data scientists to optimize data architecture for both predictive modeling and reporting needs

Ensure Data Quality & Governance

· Implement comprehensive data governance frameworks including data lineage tracking, quality monitoring, and compliance controls

· Design and maintain data catalogs and metadata management systems that enable efficient data discovery across the organization

· Establish data quality standards and automated testing frameworks for both analytical and ML workloads

· Work with stakeholders to define data definitions, business logic, and governance policies

Integrate with Enterprise Systems

· Build integrations with MAVEN Smart Systems (Palantir Foundry) environments to support operational and predictive analytics

· Connect Databricks-based systems with enterprise data warehouses, streaming platforms, and business applications

· Implement security and compliance controls that meet enterprise requirements while enabling self-service capabilities

· Collaborate with platform engineers to integrate ML systems with broader application architecture and infrastructure, * Happy - Be Infectious. Happiness multiplies and creates a positive and connected environment where motivation and satisfaction have an outsized effect on everything we do.

• Helpful - Be Supportive. Being helpful is the foundation of teamwork, resulting in a supportive atmosphere where collaboration flourishes, and collective success is celebrated.
• Honest - Be Trustworthy. Honesty serves as our compass, ensuring transparent communication and ethical conduct, essential to who we are and the complex domains we support.
• Humble - Be Grounded. Success is not achieved alone, humility ensures a culture of mutual respect, encouraging open communication, and a willingness to learn from one another and take on any task.
• Hungry - Be Eager. Our hunger for excellence drives an insatiable appetite for innovation and continuous improvement, propelling us forward in the face of new and unprecedented challenges.
• Hustle - Be Driven. Hustle is reflected in our relentless work ethic, where we are each committed to going above and beyond to advance the mission and achieve success.

· 5+ years of technical experience, including 3+ years building production data pipelines and ML infrastructure using distributed computing platforms like Databricks.

· Strong data engineering skills in Python, PySpark, and Spark SQL with experience implementing medallion architecture and modern data platform patterns

· Production ML systems experience including model deployment, monitoring, and MLOps practices in cloud environments

· Data architecture expertise with experience designing scalable data processing systems and implementing data governance frameworks

· Experience integrating with platforms such as Qlik, Tableau, PowerBI, MAVEN Smart System (Palantir), or similar.

Preferred Skills - What Would Set You Apart:

· Deep expertise in distributed computing, performance optimization, and large-scale data processing using Databricks and Apache Spark

· Advanced MLOps knowledge including automated retraining, model versioning, model testing frameworks, and production ML monitoring

· Experience conducting regression analysis, and building predictive models for business applications with measurable impact

· Advanced statistical knowledge including experimental design, hypothesis testing, causal inference, and statistical modeling techniques

· Experience designing and building enterprise-level dashboards, reports, and self-service analytics platforms

· Analytics platform knowledge including experience with Advana / MAVEN Smart Systems (Palantir Foundry) or similar enterprise analytics environments

At Agile Defense we know that action defines the outcome and new challenges require new solutions. That’s why we always look to the future and embrace change with an unmovable spirit and the courage to build for what comes next.

Our vision is to bring adaptive innovation to support our nation’s most important missions through the seamless integration of advanced technologies, elite minds, and unparalleled agility-leveraging a foundation of speed, flexibility, and ingenuity to strengthen and protect our nation’s vital interests., Employees of Agile Defense are our number one priority, and the importance we place on our culture here is fundamental. Our culture is alive and evolving, but it always stays true to its roots. Here, you are valued as a family member, and we believe that we can accomplish great things together. Agile Defense has been highly successful in the past few years due to our employees and the culture we create together.

What makes us Agile? We call it the 6Hs, the values that define our culture and guide everything we do. Together, these values infuse vibrancy, integrity, and a tireless work ethic into advancing the most important national security and critical civilian missions. It’s how we show up every day. It’s who we are.