Sr. AI & Data Engineer-Trading Analytics
Role details
Job location
Tech stack
Job description
As a Sr. AI & Data Engineer in Trading Analytics, you will work directly with front-office teams to design, build, and productionize AI-driven analytics over market pricing and fundamental data. You will combine Databricks-based data engineering, statistical and econometric techniques, and modern GenAI/agentic workflows to deliver insight at speed. This is a hands-on individual contributor role with a strong bias toward practical delivery. You will operate in a high-touch, hybrid model, iterating rapidly with users on-desk, while engineering solutions to production-grade standards using modern CI/CD and governance practices. Also, this role is rapid prototyping, iterative learning, and incremental production hardening, balanced with adherence to engineering, security, and governance frameworks to maintain speed and reliability., * Design, build, and deliver AI-driven analytics for traders and analysts, including seasonality analysis, correlation studies, regression models, forecasting, and scenario modelling over market pricing and fundamentals data
- Work closely with traders and analysts to translate ambiguous business questions into clear analytical problem statements and working solutions
- Clearly communicate analytical outputs and AI-generated insights to commercial stakeholders in a concise and actionable manner
Data Engineering & Platforms
- Build and maintain scalable, reusable data pipelines on Databricks using PySpark/Spark, SQL, Delta Lake, and Unity Catalog
- Support ingestion, modelling, and transformation of large-scale time-series pricing and fundamentals datasets
- Optimize pipelines for performance, reliability, and cost efficiency, following platform and data governance standards
AI, GenAI & Agentic Solutions
- Build and enhance GenAI and agent-based solutions to support trading analytics, including:
- Retrieval-Augmented Generation (RAG)
- Prompt engineering
- Agent orchestration using frameworks such as LangGraph
- Tool calling and guardrails
- Integrate LLM-based workflows with structured trading and market data to augment analysis, insight generation, and decision support
- Prototype solutions quickly, gather user feedback, and help harden selected use cases for production deployment
Production, Quality & Operations
- Contribute to production-ready analytics and AI solutions with testing, documentation, versioning, and basic observability
- Follow established CI/CD and DevOps practices, including use of Git-based workflows and automated testing
- Support governance requirements such as PII handling, data lineage, and auditability in line with Trading & Supply standards
Requirements
- Must have legal authorization to work in the US on a full-time basis for anyone other than current employer
- Bachelor's degree or equivalent relevant years of experience
- At least 10 years of relevant experience
- Hands-on experience with Databricks and/or Spark (PySpark, SQL, Delta Lake; Unity Catalog desirable)
- Proven data engineering skills, including pipeline development, data modelling, and performance optimization
- Solid foundation in statistics, econometrics, or data science, with experience applying these techniques to time-series or market-style datasets
- Practical experience building or contributing to LLM-based solutions, including prompt engineering and retrieval-based approaches
- Familiarity with GenAI frameworks and tooling (e.g., LangGraph or similar orchestration patterns)
- Experience working in collaborative engineering teams using Git and CI/CD pipelines
- Strong communication skills and the ability to work directly with analysts, traders, and other business stakeholders
Additional Preferred Qualifications
- Exposure to commodity or financial trading environments
- Understanding of market fundamentals, supply-demand dynamics, or risk concepts
- Experience with MLflow, feature stores, or vector databases
- Familiarity with working in regulated or risk-sensitive environments
Benefits & conditions
The base salary range for this position is $149,000 - $223,000 per year . Individual pay will be based on various factors, such as relevant work experience, education, certifications, skill level, seniority, and internal equity.
For regular full-time or regular part-time employees of the Company (participating companies as listed in the Summary Plan Description), insurance coverage options include medical, dental, vision coverage, life Insurance, Business Travel Accident Insurance, and Occupational Accidental Death Benefit programs. Employees also participate in a company pension plan and a 401(k) plan. Paid leave includes up to 6 weeks of paid vacation time, up to 11 paid holidays, and parental leave offering 16 weeks of paid leave for birthing parents, and 8 weeks of paid leave for non-birthing parents.