Senior Data Scientist / ML Engineer (Gen AI)_Boston

Photon Interactive Services Inc.
Boston, MA, United States
2 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$60,000 - $210,000
Working hours
Regular working hours

Tech stack

AI Evaluation A/B Testing Artificial Intelligence Amazon Web Services Graph Database Python (Programming Language) Machine Learning Neo4j NumPy Open Source Technology OpenAI Tensorflow
+22 more
Search Technologies Explainable AI (XAI) Enterprise Software Applications Feature Engineering Pytorch Retrieval-Augmented Generation Large Language Models Prompt Engineering Apache Spark Model Validation Generative AI Pandas AI Platforms Scikit Learn Kubernetes Machine Learning Operations Claude Evaluation of Large Language Models Google Gemini Graph RAG Unsupervised Learning Databricks

Job description

Primary

  • Design and develop machine learning and Generative AI solutions.
  • Build and optimize RAG pipelines, retrieval strategies, embeddings, and semantic search.
  • Evaluate and benchmark LLMs for accuracy, performance, and reliability.
  • Develop AI evaluation frameworks for hallucination detection, accuracy measurement, bias/toxicity detection, and ground-truth validation.
  • Optimize prompts, models, and retrieval workflows.
  • Collaborate with AI engineering teams to deploy models into production.

Also expected

  • Create training, validation, and testing datasets.
  • Perform model benchmarking, A/B testing, and performance analysis.
  • Fine-tune foundation models when required.
  • Implement model monitoring, observability, and ongoing evaluation processes.

Requirements

Artificial Intelligence (AI), Data Science, Automation, Enterprise Applications, Data Science, Artificial Intelligence (AI) Agents, Artificial Intelligence (AI), Software Agents, Benchmarking, Machine Learning, * 5-10 years of experience in data science, machine learning, or related applied ML roles.

  • Strong Python programming skills, with Pandas, NumPy, and Scikit-learn.
  • Strong foundation in supervised/unsupervised learning, statistical modeling, feature engineering, and model evaluation techniques.
  • Hands-on Generative AI experience with LLM evaluation, prompt engineering, RAG architectures, embedding models, fine-tuning approaches, and agent evaluation frameworks.
  • Experience with PyTorch and/or TensorFlow.
  • Exposure to OpenAI models, Claude, Gemini, and/or open-source LLMs.
  • Experience with vector databases, semantic search, and retrieval optimization.
  • Experience delivering or supporting production AI/ML solutions in enterprise environments.
  • Experience working with distributed onshore/offshore teams.

Preferred Skills

  • Databricks, MLflow, and Spark.
  • GraphRAG and Knowledge Graphs; exposure to Neo4j.
  • Responsible AI, Explainable AI, and AI governance.
  • Banking or Financial Services domain experience.
  • Familiarity with Azure AI Foundry, AWS Bedrock, Kubernetes, and AI observability platforms.

Soft Skills

  • Clear communication with engineering and business stakeholders.
  • Ability to translate evaluation results into actionable model/product decisions.
  • Comfortable owning quality metrics and trade-offs (accuracy, latency, cost, risk) in a delivery setting.

Compensation, Benefits and Duration

Benefits & conditions

Minimum Compensation: USD 60,000

Maximum Compensation: USD 210,000

Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.

Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.

This position is available for independent contractors

No applications will be considered if received more than 120 days after the date of this post.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…