Senior Data Scientist With LoRA/QLoRA and Amazon Sagemaker

Arkhya Tech
Herndon, VA, United States
7 days ago
Apply on arc.dev
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Amazon Web Services Encodings Customer Data Management Information Leak Prevention Distributed Computing Environment Apache Hadoop Hadoop Distributed File System Apache Hive Identity and Access Management Intrusion Detection Systems Recommender Systems
+12 more
Reinforcement Learning QLoRA Normalized Discounted Cumulative Gain Pytorch Transfer Learning Large Language Models Apache Spark Deep Learning AWS Trainium Pyspark Amazon Bedrock Model Inference

Job description

Summary: Works on data to build, train and deploy next-generation LLM-based recommender systems. The role covers the full path from raw customer data to a deployed model., * Data to training sets: turn unstructured and structured traveler and catalog data into narrative text documents and synthetic data, at a scale of tens of millions of documents.

  • Feature and context engineering: decide what information goes into each document and how to express it, such as market-relative price, tier and trip context.
  • Large-scale distributed training on Amazon SageMaker AI, including HyperPod.
  • Fine-tuning: LoRA/QLoRA adapters, supervised training, and reinforcement learning for ranking and reasoning.
  • Deep learning modeling: model architecture, ranking heads, co-training and multi-task setups.
  • Inference and deployment: low-latency, cost-efficient serving, including quantization, distillation and profiling.
  • Evaluation and error analysis: build evaluation sets, run ablations and catch data leakage. Write up findings clearly for the customer and the AWS science team.
  • Data privacy: handle customer data safely, including removing per

Requirements

  • Spark (PySpark) and the Hadoop ecosystem (Hive, HDFS) on corpora of tens of millions of documents.
  • Amazon SageMaker AI: processing, training, distributed training (HyperPod), deployment.
  • LLM fine-tuning (LoRA/QLoRA) and reinforcement learning (e.g. GRPO/PPO-style methods).
  • Strong deep learning fundamentals in PyTorch: architectures, training dynamics, co-training.
  • Large-scale batch LLM inference and production inference (vLLM, Amazon Bedrock batch).
  • Data privacy and security on AWS: personal-data removal, IAM, KMS, Lake Formation.
  • Clear written communication with customer and science stakeholders.

Preferred skills

  • AWS Trainium / Inferentia (Neuron SDK).
  • Recommender systems: ranking metrics (NDCG, MRR), sequential and generative recommenders.
  • Embedding quantization or semantic IDs.
  • Experience in a customer-facing or embedded role.

About the company

About Arkhya Tech Inc.

201-500

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on arc.dev
Prepare application

Good distractions

Loading talks and stories from around this role…