Data Engineer III (6193)

The Itd
Menlo Park, CA, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$72,800.0 - $81,120.0
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Big Data Data Cleansing Information Engineering Data Infrastructure Data Structures Cursor (Graphical User Interface Elements) Python (Programming Language) Machine Learning Object Detection Operational Databases
+12 more
Query Optimization SQL Databases Large Language Models Concurrency Prompt Engineering Generative AI Indexer Information Technology Machine Learning Operations Asynchronous Programming Software Version Control Data Pipelines

Job description

itD is seeking a Senior AI Data Engineer III to build and scale AI-augmented data infrastructure that powers next-generation image generation models. This role sits at the intersection of Data Engineering and Machine Learning Systems, driving the development of large-scale data curation, annotation, and evaluation pipelines that improve model quality across visual quality, prompt adherence, identity preservation, naturalness, and visual text generation. The ideal candidate will bring deep expertise in AI-focused data engineering and a proven track record of building production-scale pipelines that integrate machine learning inference into data workflows., * Design, build, and maintain AI-augmented data pipelines that combine traditional data transformations with machine learning model inference at billion-row scale.

  • Develop and optimize systems for remote model inference orchestration, including batching, asynchronous execution, retry logic, throughput management, and graceful failure handling.
  • Build and maintain scalable embedding generation, storage, indexing, and retrieval pipelines to support AI model training and evaluation.
  • Curate and manage large-scale image datasets using SQL and model-derived signals, ensuring data quality, governance, compliance, and operational efficiency.
  • Design and operate LLM-assisted annotation workflows that automate data labeling while measuring and improving annotation quality.
  • Develop reusable frameworks, tooling, and pipeline components that enable broader engineering teams to efficiently build AI-powered data workflows.
  • Partner closely with engineers, researchers, and cross-functional stakeholders to support image generation model development and evaluation initiatives.

Internal Responsibilities

  • Attend regular internal practice community meetings.
  • Collaborate with your itD practice team on industry thought leadership.
  • Complete client case studies and learning material (blogs, media material).
  • Build out material to contribute to the Digital Transformation practice.
  • Attend internal itD networking events (in person and virtual).
  • Work with leadership on career fast-track opportunities.

Requirements

Do you have experience in Tooling?, Do you have a Bachelor’s degree?, * 5+ years of experience in Data Engineering, ML Engineering, or a hybrid role involving both data pipelines and machine learning inference systems.

  • Strong software engineering fundamentals, including Python, data structures, concurrency, and asynchronous programming.
  • Advanced SQL expertise, including complex query development, query optimization, and large-scale data processing.
  • Experience with pipeline orchestration frameworks such as Airflow, Dataswarm, or equivalent platforms.
  • Proven experience integrating machine learning models into production data pipelines, including inference endpoint management, model versioning, batching, and failure recovery.
  • Demonstrated track record of building and operating production-scale data pipelines that invoke machine learning models at scale.
  • Proficiency with AI-assisted coding tools such as Copilot, Cursor, Codex, or similar AI development agents.
  • Strong written and verbal communication skills with the ability to collaborate effectively across technical and business teams., * Experience generating, storing, indexing, and querying vector embeddings using technologies such as FAISS, Milvus, or similar platforms.
  • Familiarity with content understanding models including image classification, object detection, OCR, NSFW detection, and aesthetic scoring systems.
  • Experience leveraging LLMs for data annotation, data cleaning, evaluation, or prompt engineering workflows.
  • Knowledge of generative AI technologies, including diffusion models, image generation systems, and evaluation metrics such as FID and CLIP Score.
  • Previous experience leading AI-focused technology companies.
  • Experience supporting large-scale image generation or multimodal AI initiatives., * Bachelor’s degree or higher in Computer Science, Data Engineering, Machine Learning, or a related STEM field required.

Benefits & conditions

Pulled from the full job description

  • 401(k)
  • Health insurance
  • 401(k) matching
  • Vision insurance
  • Dental insurance
  • Life insurance
  • Paid holidays, Pay Rate: $35 - $39 per hour, depending on experience. Duration: 5+ months

We provide comprehensive medical benefits, a 401k plan, paid holidays, and more. Please note that we are only considering direct W2 candidates at this time, as we are unable to offer sponsorship.

About the company

About itD: We are part of a new generation of consulting and software development company that blends diversity, innovation, and integrity with real business results. Our structure rejects any strong hierarchy, empowering us to deliver excellent results. We are a woman- and minority-led firm. Every day, we challenge ourselves to be considerate, fair and to re-think what great outcomes mean for our customers. This permeates down to how we approach every interaction, on every project, for every client. You’ll thrive here if you are a dynamic self-starter, a difference-maker or someone who wants to deliver great results, without constraints., The itD Digital Experience: Joining us means you’ll be part of our global community, you have a say about your own career journey, and you’ll get a chance to give back to causes that matter. You will experience working with Fortune 500 companies and high-performance teams across numerous industries. itD offers our employees excellent benefits such as medical, dental, vision, life insurance, paid holidays, 401K + matching, networking & career learning and development programs. We are growing and we want to see you grow! Visit https://itdtech.com/careers to learn more about what working at itD can mean for you.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · WWC Europe 2026

2:36 min

Analyzing limitations with PostgreSQL bitmap heap scans

Dharin Shah Dharin Shah · WWC 2025

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · WWC 2024

2:08 min

Essential engineering roles in the generative AI space

Mary Grygleski Mary Grygleski · LIVE

Videos

See all

Related articles

See all