> Markdown version of [/jobs/ext/2693035-ai-data-engineer](https://www.wearedevelopers.com/jobs/ext/2693035-ai-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # AI Data Engineer - **Company:** THE TILTED CIRCLE USA INC. - **Location:** New York, NY, United States (Remote available) - **Experience:** Experienced - **Contract:** Permanent contract - **Skills:** Training Data, A/B Testing, Artificial Intelligence, Amazon Web Services, Microsoft Azure, Data Architecture, Data Cleansing, Data Distribution Service, Information Engineering, Data Governance, Data Infrastructure, Data Security, Distributed Systems, Graph Database, Python (Programming Language), Machine Learning, Neo4j, Open Source Technology, Tensorflow, Azure Machine Learning, SQL Databases, Unstructured Data, Google Cloud, Feature Engineering, Pytorch, Retrieval-Augmented Generation, Apache Spark, Scikit Learn, Information Technology, Data Lineage, HuggingFace, Machine Learning Operations, Virtual Agents, Software Version Control, Data Pipelines, Databricks - **Published:** September 3, 2026 - **Apply:** https://www.dice.com/job-detail/20a5755d-3bb7-4ed9-ae05-7421b8efa3f8 ## About the Role * Bachelor's or master's degree in computer science, Data Science, Machine Learning, or related field. * 5-7 years of hands-on experience in data engineering, with at least 2 years focused on AI/ML workloads. * Expert proficiency in Python and experience with ML frameworks such as PyTorch, TensorFlow, or scikit-learn. * Strong experience with Databricks, Apache Spark, and distributed computing for ML workflows. * Deep understanding of the machine learning lifecycle, including model training, deployment, and monitoring processes. * Experience with feature engineering, data preprocessing techniques, and ML data pipelines. * Knowledge of vector databases, embeddings, and similarity search for AI applications. * Proficiency in SQL for structured and unstructured data management. * Understanding of data governance, model governance, and AI ethics principles. * Strong analytical and problem-solving capabilities with attention to data quality. * Excellent collaboration skills for working with data scientists, ML engineers, and architects. Preferred/Nice-to-Have Skills * Experience with generative AI applications, including RAG (Retrieval-Augmented Generation) and fine-tuning. * Knowledge of LangChain, HuggingFace, or other GenAI frameworks. * Familiarity with Azure ML, AWS SageMaker, or Google Vertex AI platforms. * Experience with graph databases (Neo4j, Amazon Neptune) for knowledge graph implementation. * Understanding of AI model explainability and interpretability techniques. * Experience with A/B testing frameworks for ML model evaluation. * Certification in Databricks, AWS, Azure, or Google Cloud Platform AI/ML services. * Publications or contributions to open-source ML projects ## Description * Design and implement specialized data pipelines for AI model metadata, training data lineage, and model performance metrics tracking. * Build data infrastructure on Databricks leveraging Spark for large-scale distributed dataset processing. * Develop MCP servers and enable AI data distribution via MCP. * Develop feature engineering pipelines and data preprocessing workflows for AI model training and inference. * Implement model versioning, experiment tracking, and model registry integration using MLflow or similar tools. * Create automated workflows for AI agent discovery, classification, and inventory management across the enterprise. * Design and maintain knowledge graph structures for representing AI model relationships, dependencies, and data lineage. * Build real-time data pipelines for AI model monitoring, drift detection, and performance tracking. * Develop data quality frameworks specific to AI training datasets and validation data. * Collaborate with data scientists to optimize data access patterns and feature store implementations. * Implement security and compliance controls for sensitive AI training data and model artifacts. * Create comprehensive documentation for AI data architectures, schemas, and integration patterns. ## Related Videos - [Developer Experience, Platform Engineering and AI powered Apps](https://www.wearedevelopers.com/videos/990-developer-experience-platform-engineering-and-ai-powered-apps) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Putting the Graph In GraphQL With The Neo4j GraphQL Library](https://www.wearedevelopers.com/videos/257-putting-the-graph-in-graphql-with-the-neo4j-graphql-library) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)