Data Engineer Experienced
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+20 more
Job description
Weβre looking for a Data Engineer to build and maintain the data infrastructure powering our AI/ML initiatives including data pipelines for model training, retrieval-augmented generation (RAG), and production ML systems. This role sits at the intersection of data engineering and applied AI, ensuring high-quality, well-governed data is available for both traditional analytics and AI consumption., * Design and build pipelines to ingest, clean, and transform structured and unstructured data (documents, PDFs, transcripts, logs) for AI/ML use cases
- Build and maintain vector embedding pipelines and support vector database integration
- Develop feature stores/pipelines for ML model training and inference
- Implement data pipelines supporting RAG architectures chunking strategies, embedding refresh cycles, metadata tagging
- Partner with ML engineers/data scientists to understand data requirements for model training and evaluation
- Ensure data lineage, quality, and governance across pipelines feeding AI systems
- Optimize pipelines for cost and performance (e.g., Dynamic Tables, streaming ingestion)
- Support MLOps/LLMOps workflows versioning datasets, tracking data used in model training for reproducibility and compliance
- Implement entitlement/access control logic so AI systems only access data theyβre authorized to use
Requirements
Artificial Intelligence (AI), Python Programming/Scripting Language, Oracle SQLPlus, Scala Programming Language, Application Programming Interface (API), Data Management, Production Systems, Data Modeling, Metadata, Shallow Parsing, * Strong SQL + one of Python/Scala for pipeline development, experience with orchestration tools and understanding of AI models.
Deal Breakers:
- Strong sql + Python understanding, AI data skills and API implementation.
Specific systems, tools, or technologies:
- Snowflake, dbt, Python
Minimum Education Requirement: Masters or undergrad with relevant experience Minimum Experience Requirement: 6 years, * Strong SQL + one of Python/Scala for pipeline development
- Experience with a cloud data platform
- Experience with orchestration tools (Airflow, dbt)
- Understanding of embedding models, vector search, and RAG patterns
- Experience with unstructured data processing
- Familiarity with ML lifecycle concepts
Nice to Have:
- Experience with Snowflake Cortex, Cortex Search, or similar in-warehouse AI tooling
- Experience in a regulated industry (financial services) with data entitlement/compliance requirements
- Exposure to LLM application frameworks (LangChain, LlamaIndex)
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦