Senior Data Engineer (GenAI / AWS)
Varite Inc
Santa Monica, CA, United States
7 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Compensation
$166,400 - $208,000
Working hours
Regular working hours
Job source
Tech stack
Amazon Web Services
Amazon S3
Continuous Integration
Github
Information Retrieval
Python (Programming Language)
Search Technologies
SQL Databases
TypeScript
Unstructured Data
AWS Cdk
Pinecone
+15 more
Retrieval-Augmented Generation
Llamaindex
AgentCore
Generative AI
Indexer
Agentic-AI
Pgvector
Amazon Bedrock
AWS Glue
Claude
Terraform
Agent SDK
Intelligent Document Processing
Data Pipelines
OpenSearch
Job description
- Design and develop data pipelines using AWS Step Functions, Lambda, S3, Textract, and Comprehend.
- Build automated document-processing workflows for extracting, transforming, and processing structured and unstructured data.
- Implement document chunking, embeddings, vector indexing, and semantic search.
- Develop and maintain vector databases and knowledge bases to support Retrieval-Augmented Generation (RAG).
- Integrate knowledge bases with AI agents for contextual information retrieval.
- Build AI agents using Claude Agent SDK and deploy them on Amazon Bedrock AgentCore Runtime.
- Develop CI/CD pipelines using GitHub Actions to automate builds, testing, and deployments.
- Optimize data pipelines for scalability, reliability, security, and performance.
Must-have: β Python, SQL β AWS Step Functions, Lambda, S3 β Amazon Textract and Comprehend β Vector databases and embeddings β Document chunking and indexing β RAG and knowledge-base integration β Amazon Bedrock β GitHub Actions CI/CD
Good-to-have: β TypeScript β AWS Glue β Document AI / OCR β OpenSearch, Pinecone, pgvector β Advanced retrieval and reranking β LangChain / LlamaIndex β Claude Agent SDK β Terraform / AWS CDK β AgentCore Runtime
Requirements
Experience: 6 10 years Cloud Platform: AWS Primary Language: Python
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.thejobnetwork.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦