Backend AI Data Engineer

• Design, develop, and maintain scalable AI-powered backend systems and services.
• Build and optimize RAG pipelines and prompt-engineering workflows.
• Develop asynchronous backend services and REST APIs using modern Python frameworks.
• Design and manage vector database infrastructure to support semantic search and AI applications.
• Create document-processing pipelines capable of extracting information from PDFs, images, tables, and other unstructured data sources.
• Build AI agent and tool-calling workflows for engineering and business use cases.
• Support intelligent knowledge-management solutions and automated content generation initiatives.
• Collaborate with cross-functional engineering, systems, and validation teams.
• Implement AI governance, monitoring, reliability controls, and cost optimization strategies.
• Document solution architecture, APIs, and AI workflows., * Work on highly visible AI initiatives with real business impact.
• Gain hands-on exposure to modern generative AI technologies and architectures.
• Help shape scalable AI platforms used across engineering teams.
• Collaborate with experienced engineers, architects, and domain experts.
• Contribute to innovative solutions that leverage AI to improve efficiency, automation, and knowledge discovery., To be considered, candidates should have recent hands-on experience with RAG architectures, Google Gemini, Vertex AI, Python development, AI agents, and vector database technologies.

• 2+ years of software engineering, backend engineering, machine learning engineering, or related experience.
• Hands-on experience building AI-powered applications in production environments.
• 2+ years of experience developing RAG pipelines, LLM-based applications, or AI agent solutions.
• Strong Python development experience.
• Experience with Google Gemini, Vertex AI, LangChain, and LangSmith.
• Experience building backend APIs and integrating AI services into enterprise applications.
• Experience processing unstructured data, including PDFs, technical documentation, and image-based content.
• Experience with vector databases and retrieval systems.
• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, Engineering, or a related STEM discipline.

Preferred Qualifications

• Experience developing FastAPI or Flask-based services.
• Experience working with AI deployment platforms such as Cloud Run, Kubernetes, or Docker.
• Experience integrating multiple LLM providers including OpenAI, Anthropic Claude, or AWS Bedrock.
• Front-end integration experience using React, Next.js, Streamlit, or Gradio.
• Experience working in regulated industries such as healthcare, life sciences, medical device, or other compliance-heavy environments.
• AI/ML certifications are a plus.

Technical Skills

• Python
• Google Gemini
• Vertex AI
• LangChain
• LangSmith
• Retrieval-Augmented Generation (RAG)
• AI Agents / Tool Calling
• Vector Databases
• FastAPI
• REST APIs
• Docker
• Kubernetes
• Cloud-Native Architecture
• Prompt Engineering
• Unstructured Data Processing

Ideal Candidate

We’re looking for someone who combines strong backend engineering fundamentals with modern AI/LLM development experience. The ideal candidate has built production AI solutions, understands retrieval architectures, can work across the full AI application stack, and enjoys solving complex problems involving large volumes of unstructured information.

Beacon Hill was founded to set a new standard in search, career placement and flexible staffing., Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies’ dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers’ technical and business needs.

Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.