Backend AI Data Engineer

• Design, develop, and maintain scalable AI-powered backend systems and services.
• Build and optimize RAG pipelines and prompt-engineering workflows.
• Develop asynchronous backend services and REST APIs using modern Python frameworks.
• Design and manage vector database infrastructure to support semantic search and AI applications.
• Create document-processing pipelines capable of extracting information from PDFs, images, tables, and other unstructured data sources.
• Build AI agent and tool-calling workflows for engineering and business use cases.
• Support intelligent knowledge-management solutions and automated content generation initiatives.
• Collaborate with cross-functional engineering, systems, and validation teams.
• Implement AI governance, monitoring, reliability controls, and cost optimization strategies.
• Document solution architecture, APIs, and AI workflows., * Work on highly visible AI initiatives with real business impact.
• Gain hands-on exposure to modern generative AI technologies and architectures.
• Help shape scalable AI platforms used across engineering teams.
• Collaborate with experienced engineers, architects, and domain experts.
• Contribute to innovative solutions that leverage AI to improve efficiency, automation, and knowledge discovery., To be considered, candidates should have recent hands-on experience with RAG architectures, Google Gemini, Vertex AI, Python development, AI agents, and vector database technologies.

• 2+ years of software engineering, backend engineering, machine learning engineering, or related experience.
• Hands-on experience building AI-powered applications in production environments.
• 2+ years of experience developing RAG pipelines, LLM-based applications, or AI agent solutions.
• Strong Python development experience.
• Experience with Google Gemini, Vertex AI, LangChain, and LangSmith.
• Experience building backend APIs and integrating AI services into enterprise applications.
• Experience processing unstructured data, including PDFs, technical documentation, and image-based content.
• Experience with vector databases and retrieval systems.
• Bachelor’s degree in Computer Science, Software Engineering, Information Technology, Engineering, or a related STEM discipline., * Experience developing FastAPI or Flask-based services.
• Experience working with AI deployment platforms such as Cloud Run, Kubernetes, or Docker.
• Experience integrating multiple LLM providers including OpenAI, Anthropic Claude, or AWS Bedrock.
• Front-end integration experience using React, Next.js, Streamlit, or Gradio.
• Experience working in regulated industries such as healthcare, life sciences, medical device, or other compliance-heavy environments.
• AI/ML certifications are a plus.

Technical Skills

• Python
• Google Gemini
• Vertex AI
• LangChain
• LangSmith
• Retrieval-Augmented Generation (RAG)
• AI Agents / Tool Calling
• Vector Databases
• FastAPI
• REST APIs
• Docker
• Kubernetes
• Cloud-Native Architecture
• Prompt Engineering
• Unstructured Data Processing

Ideal Candidate

We’re looking for someone who combines strong backend engineering fundamentals with modern AI/LLM development experience. The ideal candidate has built production AI solutions, understands retrieval architectures, can work across the full AI application stack, and enjoys solving complex problems involving large volumes of unstructured information.

Beacon Hill was founded to set a new standard in search, career placement and flexible staffing., Beacon Hill Technologies, a premier National Information Technology Staffing Group, provides world class technology talent across all industries utilizing a complete suite of staffing services. Beacon Hill Technologies’ dedicated team of recruiting and staffing experts consistently delivers quality IT professionals to solve our customers’ technical and business needs.

Beacon Hill Technologies covers a broad spectrum of IT positions, including Project Management and Business Analysis, Programming/Development, Database, Infrastructure, Quality Assurance, Production/Support and ERP roles.

Learn more about Beacon Hill and our specialty divisions, Beacon Hill Associates, Beacon Hill Financial, Beacon Hill HR, Beacon Hill Legal, Beacon Hill Life Sciences and Beacon Hill Technologies by visiting www.bhsg.com .

Benefits Information:

Beacon Hill offers a robust benefit package including, but not limited to, medical, dental, vision, and federal and state leave programs as required by applicable agency regulations to those that meet eligibility. Upon successfully being hired, details will be provided related to our benefit offerings.

We look forward to working with you.

Beacon Hill. Employing the Future Other about 3 hours ago