> Markdown version of [/jobs/ext/1197371-principal-software-engineer-generative-ai](https://www.wearedevelopers.com/jobs/ext/1197371-principal-software-engineer-generative-ai). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Principal Software Engineer - Generative AI... - **Company:** Insight Global - **Location:** Whitpain Township, PA, United States (Remote available) - **Experience:** Experienced - **Salary:** $215,000.0 - $260,000.0 - **Contract:** Temporary contract - **Skills:** A/B Testing, Application Programming Interfaces (APIs), Artificial Intelligence, Amazon Web Services, Amazon S3, Microsoft Azure, BigQuery, Cloud Computing, Continuous Integration, Data Governance, DevOps, Systems Analysis, Tensorflow, Azure Machine Learning, Search Technologies, Software Engineering, Google Cloud, Pytorch, Large Language Models, Model Validation, Multi-Cloud, Caching, Generative AI, Event Driven Architecture, Containerization, AI Platforms, Scikit Learn, Kubernetes, Information Technology, Terraform, Docker - **Published:** July 7, 2026 - **Apply:** https://www.juju.com/job/00000000gehqqi ## About the Role * 10+ years of progressive, hands-on IT experience spanning systems analysis, application design, application development, and leading engineering teams. * 7+ years designing and developing modern microservices architectures and cost-effective APIs for enterprise-scale solutions. * 7+ years managing stakeholder requirements and translating them into robust, secure, and scalable technical solutions. * 5+ years building or leading large-scale, mission-critical applications with a focus on performance, resiliency, and security. * 5+ years of hands-on delivery for enterprise cloud initiatives on public cloud platforms (AWS and/or Google Cloud), including architecture, deployment, and optimization. * 5+ years implementing DevOps and CI/CD automation, including containerization and orchestration (Kubernetes, Docker) * 3+ years of software development with a strong emphasis on Generative AI and Large Language Models (LLMs); familiarity with AI/ML frameworks and libraries (e.g., TensorFlow, PyTorch, Scikit-learn) and productionizing AI systems. * Demonstrated ability to influence architecture decisions, lead cross-functional teams, and deliver complex solutions in compliance-conscious environments. Preferred Qualifications * Hands-on experience with AWS Bedrock (Converse API, Agents, Knowledge Bases, Guardrails) and/or Google Cloud Vertex AI (Vertex AI API for Gemini, Agent Builder, Vector Search, Search & Grounding, Model Garden). * Expertise in RAG architectures, including embeddings, chunking, retrieval/reranking, vector databases, and caching strategies-implemented on Bedrock and/or Vertex AI. * Proven track record implementing Responsible AI: safety guardrails, bias/fairness testing, red-teaming, human-in-the-loop workflows, and policy compliance. * Strong background in observability and evaluation for AI systems: tracing/telemetry, token/inference cost attribution, A/B testing and offline/online evals (groundedness, hallucination), and drift monitoring. * Experience with FinOps for AI workloads (prompt optimization, caching/batching, model selection, distillation/quantization strategies, streaming). * Familiarity with infrastructure as code and platform engineering (e.g., Terraform, CDK, GitOps) and event-driven architectures. * Background in regulated industries (e.g., healthcare) and working knowledge of HIPAA/PHI, data governance, encryption, and access control. * Multi-cloud awareness (e.g., Azure OpenAI) and vendor/model evaluation frameworks. * Relevant certifications such as AWS Solutions Architect - Professional, AWS Machine Learning - Specialty, AWS Certified AI Practitioner, Google Cloud Professional Cloud Architect, or Google Cloud ML Engineer. ## Description Our Healthcare Insurance Client is looking to hire a Principal Software Engineer - Generative AI. This position is remote work from home and will convert to an FTE position after 1 year. Annual salary upon conversion to FTE will be $215-260K., We are seeking a Principal Software Engineer to lead the design and delivery of enterprise-scale Generative AI solutions that power next-generation healthcare experiences. This role goes beyond hands-on coding-you will define technical strategy, establish architectural standards, and guide multiple teams in building secure, scalable, and cost-effective AI platforms across AWS (Bedrock) and Google Cloud (Vertex AI API). You will partner with product, security, compliance, and enterprise architecture teams to ensure solutions meet business objectives, regulatory requirements, and performance goals. The ideal candidate combines deep technical expertise with leadership skills-capable of influencing cross-org architecture decisions, mentoring engineering teams, and driving responsible AI practices in production., * Lead end-to-end platform delivery of highly scalable, secure AI services and applications leveraging AWS Bedrock (Foundation Models, Knowledge Bases, Agents, Guardrails) and Google Cloud Vertex AI (Gemini via Vertex AI API, Agent Builder, Vector Search, Search & Grounding). * Architect and implement Retrieval-Augmented Generation (RAG) solutions, integrating proprietary data from sources like Amazon S3 and Google Cloud Storage/BigQuery, and using Bedrock Knowledge Bases and/or Vertex AI Search & Grounding with Vector Search to improve relevance and accuracy. * Design solutions that use function/tool calling and multimodal input processing across both platforms (e.g., Bedrock Converse API and Vertex AI API), and integrate with enterprise systems via secure, well-governed service interfaces. * Define reference architectures, golden paths, and guardrails for multi-cloud AI development; drive adoption through design reviews, Architecture Decision Records (ADRs), and clear SLOs for latency, resiliency, safety, and cost. * Champion Responsible AI: implement safety filters, policy-enforced guardrails, data minimization, and red-teaming playbooks using capabilities such as Bedrock Guardrails and Vertex AI Safety. * Partner with Security, Privacy, and Legal to ensure compliance with HIPAA/PHI, encryption, access control, and continuous auditability. * Build evaluation and observability frameworks (groundedness, hallucination rates, relevance, toxicity, drift, cost attribution, A/B testing) and drive FinOps practices (prompt optimization, caching, batching, model selection) across clouds. * Mentor Staff/Senior Engineers, elevate coding and design standards, and foster a culture of learning (design clinics, brown bags, communities of practice). * Monitor the rapidly evolving AI landscape (LLMs, agent frameworks, platform features) and translate advances into actionable platform strategy and roadmaps. ## Related Videos - [Should we build Generative AI into our existing software?](https://www.wearedevelopers.com/videos/1129-should-we-build-generative-ai-into-our-existing-software) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [HTTP headers that make your website go faster](https://www.wearedevelopers.com/videos/1676-http-headers-that-make-your-website-go-faster) - [Docker build without Docker](https://www.wearedevelopers.com/videos/100114-docker-build-without-docker) - [The Future of Developer Experience with GenAI: Driving Engineering Excellence](https://www.wearedevelopers.com/videos/1107-the-future-of-developer-experience-with-genai-driving-engineering-excellence) ## Related Articles - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering) - [Stephan Gillich - Bringing AI Everywhere](https://www.wearedevelopers.com/magazine/489-stephan-gillich-bringing-ai-everywhere)