AI Platform Architect

EisnerAmper LLP
Edison, United States of America
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Edison, United States of America

Tech stack

Artificial Intelligence
Application Performance Management
Audit Trail
Azure
C Sharp (Programming Language)
Cloud Engineering
Information Engineering
Data Governance
DevOps
Github
Monitoring of Systems
Python
Log Analysis
SQL Azure
Performance Tuning
Power BI
Azure
Azure
Search Technologies
SQL Databases
TypeScript
Cloud Platform System
Cloud Monitoring
Large Language Models
Grafana
Caching
AI Platforms
Core Data
Kubernetes
Information Technology
Data Lineage
Deployment Automation
Performance Monitor
Bicep
Cosmos DB
Data Management
Machine Learning Operations
Terraform
Azure
Docker
Databricks

Job description

EisnerAmper is seeking an AI Platform Architect who will serve as the technical backbone of EisnerAmper's AI transformation, owning the performance, reliability, and cost-efficiency of the EisnerAI Platform. This role is purpose-built to accelerate our journey to 1,000 deployed AI agents by designing and optimizing the infrastructure that powers every solution-from intelligent tax preparation to agentic audit workflows. The Platform Architect will benchmark and evaluate LLMs, codify AI and data governance into platform guardrails, build executive-grade reporting, and relentlessly drive cost and performance optimization across the entire AI stack.

Reporting to the AI Development Lead, this is a high-impact, high-visibility role at the intersection of architecture, AI engineering, and strategic operations. A critical dimension of this position is mentoring and developing talent across organizational boundaries-partnering with IT infrastructure teams, the AI Advisory service line, and functional business units to build platform fluency and AI capability firmwide. What it Means to Work for EisnerAmper:

  • You will get to be part of one of the largest and fastest growing accounting and advisory firms in the industry
  • You will have the flexibility to manage your days in support of our commitment to work/life balance
  • You will join a culture that has received multiple top "Places to Work" awards
  • We believe that great work is accomplished when cultures, ideas and experiences come together to create innovative solutions
  • We understand that embracing our differences is what unites us as a team and strengthens our foundation
  • Showing up authentically is how we, both as professionals and a Firm, find inspiration to do our best work

What Work You Will be Responsible For:

  • Architect and scale the EisnerAI Platform on Azure, designing core data, application, and agentic layers to support growth toward 1,000+ AI agents
  • Codify AI governance policies (NIST AI RMF, PCAOB, Section 7216) into enforceable platform-level controls, automated compliance checks, and governance-as-code pipelines
  • Serve as a technical mentor and cross-functional leader, elevating AI platform capabilities across IT, AI Advisory, and engineering teams
  • Lead AI performance engineering across the firm's LLM ecosystem - benchmarking models (GPT-4o, o3, etc.) for accuracy, latency, cost, and quality to drive model selection and routing strategy
  • Build and operate a real-time AI performance monitoring layer tracking hallucination rates, retrieval precision, adoption, cost-per-interaction, and ROI
  • Optimize prompts, model configurations, and routing strategies to maximize output quality while reducing token consumption and overall platform cost
  • Own AI cost management across Azure AI Foundry and related services, implementing intelligent model routing, caching, and token budgeting to continuously lower cost-per-agent
  • Ensure all AI deployments meet regulatory, risk, and firm data governance standards prior to production
  • Deliver executive and board-level dashboards translating AI performance, adoption, and cost metrics into clear business value narratives

Requirements

  • Bachelor's degree in Computer Science, Engineering, Data Science, or related technical field
  • 8+ years of experience in cloud platform architecture, infrastructure engineering, or AI/ML platform development
  • 5+ years of hands-on experience with Microsoft Azure services (AI Foundry, Azure OpenAI, Cosmos DB, ADLS, Purview, AI Search)
  • 3+ years of experience benchmarking, evaluating, and optimizing LLM-based systems in production environments

Preferred or Desired Qualifications

  • Master's degree preferred (Computer Science, AI/ML, Cloud Architecture, or MBA with technical focus)
  • Azure Solutions Architect Expert, Azure AI Engineer Associate, or equivalent certifications strongly preferred
  • Data Platforms: ADLS Gen2, Cosmos DB, Azure SQL, Azure Synapse/Databricks for analytics and data engineering
  • AI Search & RAG: Vector search, semantic ranking, knowledge mining, and retrieval pipeline optimization
  • Governance & Compliance Tooling: Microsoft Purview, Azure Policy, data lineage, and audit logging frameworks
  • Monitoring & Observability: Azure Monitor, Application Insights, Log Analytics, custom dashboards (Power BI, Grafana)
  • Programming Languages: Python, C#, TypeScript, SQL, Bicep/Terraform
  • DevOps & MLOps: Azure DevOps, GitHub Actions, Docker, Kubernetes, CI/CD pipeline design
  • Cost Management: Azure Cost Management, FinOps practices, token-level cost tracking and optimization
  • Proven track record of designing and implementing data governance frameworks and compliance controls at enterprise scale
  • Experience managing cloud cost optimization initiatives with demonstrated savings outcomes
  • Demonstrated experience mentoring technical and non-technical teams across organizational boundaries, including IT, advisory, or consulting functions

Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa for this position now or in the future.

About the company

At EisnerAmper, we look for individuals who welcome new ideas, encourage innovation, and are eager to make an impact. Whether you're starting out in your career or taking your next step as a seasoned professional, the EisnerAmper experience is one-of-a-kind. You can design a career you'll love from top to bottom - we give you the tools you need to succeed and the autonomy to reach your goals., EisnerAmper is one of the largest accounting, tax, and business advisory firms, with approximately 450 partners and 4,500 employees across the world. We combine responsiveness with a long-range perspective; to help clients meet the pressing issues they face today and position them for success tomorrow. Our clients represent enterprises of every form, ranging from sophisticated financial institutions to startups, global public firms to middle-market companies, governmental entities as well as high-net-worth individuals, family offices, nonprofit organizations and entrepreneurial ventures across a variety of industries. We are also engaged by the attorneys, financial professionals, bankers, investors, and key stakeholders who serve these clients. Should you need any accommodations to complete this application please email:talentacquisition@eisneramper.com

Apply for this position