> Markdown version of [/jobs/ext/1180245-data-engineer-senior-consultant-level](https://www.wearedevelopers.com/jobs/ext/1180245-data-engineer-senior-consultant-level). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - Senior Consultant level - **Company:** Visa Inc. - **Location:** Foster City, CA, United States - **Experience:** Expert - **Salary:** $169,100.0 - $270,800.0 - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Artificial Intelligence, Application Frameworks, Automated Storage and Retrieval Systems, Big Data, Cloud Computing, Cloud Engineering, Encodings, Continuous Integration, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Retrieval, Data Systems, Relational Databases, Distributed Data Store, Distributed Systems, Graph Database, Apache Hadoop, Apache Hive, Data Intelligence, Metadata, NoSQL, Redis, Cloud Services, Search Technologies, Data Streaming, AI Infrastructure, Enterprise Data Management, Cloud Platform System, Data Ingestion, Large Language Models, Multi-Agent Systems, Apache Spark, Generative AI, Indexer, Backend, Event Driven Architecture, Build Management, Containerization, Kubernetes, Infrastructure Automation Frameworks, Low Latency, Apache Flink, Real Time Data, Apache Kafka, Data Management, Stream Processing, Data Pipelines, Automation Anywhere - **Published:** July 4, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=44e746c673941c40 ## About the Role * 5+ years of relevant work experience with a bachelor's degree -or- At least 2 years of work experience with an Advanced degree (e.g., Masters, MBA, JD, MD) -or- 0 years of work experience with a PhD., * Four (4) years of experience solving data problems using data technologies (e.g., Hadoop, Hive, Kafka, Redis, NoSQL, RDBMS). * Experience building enterprise GenAI platforms, semantic search systems, or AI data infrastructure * Experience with vector databases, embedding pipelines, retrieval optimization, or knowledge graph systems * Experience implementing observability, lineage, evaluation, and governance frameworks for AI-enabled data systems * Familiarity with cloud-native AI infrastructure and scalable ML/data platform architectures * Exposure to payments, fintech, or highly regulated enterprise environments with stringent security and reliability requirements The Skills You Bring AI-Native Data Engineering Experience building data systems supporting LLM applications, RAG architectures, semantic retrieval, embeddings, vector databases, or AI orchestration workflows. Distributed Data Systems Strong expertise designing scalable distributed systems, streaming architectures, real-time pipelines, and large-scale data processing platforms. Retrieval & Knowledge Infrastructure Experience building semantic indexing systems, intelligent retrieval pipelines, metadata enrichment systems, or enterprise knowledge platforms. Real-Time Data Engineering Experience developing reliable event-driven and streaming systems using technologies such as Kafka, Spark, Flink, Hadoop, or similar large-scale processing frameworks. Production Platform Engineering Experience operationalizing secure, observable, and resilient production systems with strong focus on scalability, monitoring, governance, and reliability. Backend & API Engineering Ability to build backend services, APIs, orchestration integrations, and cloud-native components enabling intelligent applications and AI workflows. Cloud-Native Infrastructure Experience with Kubernetes, containerized deployments, CI/CD pipelines, infrastructure automation, and cloud platforms supporting distributed AI workloads. Data + AI Systems Thinking Ability to think beyond traditional ETL pipelines and design intelligent systems that provide context, retrieval, memory, and reasoning capabilities for AI applications. Builder Mentality Comfort operating in fast-moving environments with evolving AI technologies, ambiguous problem spaces, and platform-scale engineering challenges. ## Description We're building Visa's next-generation GenAI Platform - the intelligent data and orchestration foundation powering AI applications, copilots, semantic search, and agentic systems across the enterprise and eventually for Visa clients globally. As a Data Engineer on the GenAI Platforms team, you will help architect and scale the data infrastructure that powers enterprise AI systems at global scale. This is not a traditional data engineering role focused only on pipelines and warehousing. You will work on AI-native data systems including retrieval infrastructure, vector indexing, semantic knowledge platforms, real-time context pipelines, orchestration data flows, and intelligent data services that enable large language models and AI agents to operate securely and effectively across enterprise environments. You'll partner with software engineers, applied scientists, product teams, and platform architects to build highly scalable, production-grade systems that transform enterprise data into intelligent, context-aware AI experiences. This role is ideal for engineers who enjoy: * Building large-scale AI and data platforms from the ground up * Solving complex distributed systems and data retrieval challenges * Designing intelligent knowledge and context systems for LLMs and agents * Working across streaming systems, APIs, orchestration layers, and cloud-native infrastructure * Operationalizing GenAI systems in secure enterprise environments You'll help define how enterprise AI systems access, retrieve, reason over, and operationalize data across one of the world's most trusted technology platforms., * Real-time and batch data pipelines supporting semantic search, embeddings, RAG, and orchestration workflows * Intelligent context and indexing systems integrating structured and unstructured enterprise data * AI-ready data infrastructure enabling scalable LLM applications and workflow automation * Distributed streaming and event-driven architectures supporting AI-native applications * Observability, evaluation, and governance systems for production AI data platforms The Work Itself * Design and build scalable data platforms supporting LLM applications, AI agents, semantic search, and retrieval-augmented generation (RAG) * Develop high-throughput real-time and batch data pipelines integrating enterprise systems, APIs, documents, events, and knowledge sources * Build vector indexing, embedding pipelines, semantic retrieval systems, and intelligent context management frameworks * Engineer backend services and APIs enabling orchestration workflows, AI tool integrations, and enterprise automation use cases * Develop scalable data ingestion and transformation frameworks for structured and unstructured enterprise data * Optimize performance, reliability, latency, and scalability of distributed AI data systems operating at enterprise scale * Implement observability, lineage, monitoring, and evaluation frameworks for AI-powered data platforms * Partner with product managers, software engineers, data scientists, and platform teams to deliver secure, production-grade AI capabilities * Contribute reusable frameworks, platform tooling, and engineering best practices accelerating enterprise GenAI adoption * Explore emerging technologies across GenAI infrastructure, orchestration systems, vector databases, and cloud-native data platforms This is a hybrid position. Expectation of days in office will be confirmed by your Hiring Manager. ## Related Videos - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [Reducing LLM Calls with Vector Search Patterns - Raphael De Lio (Redis)](https://www.wearedevelopers.com/videos/1714-reducing-llm-calls-with-vector-search-patterns-raphael-de-lio-redis) - [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search) - [Developer Experience, Platform Engineering and AI powered Apps](https://www.wearedevelopers.com/videos/990-developer-experience-platform-engineering-and-ai-powered-apps) - [Accelerating Authentication Architecture: Taking Passwordless to the Next Level](https://www.wearedevelopers.com/videos/733-accelerating-authentication-architecture-taking-passwordless-to-the-next-level) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) ## Related Articles - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [Got AI ideas but no money? Here are 10 free ways to level up your AI skills with Google Cloud](https://www.wearedevelopers.com/magazine/600-got-ai-ideas-but-no-money-here-are-10-free-ways-to-level-up-your-ai-skills-with-google-cloud) - [What Industries Outside of AI Are Hiring The Most AI Experts?](https://www.wearedevelopers.com/magazine/98-what-industries-outside-of-ai-are-hiring-the-most-ai-experts) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)