> Markdown version of [/jobs/ext/1167133-sr-data-engineer-with-ai-ml](https://www.wearedevelopers.com/jobs/ext/1167133-sr-data-engineer-with-ai-ml). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Sr. Data Engineer with AI/ML

- **Company:** Sumeru INC
- **Location:** Frisco, TX, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Artificial Intelligence, Business Analytics Applications, Computing Platforms, ARM Architecture, User Authentication, Microsoft Azure, Big Data, Profiling, Computer Engineering, Customer Data Management, Data Architecture, Data Cleansing, Information Engineering, Data Governance, Data Infrastructure, Data Migration, Data Stores, Data Warehousing, Relational Databases, Digital Assets, Fault Tolerance, Graph Database, Apache Hive, Python (Programming Language), Knowledge Management, NoSQL, OAuth, Performance Tuning, Query Optimization, Queueing Systems, Swagger, JSON Web Token, Scala (Programming Language), SQL Databases, Data Streaming, Web Applications, Openapi, Data Processing, Postman, Autoscaling, Snowflake, Multi-Agent Systems, Apache Spark, Data Lakes, Pyspark, Information Technology, Data Lineage, Low Latency, Cosmos DB, Data Management, Machine Learning Operations, Restful APIs, Stream Processing, Data Pipelines, Api Management, Databricks
- **Published:** July 3, 2026
- **Apply:** https://www.careerjet.com/jobad/us4cbc038ed92a33c13b885467e3f4fb47

## About the Role

Bachelor s Degree in Computer Science, Computer Engineering, or a related field, or equivalent practical experience
8+ years of hands-on experience designing, building, and supporting data engineering solutions
Strong experience developing and migrating data solutions across cloud platforms
Demonstrated technical leadership and mentoring experience
Strong analytical and problem-solving skills applied to complex data challenges
Ability to manage multiple concurrent initiatives with strong organizational and prioritization
Passion for learning and applying new data and platform technologies
Must Have Skills
Core Data Engineering & Platforms
Advanced experience designing and building complex data pipelines using Python and SQL
Strong experience with cloud platforms and services, including Azure (Data Factory, Data Lake, Event Hub, Functions, Web Apps, Cosmos DB)
Databricks with PySpark, Spark SQL, Scala, Spark, including cluster configuration, autoscaling, and performance optimization (e.g., Photon)
Snowflake data warehousing, including schema design (star/snowflake), query optimization, and cost/performance tuning
Expertise in SQL, NoSQL, and relational database design and development
APIs, Streaming & Integration
Proficiency designing and consuming RESTful APIs with secure authentication and authorization (OAuth 2.0, JWT, API keys)
Experience using Postman and Swagger/OpenAPI for API testing, documentation, and validation
Working knowledge of message queuing, stream processing, and highly scalable big-data data stores
Engineering Practices
Advanced knowledge of data pipeline development using Python and experience with languages such as SQL, DAX, Java, Scala, and/or Go
Experience performing root-cause analysis and using technology to solve complex business problems
Experience adopting AI-assisted development tools and building AI-powered agents or agentic workflows to automate engineering tasks, accelerate delivery, and enhance data platform capabilities
Experience with NL-to-SQL query generation using Databricks Genie and Snowflake Cortex to enable natural language access to data assets
Hands-on experience with Unity Catalog for data governance, fine-grained access control, and end-to-end data lineage
Experience developing AI-assisted dbt models, including AI-generated transformation logic, automated documentation, and intelligent testing
Familiarity with AI-powered data quality tools for automated profiling, anomaly detection, and pipeline observability Nice to Have
Experience with Iceberg table design and optimization
Experience with Unity Catalog governance and security
Cloud platform certifications such as Azure Certified Solutions Architect, Azure Cloud Practitioner, or MCSA
Experience contributing to enterprise data governance, security, or compliance initiatives
Experience with ML feature platforms (e.g., Feast, Tecton, or Databricks Feature Store) and vector database engineering (e.g., Pinecone, Weaviate, pgvector)
Experience designing and operating streaming AI pipelines and applying MLOps practices to data engineering workflows
Exposure to end-to-end ML pipeline ownership and real-time AI inference plumbing in production environments

## Description

Sr Engineer, Data designs and delivers scalable data architectures and advanced data engineering solutions across on-premises, cloud, and hybrid platforms to support enterprise analytics and customer intelligence use cases. This role partners closely with data engineers, architects, and analytics teams to analyze, design, and optimize data warehouse and analytics solutions that power personalization and data-driven decision-making within the customer data platform. The Sr Engineer provides hands-on technical leadership, mentors engineers, and drives the evolution of modern data architectures. Success is measured by solution effectiveness, scalability, performance, and growth in team capability and architectural maturity.
What You ll Do
Design and develop advanced data engineering solutions that enable data pipelines, visualization, and analytical tools
Architect and implement scalable data platforms across on-premises, cloud, and hybrid environments
Build, optimize, and operate complex batch and real-time and near real-time streaming data pipelines
Build, optimize, and operate low-latency, sub-second APIs on highly scalable, fault-tolerant architectures.
Design and maintain high-throughput data pipelines to support agentic AI workloads and real-time multi-agent MCP orchestration.
Build and maintain enterprise-scale Graph Databases that power organizational knowledge graphs and connected data experiences.
Perform data wrangling, exploration, and discovery across heterogeneous data sources to generate insights
Lead development of large-scale data processing solutions using Databricks and Spark technologies
Contribute to team knowledge sharing and advancement of data engineering standards and capabilities
Mentor engineers to strengthen technical skills, delivery quality, and professional growth
Support project definition activities including estimation, planning, and scoping in partnership with management What You ll Bring


## Related Videos

- [Keeping applications secure by evolving OAuth 2.0 and OpenID Connect](https://www.wearedevelopers.com/videos/100152-keeping-applications-secure-by-evolving-oauth-2-0-and-openid-connect)
- [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis)
- [For the REST of us: API First and Conway’s Law](https://www.wearedevelopers.com/videos/1932-for-the-rest-of-us-api-first-and-conway-s-law)
- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [Delay the AI Overlords: How OAuth and OpenFGA Can Keep Your AI Agents from Going Rogue](https://www.wearedevelopers.com/videos/1637-delay-the-ai-overlords-how-oauth-and-openfga-can-keep-your-ai-agents-from-going-rogue)
- [Contract-First Frontend: Scaling Reliable UIs with OpenAPI and AI](https://www.wearedevelopers.com/videos/1995-contract-first-frontend-scaling-reliable-uis-with-openapi-and-ai)

## Related Articles

- [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)