> Markdown version of [/jobs/ext/1922082-data-engineer](https://www.wearedevelopers.com/jobs/ext/1922082-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Data Engineer - **Company:** Lorven Technologies Inc - **Location:** Foster City, CA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Amazon Web Services, Amazon S3, Business Analytics Applications, Confluence, JIRA, Microsoft Azure, Business Software, Cloud Database, Information Systems, Computer Engineering, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Infrastructure, Data Integration, Extract Transform Load (ETL), Data Warehousing, DevOps, Middleware, Identity and Access Management, Python (Programming Language), Messaging Application Programming Interface, Meta-Data Management, Performance Tuning, Standard Sql, SQL Databases, Systems Integration, Unstructured Data, Enterprise Data Management, Data Processing, Apache Spark, Boomi, Software Troubleshooting, Event Driven Architecture, Data Lakes, Pyspark, Information Technology, Apache Kafka, Data Management, Api Design, Cloudwatch, Data Pipelines, Serverless Computing, Mulesoft, Amazon Redshift, Databricks - **Published:** August 4, 2026 - **Apply:** https://www.dice.com/job-detail/0a7d65e9-bf93-47f5-b23b-6e048fe25c0f ## About the Role * Bachelor's degree preferably in Computer Science, Information technology, Computer Engineering, or related IT discipline or equivalent experience with 12+ Minimum Experience * 10+ years of experience in Data Engineering, Data Integration, or Data Platform delivery; hands-on experience with Databricks on AWS; Apache Spark, PySpark, Delta Lake, and Lakehouse architecture * Experience designing and implementing enterprise-scale data pipelines; Strong understanding of AWS services such as S3, Glue, Lambda, Redshift, IAM, and CloudWatch * Hands-on experience with MDM implementations and integrations; Experience with data quality, data governance, lineage, and master data management processes * Strong experience integrating enterprise systems using middleware platforms such as MuleSoft, Boomi, Kafka, or API-based integrations * Experience working with structured, semi-structured, and unstructured datasets; Strong SQL and Python development skills * Experience with Agile methodologies and DevOps practices; Experience leading distributed teams and managing stakeholder communications * Bachelor's Degree or higher in Information Systems, Computer Science, or equivalent experience * Skills / Tech Stack Snapshot - Databricks on AWS, Apache Spark, PySpark, Delta Lake, AWS S3, Glue, Lambda, Redshift, MDM Platforms (Informatica MDM, Reltio, Profisee or equivalent), Data Integration & ETL/ELT Frameworks, Middleware Technologies (MuleSoft, Boomi, Kafka, API-led Integrations), Data Warehousing & Data Lake Architecture, Data Governance, MDM, Data Quality & Metadata Management, SQL, Python, Azure DevOps, Jira, Confluence, CI/CD, Agile Delivery ## Description Hiring Data Engineering Lead with strong expertise in Databricks on AWS, MDM, and enterprise data integration. Lead the design and delivery of modern data platforms that enable trusted, governed, and scalable data consumption across business functions. Experience in cloud-based data engineering, middleware integrations, data governance, and enterprise-scale analytics solutions. Work closely with business, architecture, analytics, and engineering teams to drive data modernization initiatives. This role will be instrumental in enabling the enterprise data modernization journey. Establish a scalable and governed data foundation that supports advanced analytics, AI/ML initiatives, and business decision-making. Success in this role will directly improve data quality, consistency, and accessibility across critical business domains. The architecture and integration patterns defined by this role will serve as a foundation for future data and digital transformation programs., * Lead the design and implementation of Databricks-based data platforms on AWS; Architect scalable Lakehouse solutions supporting enterprise analytics workloads * Design and develop complex ETL/ELT pipelines using Databricks, Spark, and Cloud-native services; Drive MDM strategy, implementation, and integration across business applications and data platforms * Define data integration patterns using APIs, middleware, event-driven architectures, and messaging frameworks; Establish data governance, metadata management, and data quality frameworks * Collaborate with business stakeholders to understand data requirements and translate them into technical solutions; Optimize data processing performance, scalability, and operational monitoring * Define CI/CD processes and deployment standards for data engineering assets; Mentor engineering teams and provide technical leadership throughout the project lifecycle * Support architecture reviews, solution design discussions, and technical decision-making; Ensure compliance with organizational standards, security requirements, and best practices * Facilitate architecture reviews, workshops, and stakeholder discussions; Ability to communicate complex technical concepts to business and executive stakeholders; * Stakeholder Management - Build strong relationships with business, IT, and external partners; Manage competing priorities and drive consensus among stakeholders; Demonstrate customer-centric and consultative engagement skills. * Leadership Skills - Lead cross-functional and geographically distributed teams; Mentor and guide engineers and junior architects; Influence technical decisions through collaboration * Problem Solving & Analytical Thinking - Identify root causes of complex data and integration challenges; Evaluate multiple solution options and recommend optimal approaches; Strong troubleshooting and performance optimization capabilities ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Improving quality with Agentic AI with Rovo Dev and Xray](https://www.wearedevelopers.com/videos/2005-improving-quality-with-agentic-ai-with-rovo-dev-and-xray) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [DevOps Maturity Check – a way to balance autonomy and alignment](https://www.wearedevelopers.com/videos/58-devops-maturity-check-a-way-to-balance-autonomy-and-alignment) - [Collaboration Quantified: Lessons from Open Source Developer Networks](https://www.wearedevelopers.com/videos/1422-collaboration-quantified-lessons-from-open-source-developer-networks) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer)