> Markdown version of [/jobs/ext/1408293-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/1408293-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** Wells Fargo - **Location:** Woodbridge Township, NJ, United States (Remote available) - **Experience:** Expert - **Salary:** $119,000.0 - $224,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Agile Methodology, Airflow, Amazon Web Services, Application Frameworks, Automation of Tests, Microsoft Azure, BigQuery, Cloud Computing, Cloud Engineering, Cloud Storage, Continuous Integration, Directed Acyclic Graph (Directed Graphs), Data Validation, Data Security, Data Vault Modeling, Data Flow Control, Apache Hive, Identity and Access Management, Python (Programming Language), Open Source Technology, Cloudera, Software Engineering, SQL Databases, Workflow Management Systems, Data Logging, Google Cloud, Data Ingestion, Cloud Monitoring, Apache Spark, Build Server, Git Flow, Data Management, Data Pipelines, Apache Beam - **Published:** July 23, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=f7af0d3613277865 ## About the Role * 5+ years of Database Engineering experience, or equivalent demonstrated through one or a combination of the following: work experience, training, military experience, education * 5+ years of data management experience within Public Cloud (GCP, AWS, Azure) * 5+ years of hands on experience of Python or Java, plus Spark SQL for building data pipelines, libraries, and automation tooling. * 5+ years with orchestration tools (Cloud Composer/Airflow) and CI/CD (Cloud Build, Git-based workflows) for data workloads, * Experience with logging/monitoring stacks (Cloud Logging, Cloud Monitoring, error reporting, metrics dashboards * Experience with automated testing, data quality checks, and monitoring for pipelines and platform services. * Knowledge of cloud architecture principles (networking, security, IAM, reliability, cost management). * Experience with core GCP data services: BigQuery, Dataflow/Apache Beam, Dataproc, Pub/Sub. * Experience with Agile transformations and technology roadmaps. * Experience working with onshore and offshore teams. ## Description * Design and implement scalable, secure data platforms on Google Cloud using managed services (BigQuery, Dataflow, Dataproc, Pub/Sub, Cloud Storage, Composer).) * Build reusable frameworks and tooling (ingestion, transformation, quality, orchestration) that can be adopted by multiple product and domain teams. * Enable self-service data consumption and governance by standardizing patterns, templates, and platform capabilities rather than one-off pipelines. * Design logical and physical data platform architectures leveraging BigQuery, Dataflow/Apache Beam, Dataproc/Spark, Pub/Sub, and Cloud Storage. * Define and implement standardized ingestion, transformation, and serving patterns (batch and streaming) as reusable blueprints. * Optimize cost, performance, and reliability of GCP data workloads (partitioning, clustering, storage classes, autoscaling strategies). * Build opinionated data ingestion frameworks (e.g., config-driven pipelines, connectors, schema handling, error handling) on top of Dataflow, Dataproc, or Composer. * Develop shared transformation libraries in Python/SQL/Beam (e.g., common SCD patterns, data quality checks, masking/tokenization routines). * Provide orchestration capabilities via Cloud Composer or Cloud Workflows with reusable DAGs/templates and CI/CD integration. * Implement robust data modeling (dimensional, data vault, or canonical models) and semantic layers in BigQuery and related tools. * Enforce data quality, lineage, and observability using standardized metrics, validation rules, and monitoring dashboards. * Apply security and governance controls: IAM, VPC-SC, CMEK, row/column-level security, and policy-driven access patterns * Partner with domain data engineers, analytics, and ML teams to onboard use cases onto platform services and frameworks * Document patterns, runbooks, and best practices, and provide enablement through workshops and code examples. * Contribute to platform roadmap, tool selection, and evaluation of new GCP services and open-source components, * Flexible to provide both application development and production support during off-hours * This role is not eligible for Visa Sponsorship * Hybrid schedule (3 days in office, 2 days remote) * Work Transparently: You always deal in an honest, direct, and transparent way * Take Ownership: You embrace responsibility and find joy in having the answers * Learn More: You regularly self-educate and improve your skill set ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Why Git Still Matters](https://www.wearedevelopers.com/videos/100288-why-git-still-matters) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [How Much FAANG Companies Actually Pay Software Engineers in 2025](https://www.wearedevelopers.com/magazine/230-how-much-faang-companies-actually-pay-software-engineers-in-2025)