> Markdown version of [/jobs/ext/1429119-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1429119-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** McClure Engineering Co. - **Location:** San Jose, CA, United States - **Experience:** Expert - **Salary:** $114,400.0 - $124,800.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Architectural Patterns, Microsoft Azure, BigQuery, Cloud Computing, Code Review, Computer Programming, Databases, Continuous Integration, Data as a Services, Data Validation, Information Engineering, Data Governance, Data Infrastructure, Extract Transform Load (ETL), Data Security, Data Warehousing, DevOps, Dimensional Modeling, Distributed Computing Environment, Data Flow Control, Apache Hadoop, Python (Programming Language), Software Engineering, Data Streaming, Workflow Management Systems, Datadog, Azure Data Factory, Sql Optimization, Snowflake, Data Build Tool (dbt), Grafana, Apache Spark, Git, Event Driven Architecture, Containerization, Kubernetes, Information Technology, Apache Flink, Apache Kafka, Machine Learning Operations, Video Streaming, Terraform, Stream Analytics, Software Version Control, Data Pipelines, Docker, Amazon Redshift, Databricks - **Published:** July 24, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=8d2b4aeea181df1a ## About the Role * 7-8 years of hands-on experience in data engineering, backend engineering, or a related field. * Strong programming skills in Python and/or Scala/Java; advanced SQL proficiency required. * Deep experience with distributed data processing frameworks (Apache Spark, Hadoop, or similar). * Hands-on experience with cloud platforms (AWS, GCP, or Azure) and their data services (S3, Glue, Redshift, BigQuery, Dataflow, Data Factory, etc.). * Experience with workflow orchestration tools such as Apache Airflow, Dagster, or Prefect. * Solid understanding of data modeling concepts (dimensional modeling, normalization, CDC, SCD types). * Experience with streaming technologies (Kafka, Kinesis, Pub/Sub, or similar). * Proficiency with modern data warehouse/lakehouse platforms (Snowflake, Databricks, BigQuery, Redshift). * Strong understanding of data infrastructure best practices: version control (Git), CI/CD, containerization (Docker/Kubernetes), and infrastructure as code (Terraform). * Experience implementing data quality frameworks and monitoring/observability tools (e.g., Great Expectations, Monte Carlo, Datadog). * Strong understanding of data security, privacy, and compliance practices. * Excellent communication skills and ability to work cross-functionally with technical and non-technical stakeholders. * Bachelor's or Master's degree in Computer Science, Engineering, or a related field (or equivalent practical experience). Preferred / Nice-to-Have * Experience with real-time analytics and event-driven architectures. * Exposure to machine learning pipelines and MLOps practices. * Experience with dbt (data build tool) for transformation workflows. * Prior experience mentoring teams or leading technical projects. * Relevant certifications (AWS/GCP/Azure Data Engineer certifications). * Experience in a high-growth startup or high-scale enterprise environment., * backend engineering: 2 years (Required) * advanced SQL: 2 years (Required) * data infrastructure: 3 years (Required) Work Location: Hybrid remote in San Jose, CA 95139 ## Description We are looking for a Senior Data Engineer with 7-8 years of experience to design, build, and maintain scalable data infrastructure and pipelines. You will work closely with data scientists, analysts, and software engineering teams to ensure data is reliable, accessible, and optimized for analytics and decision-making. This is a senior individual-contributor role with strong ownership over architecture decisions and mentorship of junior engineers., * Design, build, and maintain robust, scalable ETL/ELT pipelines to ingest data from diverse sources (databases, APIs, streaming platforms, third-party systems). * Architect and optimize data warehouse/lakehouse solutions (e.g., Snowflake, BigQuery, Redshift, Databricks) for performance, scalability, and cost efficiency. * Build and maintain batch and real-time streaming data pipelines using tools such as Apache Kafka, Spark, Flink, or similar. * Own the design of data models (dimensional modeling, star/snowflake schemas) to support analytics, reporting, and ML use cases. * Implement data quality checks, monitoring, alerting, and observability across pipelines to ensure accuracy and reliability. * Collaborate with data scientists and analysts to understand data requirements and deliver clean, well-documented datasets. * Drive best practices around data governance, security, access control, and compliance (e.g., GDPR, SOC 2). * Optimize infrastructure costs and pipeline performance, identifying and resolving bottlenecks. * Mentor junior and mid-level data engineers; participate in code reviews and technical design discussions. * Partner with DevOps/Platform teams to manage CI/CD pipelines, infrastructure as code, and containerized deployments for data workloads. * Evaluate and recommend new tools, frameworks, and architectural patterns to improve the data platform. ## Related Videos - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)