> Markdown version of [/jobs/ext/1991482-senior-data-engineer-in-oakland](https://www.wearedevelopers.com/jobs/ext/1991482-senior-data-engineer-in-oakland). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Senior Data Engineer in Oakland

- **Company:** Energy Jobline
- **Location:** Oakland, CA, United States
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Airflow, Amazon Web Services, Microsoft Azure, Big Data, Continuous Integration, Information Engineering, Extract Transform Load (ETL), Data Transformation, Data Warehousing, Software Debugging, DevOps, Distributed Data Store, Python (Programming Language), Cloud Services, Standard Sql, Workflow Management Systems, Data Ingestion, Azure Data Factory, Snowflake, Data Lakes, Pyspark, AWS Glue, Software Version Control, Data Pipelines, Databricks
- **Published:** August 8, 2026
- **Apply:** https://www.energyjobline.com/job/senior-data-engineer-oakland-31404812

## About the Role

* Strong hands-on experience in Python and PySpark for large-scale data engineering.
 * Proven expertise in using Databricks for data transformation and analytics.
 * Solid working knowledge of SQL and cloud data platforms (e.g., Snowflake).
 * Experience with major cloud providers (AWS ; Azure/GCP considered).
 * Good understanding of data modelling, data warehouses, and data lakes.
 * Exposure to orchestration tools like Airflow, AWS Glue, or Azure Data Factory.
 * Familiarity with DevOps practices, CI/CD, and version control systems.
 * Strong problem-solving and debugging skills in distributed data environments.

## Description

* Build and maintain ETL/ELT data pipelines using PySpark and Databricks.
 * Work with distributed datasets, ensuring efficiency, scalability, and accuracy.
 * Develop and optimize workflows for data ingestion, transformation, and warehousing.
 * Write high-quality Python code for data engineering use cases.
 * Collaborate with data science and analytics teams to translate requirements into solutions.
 * Troubleshoot issues, optimize queries, and manage performance within AWS cloud environments.
 * Support CI/CD and automation workflows for reliability and repeatability.


## Related Videos

- [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)

## Related Articles

- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [A Guide to Green Tech and Green IT Careers](https://www.wearedevelopers.com/magazine/374-a-guide-to-green-tech-and-green-it-careers)
- [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)