> Markdown version of [/jobs/ext/1959432-lead-data-engineer](https://www.wearedevelopers.com/jobs/ext/1959432-lead-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Data Engineer - **Company:** Intersources Inc. - **Location:** Foster City, CA, United States - **Experience:** Expert - **Salary:** $24,000.0 - **Contract:** Permanent contract - **Skills:** Airflow, Bash Shell, Computer Programming, Information Engineering, Payment Systems, Apache Hadoop, Hadoop Distributed File System, Apache Hive, Python (Programming Language), Korn Shell, Simple Data Format, Parquet, Scripting, Apache Yarn, Pyspark, Avro, Apache Kafka, Spark Streaming - **Published:** August 6, 2026 - **Apply:** https://www2.jobdiva.com/portal/?a=62jdnw10t7d77ytz0lbaey9qxonk3b05a9tqw96rb7z6hlfo7xj79l9g6mp6aj2o&compid=0/jobs/26822885#/jobs/26822885 ## About the Role Minimum 10 years experience in Data Engineering and Lead experience atleast 3-4 years. Experience with Hadoop ecosystem (HDFS, Hive, Yarn, File formats like Avro/Parquet), Kafka, Spark Streaming, PySpark, Airflow. Experience with programming in languages Python, and scripting tools like Bash, KSH. Digital payments or financial domain will be plus. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From event streaming to event sourcing 101](https://www.wearedevelopers.com/videos/91-from-event-streaming-to-event-sourcing-101) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)