> Markdown version of [/jobs/ext/1820022-python-big-data-developer](https://www.wearedevelopers.com/jobs/ext/1820022-python-big-data-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Python/Big Data Developer - **Company:** Matlen Silver - **Location:** New York, NY, United States - **Salary:** $124,800.0 - $141,440.0 - **Contract:** Temporary contract - **Skills:** Apache HTTP Server, Big Data, Cloudera Impala, Databases, Data Infrastructure, Distributed Data Store, Distributed Systems, Apache Hadoop, Python (Programming Language), PostgreSQL, MongoDB, Object-Oriented Software Development, Software Construction, Enterprise Data Management, Data Processing, Fastapi, Data Lakes, Pyspark, Information Technology, Data Management - **Published:** July 31, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=e50c1511958605ed ## About the Role Overview We are seeking a Python Developer with strong Big Data and Data Lake engineering experience to support Data Lake migration, modernization, and ongoing platform maintenance initiatives. This role is ideal for an engineer who is passionate about building scalable data solutions and has experience working with modern Big Data technologies. We are open to candidates with either: * Strong Big Data/Data Lake engineering experience complemented by Python development, or * Strong Python development experience with solid exposure to Big Data engineering. Required Skills * Strong Python development experience * Experience working with Big Data/Data Lake technologies * Hands-on experience with PySpark * Experience with Apache Iceberg * Experience with Hadoop * Experience with Impala * Experience supporting Data Lake migration, engineering, and maintenance initiatives * Strong understanding of data processing, distributed computing, and scalable data platforms Preferred Qualifications * Experience with object-oriented databases such as: * MongoDB * PostgreSQL, * Bachelor's or Master's degree in Computer Science, Engineering, or a related technical discipline. * Experience developing scalable applications using Python. * Hands-on experience with Big Data ecosystems and Data Lake technologies. * Strong analytical and problem-solving skills. * Excellent communication and collaboration abilities. Preferred Candidate Profile We're looking for a software engineer who combines strong Python development skills with experience building and maintaining enterprise-scale Data Lake platforms. The ideal candidate has worked with distributed data technologies such as PySpark, Apache Iceberg, Hadoop, and Impala, and has experience supporting Data Lake migrations. Experience with object-oriented databases-including MongoDB, PostgreSQL, or financial industry platforms ## Description * Develop and maintain Python applications supporting enterprise Data Lake platforms. * Participate in Data Lake migration and modernization efforts. * Build and optimize scalable data processing pipelines using PySpark. * Work with Apache Iceberg, Hadoop, and Impala to develop and maintain large-scale data solutions. * Collaborate with engineering teams to improve performance, reliability, and scalability of the data platform. * Troubleshoot production issues and support ongoing platform maintenance. * Write clean, maintainable, and reusable Python code following software engineering best practices. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Intro to FastAPI](https://www.wearedevelopers.com/videos/462-intro-to-fastapi) - [40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs](https://www.wearedevelopers.com/videos/208-40-minutes-to-build-a-serverless-covid-19-rest-and-graphql-apis) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers)