> Markdown version of [/jobs/ext/1030927-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/1030927-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Saransh Inc - **Location:** New York, NY, United States - **Experience:** Expert - **Salary:** $104,000.0 - $230,000.0 - **Contract:** Permanent contract - **Skills:** Agile Methodology, Airflow, Amazon Web Services, Amazon S3, Big Data, Data as a Services, Data Architecture, Information Engineering, Data Systems, PostgreSQL, Amazon Simple Notification Service (SNS), SQL Databases, Data Processing, Scripting, Electronic Medical Records, Data Lakes, Pyspark, Information Technology, AWS Glue, Data Pipelines - **Published:** June 5, 2026 - **Apply:** https://www.careerjet.com/jobad/us7511f07de389b95d321f3a13d1cd3d44 ## About the Role * Minimum Qualifications: 8+ Years overall IT experience with minimum 5 years of work experience in below tech skills. * Tech Skills: Strong experience in Python Scripting and PySpark for data processing. * Proficiency in SQL, dealing with big data processing. * Proven experience in data processing for data lake in Iceberg format, with strong understanding of architecture. * Experience in AWS Glue jobs. * Experience in AWS cloud platform and its data services (S3, Redshift, Lambda, EMR, Airflow, Postgres, SNS, Event bridge). * Expertise in BASH/Shell scripting. * Strong understanding of healthcare Finance systems and experience leading data engineering teams. * Experience in Agile environments. * Excellent problem-solving skills and attention to detail. * Effective communication and collaboration skills. ## Description * Senior Data Engineer Position Summary: The Senior Data Engineer leads complex data engineering projects, working on designing data architectures that align with business requirements. * This role focuses on optimizing data workflows, managing data pipelines, and ensuring the smooth operation of data systems., * Responsibilities: Leads development of data pipelines and architectures that handle large-scale data sets. * Designs, constructs, and tests data architecture aligned with business requirements. * Provides technical leadership for data projects, ensuring best practices and high-quality data solutions. * Collaborates with product, finance, and other business units to ensure data pipelines meet business requirements. * Oversees development of data solutions that enable predictive and prescriptive analytics. * Ensures the technical quality of solutions, managing data as it moves across environments. * Aligns data architecture to Healthfirst solution architecture. ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [How we built an AI-powered code reviewer in 80 hours](https://www.wearedevelopers.com/videos/1511-how-we-built-an-ai-powered-code-reviewer-in-80-hours) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) ## Related Articles - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Software Engineer Salary London](https://www.wearedevelopers.com/magazine/252-software-engineer-salary-london)