> Markdown version of [/jobs/ext/3027720-senior-big-data-engineer-fastapi-expert](https://www.wearedevelopers.com/jobs/ext/3027720-senior-big-data-engineer-fastapi-expert). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Big Data Engineer (FastAPI expert) - **Company:** IQVIA - **Location:** Warsaw, IN, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Application Programming Interfaces (APIs), Agile Methodology, Artificial Intelligence, Data Analysis, Systems Engineering, Microsoft Azure, Batch Processing, Big Data, Code Generation, Software Quality, Continuous Integration, Information Engineering, Data Integration, Extract Transform Load (ETL), Data Profiling, Data Warehousing, Cursor (Graphical User Interface Elements), Database Design, Software Debugging, Software Design Patterns, DevOps, Python (Programming Language), Scrum Methodology, Productivity Software, Scala (Programming Language), Software Engineering, SQL Databases, Data Streaming, Parquet, Test-Driven Development (TDD), Delivery Pipeline, Apache Spark, Electronic Medical Records, Gitlab, Fastapi, Information Technology, Data Pipelines, Jenkins, Databricks - **Published:** September 22, 2026 - **Apply:** https://www.healthjobsnationwide.com/node/15530838/apply-external ## About the Role Bachelor's Degree in Information Technology, Software Engineering, Computer Science, Mathematics, or another related field Technical skills and knowledge * 6 years of the following language: SQL, Python, Scala * 6 years of experience in data engineering * Strong understanding of Databricks platform · Experience with Big Data Batch processing and Azure Cloud Services · Practical knowledge of Apache Spark ecosystem, including Delta and Parquet data formats · Experience with complex ETL design and implementation · Experience with data analysis, data profiling, data integration, data quality, data warehousing, data reporting · Experience with CI/CD automation processes and tools such as Jenkins/GitLab * undefined * undefined * Familiarity with AI-powered productivity tools such as Copilot or Cursor, and their practical use in day-to-day software development workflows (e.g. code generation, documentation, task automation, or debugging support) * Practical experience with FastAPI for building production-grade APIs is a plus · Experience working in an Agile environment · Experience with database design and modelling · Previous experience with healthcare or pharmaceutical data would be an advantage * Knowledge of algorithms & design patterns and how to apply them effectively * Experience with large data volume (TBs') processing * undefined Personal skills and behaviours · Excellent analytical & troubleshooting skills · Strong collaboration, written, and verbal skills · Familiarity with project management concepts, specifically Agile/Scrum · Ability to present complex results in a clear language for both technical and non- technical audience · Experience collaborating with teams from Europe, with an understanding of cross-cultural communication and remote delivery dynamics · A great team player mindset ## Description We are looking for an experienced, innovative and highly motivated engineer who is capable of working independently to design, develop, and support data engineering solutions. This role requires a considerable focus on understanding our data we deal with as an organization, develop a better understanding of our data through profiling, take ownership of the solution design, work collaboratively with the wider engineering team to implement optimal solutions in a timely manner and ensure successful deployment and operation of the platform in production. Our platform helps solve complex business challenges pertaining to healthcare data such as mapping wide variety of healthcare drug and diagnosis data to standard coding frames. You will have the opportunity to solve complex engineering challenges and develop innovative solutions. In your daily work you will be responsible for creation and delivery of a platform loading and processing millions of electronic medical records. The Team The Systems Engineering team is part of the Global Infrastructure & Operations (GIO) and remains one of the most dynamic and fast-growing groups in the organisation. We are passionate about Agile software development and are among the strongest advocates for DevOps and Test-Driven Development (TDD). Our culture promotes autonomy and collaboration, empowering individuals to thrive within self-organising teams. Our work involves processing and analysing a wide range of patient-level healthcare data, which supports solving complex healthcare challenges - from retrospective clinical studies to disease progression modelling. In your daily activities, you will collaborate with a team of Architects who design effective solutions, and with the Quality Assurance team, which ensures the highest standards of software quality. The Data We process over a billion records at a time; our engineers are responsible for the data analysis and construction and optimization of data flow processes. You will build data pipeline using ETL solutions for acquiring, processing and loading medical data into the Databricks. Core Responsibilities · Ability to oversee and guide junior and mid-level engineers, providing technical direction and mentoring to support their growth. · Delegating tasks effectively, ensuring clarity of expectations and alignment with delivery goals. · Ownership for the delivery of assigned workstreams, ensuring quality, timeliness, and accountability across the team. · Build pipelines for processing big amount of medical data · Participate in analysis, system design, development, deployment and maintenance · Conduct peer code reviews · Contribute to the definition and adoption of technical standards ## Related Videos - [WeAreDevelopers LIVE - Modern DevOps for IoT Devices and More](https://www.wearedevelopers.com/videos/1805-wearedevelopers-live-modern-devops-for-iot-devices-and-more) - [Hiring AI Native Talents](https://www.wearedevelopers.com/videos/100268-hiring-ai-native-talents) - [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Enabling automated 1-click customer deployments with built-in quality and security](https://www.wearedevelopers.com/videos/83-enabling-automated-1-click-customer-deployments-with-built-in-quality-and-security) ## Related Articles - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [The 12 Best Jobs for Software Engineers](https://www.wearedevelopers.com/magazine/401-the-12-best-jobs-for-software-engineers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies)