> Markdown version of [/jobs/ext/2198699-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/2198699-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Tiger Analytics - **Location:** Chicago, IL, United States - **Experience:** Expert - **Salary:** $84,800.0 - $116,600.0 - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Airflow, Amazon Web Services, Amazon S3, Big Data, Cloud Computing, Data Architecture, Information Engineering, Data Infrastructure, Extract Transform Load (ETL), Data Systems, Standard Sql, SQL Databases, Unstructured Data, Data Processing, Data Ingestion, Large Language Models, Apache Spark, Generative AI, AWS Lambda, Data Lakes, AWS Glue, Veeva, Data Pipelines, Amazon Redshift, Databricks - **Published:** August 23, 2026 - **Apply:** https://www.careerjet.com/jobad/us0e269d587fd8e950aa335a71c5f6fd1c ## About the Role * 8+ years of experience in Data Engineering, preferably with experience supporting commercial pharmaceutical/healthcare data environments. * Strong hands-on experience with AWS cloud, Databricks, Spark, and SQL * Strong experience building ETL/ELT data pipelines and large-scale data processing workflows. * Hands-on experience with Apache Airflow for workflow orchestration. * Strong understanding of data modeling, data lake/lakehouse architecture, data ingestion, and transformation frameworks. * Deep knowledge of commercial pharmaceutical data sources: Xponent, Veeva, MMIT, Plantrak, Specialty Pharmacy, LAAD, and other commercial pharma data sources * Strong understanding of pharmaceutical commercial data processes, including: Alignment, Allocation, Split credits, Market basket, Customer universe * Strong understanding of pharma KPIs, metrics, and commercial analytics. * Strong analytical, problem-solving, and data troubleshooting skills. ## Description * Design, develop, and deploy end-to-end data pipelines on AWS using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, and related data platform technologies. * Build and maintain scalable data processing and transformation workflows using Databricks, Apache Spark, and SQL. * Develop and maintain Apache Airflow workflows for pipeline orchestration, scheduling, dependency management, monitoring, and automation. * Integrate and process commercial pharmaceutical data sources such as Xponent, Veeva, MMIT, Plantrak, Specialty Pharmacy, LAAD, and similar sources. * Build and optimize data pipelines supporting pharma KPIs, metrics, analytics, and reporting requirements. * Design and implement data pipelines for AI/ML and Generative AI workloads, including structured and unstructured data preparation. * Enable data pipelines supporting LLM-based applications, vector embeddings, and knowledge retrieval/RAG solutions. * Support migration of legacy data systems and pipelines to modern AWS cloud and lakehouse architectures. * Monitor, troubleshoot, and optimize data pipelines for performance, scalability, reliability, and cost-effectiveness. * Ensure data pipelines meet required standards for data quality, accuracy, consistency, and operational reliability. * Communicate effectively with technical and business stakeholders to understand requirements and translate pharmaceutical business needs into scalable data solutions., Description We are seeking a Senior Transmission Line Engineer who will work as a member of a dynamic team working in a fast paced environment, solving challenging problems invol… + 21 days ago ## Related Videos - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [Enjoying SQL data pipelines with dbt](https://www.wearedevelopers.com/videos/823-enjoying-sql-data-pipelines-with-dbt) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [AI Model Management Life Circles: ML Ops For Generative AI Models From Research to Deployment](https://www.wearedevelopers.com/videos/1152-ai-model-management-life-circles-ml-ops-for-generative-ai-models-from-research-to-deployment) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk) - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)