Senior Data Engineer

Concertai LLC
Plymouth Meeting, PA, United States
3 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Working hours
Regular working hours
Job source

Tech stack

Artificial Intelligence Airflow Amazon Web Services Big Data Code Review Data Validation Information Engineering Data Governance Extract Transform Load (ETL) Data Warehousing Dimensional Modeling Amazon DynamoDB
+16 more
Apache Hadoop Python (Programming Language) PostgreSQL Microsoft SQL Server NoSQL Software Engineering SQL Databases Privacy Controls Snowflake Data Lakes Pyspark Information Technology Data Management Data Pipelines Amazon Redshift Databricks

Job description

We are seeking a motivated Senior Data Engineer to work within our Commercials Solution team. In this role, you will be responsible for ensuring that all projects meet the technical & business requirements and accelerate towards on-time completion. You will work closely with technical teams and cross-functional teams, including product development, design, and operations in US and India.

As a Senior Data Engineer, your role will be primarily hands-on data technical implementations with blend of technical mentorship. You will play a crucial role in developing data pipelines and delivering quality data engineering implementations per business requirements.

Responsibilities

  • Demonstrate deep technical understanding of product design/ Architecture with hands-on development capability
  • Initiate/Incubate/execute PoCs to validate the use cases targeting enhanced ETL/DWH engineering solutions.
  • Design, build, and maintain reliable and scalable data pipelines and architecture, including data warehouses and data lakes.
  • Implement data quality checks, validation, and security protocols.
  • Initiate and drive cost optimization programs leverage design & Infra enhancements.
  • Implement best practices for data engineering, ETL, and DWH development in AWS cloud environment
  • Conduct code reviews; Coach team members on coding practices and drive adherence to coding standards.
  • Collaborate with cross-functional teams to finalize project requirements, timelines, and deliverables.
  • Monitor project progress, identify risks, and ensure on-time delivery of data engineering projects.
  • Optimize data models for performance and scalability; leverage latest AWS services to supplement scalable and configurable DWH architectures
  • Ensure project implementations/ solutions in compliant to security and privacy standards per HIPAA guidelines.
  • Stay abreast with the latest trends in data engineering and AWS technologies; Continuously evaluate tools and services to improve data engineering outcomes.
  • Proactively identify & resolve issues relating to people, product, tech, and processes.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Software Engineering, or a related field.
  • 5-7+ yrs. experience in data engineering roles.
  • 5+ years of experience in DWH/ETL Domain using cloud MPP data platforms such as Databricks, Redshift, Delta Lake, Snowflake, Hadoop.
  • Proficiency in PySpark/Python/SQL and designing data models and data standards.
  • Deep understanding of ETL/ELT processes, data warehousing concepts, and big data technologies.
  • Experience building & managing data pipelines using tools like Glue, Airflow, AWS Step Functions, or similar.
  • Experience in RDMS & No-SQL databases: SQL Server databases, PostgreSQL, DynamoDB, or Aurora.
  • Experience in dimensional modeling & schema design; Star and Snowflake model
  • Proven ability to lead & mentor data engineers towards innovative and disciplined environment.
  • Strong problem-solving skills, with a process/methodical approach to resolve technical challenges and risks
  • Excellent analytical, verbal and communication skills for stakeholder and team management.
  • Experience with healthcare data is a big plus.
  • Experience writing Claude code and agentic pipelines is a plus

About the company

ConcertAI is building the future of precision medicine. We use advanced artificial intelligence and real-world data to transform how healthcare and life sciences generate evidence, make decisions, and improve patient outcomes-starting in oncology and rapidly expanding across therapeutic areas. Our teams partner with the world’s leading pharmaceutical companies, providers, and research organizations to solve some of healthcare’s most complex challenges.

At the core of our innovation is CaraAI, our next-generation AI platform that unlocks powerful insights from complex clinical, imaging, and molecular data. Combined with our Precision Suite-which unifies real-world data, advanced analytics, and scalable evidence generation-these solutions are transforming how clinical development, regulatory, and commercialization decisions are made.

ConcertAI brings together a portfolio of purpose-built solutions, including TeraRecon, an industry leader in advanced imaging and AI-driven visualization, and CancerLinQ, the ASCO-originated oncology platform advancing care quality and large-scale discovery.

Joining ConcertAI means working alongside bold thinkers, builders, and healthcare experts on innovative, high-impact products that directly improve patient lives. You’ll be part of a fast-growing, mission-driven organization at the forefront of AI-enabled healthcare, with meaningful opportunities for growth and leadership., Our team at ConcertAI is dedicated to transforming healthcare decision-making through the application of RWE and AI to improve patient outcomes. We work in a fast-paced, dynamic, high-performing culture where diversity, collaboration, and innovation are valued. Join us on our quest to create a world free of disease. Learn more about ConcertAI at www.concertai.com , or follow us on LinkedIn. Serving 1,300 clinical sites globally, TeraRecon - a ConcertAI company - is a Best in KLAS solution provider for AI-empowered radiology, oncology, cardiology, neurology, and vascular surgery. In the future, the combination with ConcertAI could bring a single, advanced AI-augmented diagnosis and interpretation capability from clinical trials to patient care. Learn more about TeraRecon at www.terarecon.com , or follow us on LinkedIn.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

2:15 min

Empowering domain teams with an open data platform

Sandhya Menon Sandhya Menon · World Congress 2026 Europe

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

4:32 min

Harnessing Spark with Python using PySpark and Py4J

Ayon Roy · LIVE

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

3:37 min

Scaling machine learning pipelines from prototypes to petabytes

Julian Joseph · LIVE

3:05 min

Audience questions on AI agents and pipeline vectorization

Joy Joy · World Congress 2024

Videos

See all

Related articles

See all