Senior Data Engineer

Our Client is Looking a talented Senior Data Engineer - Research & Data Platforms to support the development of enterprise-grade data products that enable data-driven innovation in research and development. This role plays a critical part in building scalable data pipelines and ensuring high-quality data availability across complex, multi-source environments., Data Engineering & Pipeline Development

• Design, develop, and maintain scalable, high-performance data pipelines
• Build robust data workflows to support enterprise data products and analytics use cases
• Ensure efficient data ingestion, transformation, and delivery across platforms

Data Integration & Management

• Integrate data from diverse internal and external sources while ensuring consistency and reliability
• Implement best practices for data governance, quality, and security
• Maintain structured and accessible data models aligned with business needs

Performance & Optimization

• Optimize data processing pipelines for scalability, performance, and cost efficiency
• Monitor pipeline health and resolve performance bottlenecks
• Ensure reliability and availability of data systems

Collaboration & Stakeholder Engagement

• Partner with data scientists, analysts, and business stakeholders to understand data requirements
• Support development of analytics, machine learning, and reporting solutions
• Work cross-functionally to drive data platform improvements

Documentation & Continuous Improvement

• Maintain comprehensive documentation for data pipelines, architectures, and workflows
• Stay updated with the latest data engineering tools, cloud technologies, and best practices
• Identify opportunities for automation, efficiency improvements, and innovation

Technical Expertise

• Strong experience in data engineering, pipeline development, and large-scale data processing
• Expertise in Databricks and modern data lakehouse architectures
• Proficiency in SQL and programming languages such as Python, Java, or Scala
• Hands-on experience with cloud platforms (AWS, Azure, or GCP)
• Experience with data warehousing solutions (e.g., Snowflake, Redshift, BigQuery)
• Familiarity with ETL tools and data integration frameworks

Analytics & Data Management

• Strong understanding of data modeling, governance, and quality frameworks
• Experience working with large-scale, multi-source datasets
• Exposure to analytics, reporting, or machine learning workflows

Collaboration & Communication

• Excellent problem-solving and analytical skills
• Strong communication and ability to work in cross-functional teams
• Ability to translate technical concepts into business-relevant insights, * Bachelor's or Master's degree in Computer Science, IT, or related field
• 5-7 years of experience in data engineering or related roles
• Strong experience with Databricks and SQL-based data systems

Preferred:

• Experience with data visualization tools (e.g., Tableau, Power BI)
• Understanding of machine learning concepts and data science workflows
• Experience in regulated industries (e.g., healthcare, pharmaceuticals)
• Familiarity with data privacy and compliance standards