Lead Python Data Engineer

• Architect and design distributed data processing systems, schema design, and microservices.
• Develop and maintain data pipelines and workflows using Databricks, DBT, and Apache Airflow.
• Implement and manage AWS services to support data engineering tasks.
• Design and integrate REST APIs for data access and manipulation.
• Ensure compliance with GxP environments or software requiring compliance with FDA 21 CFR Part 11 regulations.

• 10+ years of hands-on professional software engineering and technical leadership experience.
• Expert-level proficiency with Databricks, DBT and Apache Airflow.
• Mastery of Python and solid database/SQL expertise.
• Hands-on experience with core AWS services: EC2, S3, Lambda, and RDS, including IAM and secure VPC networking.
• Strong proficiency in REST API design and integration patterns (JSON, XML, OData).
• Bachelor s degree in Information Technology, Computer Science, or a related technology stream., * Experience or familiarity with frontend tech stacks (HTML/CSS, TypeScript, Node.js, or React).
• Solid grasp of infrastructure-as-code (Terraform), containerization (Docker), and automated DevSecOps pipelines.
• Practical knowledge of modern authentication protocols (OAuth, JWT, SAML).

Skills:

• Python.
• AWS DevOps.
• Databricks.
• DBT.
• Apache Airflow.
• REST API design.
• SQL.

Qualification And Education:

• Strong verbal and written communication skills.
• Excellent communication and presentation skills.
• Ability to communicate effectively with stakeholders.