Lead Python Data Engineer

CYNET SYSTEMS INC.
Rahway, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior
Compensation
$ 156K

Job location

Rahway, United States of America

Tech stack

Airflow
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Authentication Protocols
CSS
Databases
Information Engineering
Data Security
Distributed Computing Environment
Identity and Access Management
JSON
Python
Node.js
OAuth
Open Data Protocol
Standard Sql
JSON Web Token
Security Assertion Markup Language (SAML)
Software Engineering
SQL Databases
TypeScript
XML
React
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Containerization
Information Technology
Front End Software Development
Functional Programming
REST
Terraform
Devsecops
GXP
Docker
Databricks
Microservices

Job description

  • Architect and design distributed data processing systems, schema design, and microservices.
  • Develop and maintain data pipelines and workflows using Databricks, DBT, and Apache Airflow.
  • Implement and manage AWS services to support data engineering tasks.
  • Design and integrate REST APIs for data access and manipulation.
  • Ensure compliance with GxP environments or software requiring compliance with FDA 21 CFR Part 11 regulations.

Requirements

  • 10+ years of hands-on professional software engineering and technical leadership experience.
  • Expert-level proficiency with Databricks, DBT and Apache Airflow.
  • Mastery of Python and solid database/SQL expertise.
  • Hands-on experience with core AWS services: EC2, S3, Lambda, and RDS, including IAM and secure VPC networking.
  • Strong proficiency in REST API design and integration patterns (JSON, XML, OData).
  • Bachelor s degree in Information Technology, Computer Science, or a related technology stream., * Experience or familiarity with frontend tech stacks (HTML/CSS, TypeScript, Node.js, or React).
  • Solid grasp of infrastructure-as-code (Terraform), containerization (Docker), and automated DevSecOps pipelines.
  • Practical knowledge of modern authentication protocols (OAuth, JWT, SAML).

Skills:

  • Python.
  • AWS DevOps.
  • Databricks.
  • DBT.
  • Apache Airflow.
  • REST API design.
  • SQL.

Qualification And Education:

  • Strong verbal and written communication skills.
  • Excellent communication and presentation skills.
  • Ability to communicate effectively with stakeholders.

Apply for this position