Lead Data Engineer

Roles and Responsibilities: Interact with Business to understand the requirement on a daily evolving need and adapt to the needs. Able to understand the business requirements, tech stack involved and guide the team towards Integral solution approach. Dedicated and committed approach, with good communication skills and participation in agile ceremonies. Experience with Object Oriented Programming including limitations. Familiarity with cross-platform development Able to handle all the database storage and retrieval mechanisms on Data Lake Platforms and extensive experience in handling. Extensive Unix/FTP/ File Handling Strong Hands-on experience with SQL databases

Must Have Technical Skills: A deep understanding and multi-process architecture and the threading limitations of Python. Pyspark Data engineering skills Experience using libraries like Pandas, NumPy and MatPlotLib. With experience working with file based systems(supporting csv/parquet/) Extensive knowledge in understanding Data and creating Data Pipelines Hands on experience designing and implementing APIs Hands on experience building microservices using FastAPI or related technologies. Experience writing unit testing and ensure code coverage. Experience with Agile Methodology/JIRA/Confluence Experience in version control using GitFlex

Flex Skills/Nice to Have: Added advantage if worked on Big Data, PySpark libraries.

Soft Skills: Excellent written and verbal communication skills Team player

Skills: Agile Programming Methodologies, Application Programming Interface (API), Atlassian JIRA, Big Data, Code Coverage, Communication Skills, Data Lake, Data Management, Data Recovery, Data Storage, Engineering, FTP (File Transfer Protocol), File Systems, Microservices, Multiplatform/Cross-Platform, Object Oriented Programming (OOP), Presentation/Verbal Skills, Python Programming/Scripting Language, SQL Databases, Source Code/Configuration Management (SCM), Team Player, Test Plan/Schedule, Unit Test, Unix Operating Systems, Writing Skills