Data Engineering

• Build data pipelines / data orchestrator and data structures for existing operational data stores, Azure data lake & data warehouse.
• Develop proof-of-concepts to evaluate new technologies and suggest improved and better ways to re-architect existing data loading processes and data structures.
• Design and develop ELT / ETL to load data from internal sources into operational data stores, Azure data lake and data warehouse.
• Create APIs, data structures and schemas to store and retrieve data.
• Create and maintain data mappings, data definitions, architecture, and data flow diagrams.
• Implement solutions to validate and test data quality.
• Build proof-of-concepts to determine viability of new processes and technologies.
• Deploy and manage code in non-prod and prod environments.
• Troubleshoot data related issues and fix defects.
• Optimize and performance tune databases and queries.
• Participate in code reviews and train other team members.
• Document code and create code templates based on industry best practices.

Note: Need them to have a Data Bricks Certificate that is current. They have to have at least 3 to 5 years IT experience and knowledge of Python, Azure, Airflow and Databricks and Data Warehousing. Paying $130K and there is no bonus. Right now it is hybrid, with maybe one day a week in the office., * Bachelor's Degree and/or equivalent experience required.

• Minimum 5 years of experience working as a Data Engineer, ETL Engineer, Data/ETL Architect or similar roles.
• 3 -5 years of solid experience with Databricks, Python, Airflow, Azure, and Data Warehousing.
• Data Bricks Certificate that is current is a must.

#Recruitps, Over 20 years' of recruiting experience with hands-on recruiting and placement of I.T. professionals (Full Time, Temp 2 Perm, & Contingent) in the NJ/NY/CT/PA marketplace for a wide variety of today's demanding IT skill sets. Focused on delivering exceptional service by understanding client's objectives and goals.