Director: Lead Data Engineer

Section / Function:Insert Section/FunctionTravel Required:NoSMCR Status:N/AEffective from:Dual Hat Department:Non-employing entity Dual Hat DepartmentDual Hat Reports to:Non-employing entity Manager’s Job Rank/Corporate title and functionaltitleDual Hat SMCR:Client Dealing Function, Material Risk Takers, Manager of Certified Employees, Significant Management Function, CASS Oversight function, Algorithmic trading or N/AProfile SummaryWe are seeking a highly skilled and experienced Lead Data Engineer to join our talented team. The ideal candidate will have a strong background in data engineering, with experience in AI and a proven track record of designing and implementing robust data pipelines.ResponsibilitiesLead the design, development, and maintenance of scalable and efficient data pipelines to support our data-driven applicationsCollaborate with cross-functional teams, including data scientists, software engineers, and product managers, to understand data requirements and deliver high-quality solutionsArchitect and implement data ingestion, transformation, and storage processes using tools such as Apache Spark, Azure Data Factory, and other similar technologiesOptimize data pipeline performance, ensuring data accuracy, reliability, and timely deliveryMentor and guide junior data engineers, fostering a culture of continuous learning and improvementStay up-to-date with the latest trends and best practices in data engineering and AI, and apply them to our projectsParticipate in the evaluation and selection of new technologies and tools to enhance our data engineering capabilitiesContribute to the development of AI-powered features and products, leveraging your knowledge of machine learning and data science conceptsRequired QualificationsBachelor’s or Master’s degree in Computer Science, Engineering, or a related field7+ years of experience in data engineering, with at least 3 years in a leadership roleStrong proficiency in Apache Spark, Azure Data Factory, and other data pipeline toolsExperience with cloud platforms such as Azure, AWS, or GCPSolid understanding of data modeling, data warehousing, and ETL/ELT processesFamiliarity with AI and machine learning concepts, with hands\u2011on experience in implementing AI-driven solutionsExcellent problem-solving skills and the ability to design and optimize data architecturesStrong programming skills in languages such as Python, Scala, or JavaExperience with data quality, data governance, and data security best practicesExcellent communication and collaboration skills, with the ability to work effectively in a team environmentAbility to thrive in a fast-paced, dynamic environment and manage multiple prioritiesPreferred QualificationsAdvanced degree in Computer Science, Data Science, or a related fieldCertifications in relevant technologies, such as Azure Data Engineer or Databricks Certified DeveloperExperience with real-time data processing and streaming technologies like Apache Kafka or Azure Event HubsKnowledge of data visualization tools, such as Power BI or TableauContributions to open-source projects or active participation in the data engineering community #J-18808-Ljbffr