Associate, Data Engineer (multiple positions)

Duties: Architect and design Azure-based cloud data platforms and solutions. Assess business requirements and translate them into scalable, secure Azure technical architectures. Design, develop, and deploy cloud data solutions supporting risk, regulatory, finance, and compliance initiatives. Build and maintain large-scale batch and real-time data pipelines using Azure services such as Azure Data Factory, Databricks, Azure Functions, Azure Data Lake Gen2, and Azure SQL. Develop, test, and optimize software to enhance the performance, scalability, and efficiency of data platforms and applications. Configure and manage Databricks clusters and Unity Catalog environments. Automate cloud infrastructure provisioning and CI/CD pipelines using tools such as Azure DevOps, Git, and Jenkins. Lead and support enterprise-wide system integration using Azure API Management, RESTful microservices, and gateway technologies. Contribute to API and gateway strategy, and design distributed, containerized system architectures. Review core code changes and support production deployments. Integrate data from multiple sources while enforcing data quality, governance, and accessibility standards. Collaborate with architects, engineers, analysts, and business stakeholders to deliver enterprise-grade, data-driven platforms. Provide technical leadership and guidance on architecture decisions and technology implementations. Partner with business teams and product managers to convert functional requirements into detailed technical designs. Engage with IT architects, DBAs, and cybersecurity teams to ensure backend functionality, security, and regulatory compliance. Coordinate with cross-functional technology teams to ensure seamless application and system integration. Provide mentorship and indirect leadership to junior team members. Participate in regular development and planning meetings to align priorities, assign work, and share best practices. Develop, support, and troubleshoot complex interface processes, driving issues through to resolution. Provide production support for deployed interface processes, including participation in weekend maintenance windows as needed. Coordinate with infrastructure, scheduling, Azure DevOps, and support teams to deploy changes and resolve operational issues.

Bachelor’s degree in applied computer science, information systems or a related field, Requirements: Bachelor’s degree in applied computer science, information systems or a related field, plus 7 years of progressively responsible experience. Experience must include the following: Azure cloud technologies including Azure Data Factory, Azure Data Lake Storage Gen2, Azure Databases, Azure Functions, API Management, and Databricks Unity Catalog; advanced programming skills in Python, Java, and SQL; experience in ETL/ELT processes, distributed systems design, real-time and batch data pipelines, microservices architecture, RESTful web services, containerization, Web APIs and gateway management, streaming data design patterns, and data integration and quality standards; experience with DevOps and collaboration tools such as Jenkins, Git, Jira, and Confluence. The required skills do not need to be maintained over the full term of required experience.