Technology Lead | Cloud Integration | Azure Data Factory (ADF)

Technical Leadership, Microsoft Windows Azure, Cloud Computing, Diversity Recruiting, Fortune 500 Customers, Finance, Call Centers, Customer Support/Service, Health Information Technology, Microsoft Windows Azure, Azure Data Factory Pipelines, data flows (mappingwrangling), triggers, integration runtimes, parameterization, error handling & retries. Azure Databricks Databricks Notebooks, JobsWorkflows, PySparkScala, Delta Lake, cluster configuration and optimization. SQL Expertlevel SQL (CTEs, window functions, query tuning), working with large datasets.

Nice to have skills Agile InfrastructureasCode exposure is a plus.

Detailed Job Description Experience 58 years in data engineering with at least 3 years on Azure.Azure Data Factory Pipelines, data flows mappingwrangling, triggers, integration runtimes, parameterization, error handling retries.Azure Databricks Databricks Notebooks, JobsWorkflows, PySparkScala, Delta Lake, cluster configuration and optimization.Programming Advanced Python or Scala at least one, strong coding standards, modularization, and unit testing e.g., pytest.SQL Expertlevel SQL CTEs, window functions, query tuning, working with large datasets.Data Storage Formats ADLS Gen2, Delta Lake, Parquet, partitioning, ZOrdering, OPTIMIZEVACUUM.Ops CICD Git, branching strategies, CICD for ADFDatabricks environment promotion InfrastructureasCode exposure is a plus.

Minimum years of experience 8-10 years

Certifications Needed :No

Top 3 responsibilities you would expect the Subcon to shoulder and execute Coding and Development UI testing Stakeholder management

Company Description: IMCS Group is one of the fastest growing MWBE (Minority Woman Owned Enterprise) staffing firms in the U.S. We focus on bringing a Diversity Recruitment approach to Fortune 500 companies within North America and EMEA region contingent labor programs. IMCS Group excels in providing top talent in IT, Healthcare, Engineering, Finance, Light Industrial, Contact Center, and Clerical. We have offices in the US, Canada, Mexico, and India in which we can provide support to our clients., EEOC Disclaimer: IMCS Group is an equal opportunity employer and makes employment decisions without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran status, disability status, age, or any other status protected by law. IMCS Group is committed to maintaining an inclusive workforce, where employees are hired, retained, compensated, and promoted based on their contributions to our Company.