Lead Azure Data Engineer/Architect

This is a full-time, remote position leading a team of Data Scientists and Azure Data Engineers in the design, development, and delivery of machine learning models, enterprise data pipelines, and analytics solutions on Microsoft Azure and Fabric.

• This full-time remote role is for a Lead Azure Data Engineer/Architect responsible for designing, building, and optimizing data solutions on Microsoft Azure.
• he Lead Azure Data Engineer/Architect will collaborate closely with stakeholders to gather requirements, translate them into technical designs, and ensure data quality, security, and governance standards are met.
• Day-to-day responsibilities include hands-on development, performance tuning, code reviews, and mentoring other data engineers., * Architect and build scalable pipelines using:
• Databricks
• Apache Airflow
• Fabric Data Factory
• Azure Date Engineering
• Microsoft Fabric (Lakehouse, OneLake, Semantic Models)
• Implement medallion architecture and modern data warehousing
• Ensure scalability, performance, and resilience
• Own full lifecycle: feature engineering * model design * training * validation * deployment * monitoring
• Drive model selection, tuning, and evaluation strategies
• Deliver predictive analytics tied to project and financial data, * Lead the design and implementation of comprehensive data architectures leveraging Azure Data Lake, Azure Data Factory, and other Azure cloud services to support enterprise analytics needs.
• Develop and optimize scalable ETL (Extract, Transform, Load) processes using tools such as Informatica, Spark, and custom scripting in Java, Python, or Bash.
• Architect and maintain large-scale data warehouses utilizing Microsoft SQL Server, and NoSQL databases
• Collaborate with cross-functional teams to define data modeling standards, ensuring efficient database design and integration of linked data sources.

Pay: $185,000.00 - $195,000.00 per year

Do you have experience in Unsupervised learning?, Do you have a Bachelor’s degree?, * 7+ years in Azure Data Engineering

• 3+ years of work experience with Azure Data Factory
• 1+ years of work or strong knowledge of Azure Service Fabric
• 4+ years of work experience with Azure Databricks
• 3+ years in technical leadership roles
• Bachelor’s degree required, Technical (Hands-On Leadership Required)
• Expert in Python, advanced T-SQL, strong Spark/PySpark
• Deep experience in:
• ML model architecture (required) - supervised, unsupervised, NLP, time-series
• ML deployment in production (required) - end-to-end lifecycle ownership
• Azure Data Factory (ADF) for ML pipelines (required)
• Data engineering - ETL/ELT, data warehousing, medallion architecture
• Advanced experience with:
• Azure ecosystem
• Databricks
• Microsoft Fabric
• Apache Airflow, * Lead Data engineer: 6 years (Required)
• Azure Data Lake: 3 years (Required)
• Python: 3 years (Required)

Pulled from the full job description

• 401(k)
• Health insurance
• Paid time off
• Vision insurance
• Dental insurance
• Life insurance, * 401(k)
• Dental insurance
• Health insurance
• Life insurance
• Paid time off
• Vision insurance