> Markdown version of [/jobs/ext/2051554-fabric-principal-data-engineer-solution-architect](https://www.wearedevelopers.com/jobs/ext/2051554-fabric-principal-data-engineer-solution-architect). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Fabric Principal Data Engineer / Solution Architect - **Company:** CAPITAL VIEW IV ASSOCIATION, INC. - **Location:** New York, NY, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Amazon Web Services, Microsoft Azure, System Configuration, Data Architecture, Information Engineering, Data Infrastructure, Data Systems, Data Warehousing, Digital Assets, Identity and Access Management, Python (Programming Language), Machine Learning, Microsoft SQL Server, Performance Tuning, Cloud Services, Tensorflow, Azure Data Lake, SQL Stored Procedures, SQL Databases, Systems Integration, Data Processing, Azure Data Factory, Pytorch, Indexer, Microsoft Fabric, Pyspark, Kubernetes, Data Management, Machine Learning Operations, Cloud Integration, Data Pipelines, Databricks - **Published:** August 14, 2026 - **Apply:** https://www.careerjet.com/jobad/us2ec046aba6abf3560c367094cd330c0b ## About the Role * 8+ years of hands-on data engineering, data architecture, or complex data platform development experience. * Strong, practical experience building, supporting, and troubleshooting data pipelines in Microsoft Fabric and Azure Data Factory (ADF). * Advanced proficiency in Microsoft SQL (query development, stored procedures, schema design, indexing, performance tuning) and Python / PySpark in Fabric. * Hands-on experience managing and supporting Databricks Unity Catalog (catalog/schema/table organization, access controls, permissions, and governance administration). * Deep familiarity with Azure Data Lake Storage Gen2 (ADLS Gen2), including data organization, security, and cloud service integrations. * Architecture & Migration Experience: * Proven experience supporting or leading platform migrations, modernizations, or transitions (specifically Azure-to-Microsoft Fabric). * Familiarity with medallion architecture, lakehouse patterns, and modern data warehouse design. * Experience with Azure administration activities supporting data platforms (access management, service configuration, and monitoring). * Industry & Domain Experience: * Required: Prior hands-on experience working with Life Sciences, pharmaceutical, biotechnology, medical device, clinical, or regulatory data environments. * Knowledge of appropriate data handling, quality, compliance awareness, and business context in regulated settings. * Logistics & Operating Style: * Based in Boston, MA or willing/able to travel to Boston, MA for client engagements and alignment meetings. * Full working time overlap with US East Coast business hours (ET). * Demonstrated ability to operate effectively in a startup-speed environment with shifting priorities, tight timelines, and minimal ramp-up time. * Certifications Preferred ## Description This is a full-time position for a Principal Data Engineer / Solution Architect specializing in Microsoft Fabric and Azure data architectures to support a fast-moving project for a key client in the Life Sciences / Biotech industry. In this role, you will serve as a senior technical resource responsible for supporting, enhancing, and executing data engineering solutions across Microsoft Fabric, Fabric Data Factory, Microsoft SQL, ADLS Gen2, Databricks Unity Catalog, PySpark in Fabric, and related Azure ecosystem services. The project operates at high velocity, requiring someone who can ramp up quickly, navigate technical ambiguity, and keep active delivery moving seamlessly. You will help stabilize, troubleshoot, and advance an active migration from traditional Azure infrastructure to Microsoft Fabric. Location & Logistics: Candidates must be based in Boston, MA or fully capable of traveling to Boston as required by project milestones, maintaining 100% working time overlap with US East Coast business hours. Qualification / Skill Set Requirement: * Core Technical Expertise, * Fabric & Pipeline Engineering: Design, build, enhance, and support scalable data pipelines and integrations using Microsoft Fabric Data Factory, PySpark in Fabric, and Azure Data Factory. * Migration Support & Stabilization: Drive active migration efforts to Microsoft Fabric, including pipeline transition, validation, performance tuning, and operational stabilization. * Databricks Governance: Manage and organize Databricks Unity Catalog structures, permissions, and access control policies. * Data Asset Management: Develop and optimize Microsoft SQL data assets, complex stored procedures, queries, and ADLS Gen2 storage layers. * Troubleshooting & Quality Assurance: Quickly diagnose and resolve issues across data pipelines, SQL queries, Fabric PySpark notebooks, Unity Catalog, and cloud integration layers. * Technical Leadership & Knowledge Transfer: Assist with knowledge transfer from outgoing project resources, document technical designs and operational workflows, and mentor delivery team members. * Stakeholder Collaboration: Partner closely with technical, project, and business stakeholders to translate complex requirements into reliable, compliant data solutions during US Eastern business hours., Lead Machine Learning Engineer (MLOps, KServe + building Kubernetes Clusters, PyTorch, TensorFlow on AWS) As a Capital One Machine Learning Engineer (MLE), you'll be part of an Agi… + 1 day ago ## Related Videos - [Data Analytics with Microsoft Fabric: End-to-End Use Case with Data Agents](https://www.wearedevelopers.com/videos/1547-data-analytics-with-microsoft-fabric-end-to-end-use-case-with-data-agents) - [Optimizing Discovery: PostgreSQL's Role in Transforming GetYourGuide's Search](https://www.wearedevelopers.com/videos/1647-optimizing-discovery-postgresql-s-role-in-transforming-getyourguide-s-search) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Photonic Computing: Programming a New Class of AI Accelerators (incl. Live Coding)](https://www.wearedevelopers.com/videos/100196-photonic-computing-programming-a-new-class-of-ai-accelerators-incl-live-coding) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [From Prototype to Production: Build AI Agents with This Free 4-Course Learning Path](https://www.wearedevelopers.com/magazine/655-from-prototype-to-production-build-ai-agents-with-this-free-4-course-learning-path) - [Best US AI Conferences for CTOs in 2026: Build vs. Buy, Vendor Evaluation, and Peer Intelligence](https://www.wearedevelopers.com/magazine/736-best-us-ai-conferences-for-ctos-in-2026-build-vs-buy-vendor-evaluation-and-peer-intelligence)