> Markdown version of [/jobs/ext/1251036-lead-bi-engineer](https://www.wearedevelopers.com/jobs/ext/1251036-lead-bi-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Lead BI Engineer

- **Company:** CRG
- **Location:** United States (Remote available)
- **Experience:** Expert
- **Contract:** Permanent contract
- **Skills:** Amazon Web Services, Microsoft Azure, Big Data, Continuous Integration, Data Architecture, Information Engineering, Data Governance, Data Security, Distributed Data Store, Python (Programming Language), Machine Learning, Performance Tuning, Cloud Services, DataOps, Azure Machine Learning, SQL Databases, Data Streaming, Azure Service Bus, Apache Spark, Data Strategy, Data Lakes, Apache Kafka, Machine Learning Operations, Tools for Reporting, Data Pipelines
- **Published:** July 12, 2026
- **Apply:** https://www.indeed.com/viewjob?jk=3bf77df3bbab7de8

## About the Role

* 7+ years of experience in advanced data engineering with distributed compute technologies.
 * Expert-level Spark engineering (performance tuning, cluster configuration, partition strategies, optimization of large datasets).
 * Hands-on experience with Lakehouse architectures including ACID transactions, schema evolution, and governance frameworks.
 * Deep proficiency in Python and SQL for large-scale data transformation.
 * Experience supporting machine-learning pipelines or model operationalization.
 * Proven experience architecting cloud-native data platforms (Azure, AWS, or GCP).
 * Strong background integrating diverse, complex data sources at enterprise scale.
 * Demonstrated ability to own mission-critical production systems.
 * Experience with distributed streaming frameworks (Kafka, Event Hubs, or similar).
 * Experience building or supporting ML platforms, feature stores, or experiment-tracking systems.
 * Background in data security, compliance controls, or audit-ready governance.
 * Experience automating data operations with CI/CD and infrastructure-as-code.

## Description

At CRG, we are seeking an experienced Lead BI Engineer to lead the design, development, and optimization of scalable Business Intelligence solutions. This role is responsible for driving data strategy, building robust data models and reporting platforms, and mentoring BI engineers while partnering with cross-functional stakeholders to deliver actionable insights that support business decision-making., * Architect, build, and optimize distributed data pipelines using Apache Spark in a high-volume, mission-critical environment.

 * Design and maintain enterprise Lakehouse architecture with Delta Lake, ensuring ACID compliance, lineage, auditability, and data governance.
 * Develop automated ingestion frameworks (batch, streaming, and event-driven) across multiple cloud services and integration points.
 * Enable machine-learning workflows by preparing feature-ready datasets and establishing reproducible ML deployment patterns.
 * Lead platform-wide data quality, access control, and cataloging frameworks.
 * Implement advanced cost-optimization, cluster tuning, and performance engineering strategies.
 * Collaborate with Finance, BI, Operations, and ML teams to translate complex business needs into scalable data solutions.
 * Own production reliability, troubleshooting, and root-cause analysis for data and ML pipelines.


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning)
- [OLTP in the Lakehouse: Redefining Data for AI Workloads](https://www.wearedevelopers.com/videos/2038-oltp-in-the-lakehouse-redefining-data-for-ai-workloads)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Data Governance in the Era of AI](https://www.wearedevelopers.com/videos/1622-data-governance-in-the-era-of-ai)
- [The Data Mesh as the end of the Datalake as we know it](https://www.wearedevelopers.com/videos/156-the-data-mesh-as-the-end-of-the-datalake-as-we-know-it)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk)
- [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [Graph and AI Trends 2026: Why Is AI Running but Not Yet Delivering?](https://www.wearedevelopers.com/magazine/680-graph-and-ai-trends-2026-why-is-ai-running-but-not-yet-delivering)