Data Intelligence Platform Lead
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+15 more
Job description
The successful candidate will coordinate the modernization of the current on-premises data environment while leading the design and implementation of a governed cloud data platform on Databricks and AWS. This is a strategic role for a professional who can connect architecture, governance, delivery execution, data quality, security, and AI adoption into a coherent enterprise data capability., * Coordinate the structuring of the Databricks environment on AWS, including development pipelines, operational controls, governance parameters, data quality monitoring, alerting, and platform observability.
- Define and align target-state solutions for ingestion, orchestration, processing, monitoring, security, and lifecycle management in the Databricks ecosystem.
- Lead the migration of on-premises data pipelines to Databricks, ensuring they are rebuilt as reusable, scalable, governed, and well-documented data products.
- Partner with technology, security, infrastructure, compliance, and business stakeholders to ensure the cloud platform meets banking-grade operational, regulatory, and information security expectations.
Data Products, Governance, and Quality
- Coordinate the definition, documentation, and dissemination of the data product concept across the Data team and the broader bank.
- Establish the required governance, ownership, metadata, lineage, access, quality, monitoring, and lifecycle dimensions for data products.
- Review and strengthen governance practices in the current data warehouse environment, including data access workflows, pipeline development standards, orchestration processes, and data domain definitions.
- Define and document data quality dimensions, implement automated quality tests, and build end-to-end monitoring and alerting for critical data flows.
On-Premises Platform Modernization
- Coordinate DataSecOps practices to establish end-to-end monitoring and alerting across infrastructure, development environments, orchestration layers, and data pipelines.
- Lead the inventory, technical assessment, rationalization, and recommendation process for SQL Server environments, including whether to migrate, retain, consolidate, modernize, or decommission each server.
- Drive improvements in operational reliability, documentation, development standards, and production support for the current SQL Server, Airflow, and dbt environment.
AI Enablement and Governance
- Coordinate the establishment of AI governance practices, including principles, controls, accountability, observability, and risk management considerations.
- Identify, prioritize, and coordinate AI initiatives that generate measurable business value on top of both the current on-premises environment and the future cloud data platform.
- Support experimentation and delivery of AI-based use cases in collaboration with business, data, technology, compliance, and risk stakeholders.
Requirements
- 15+ years of experience in IT.
- Strong experience leading data platform, data engineering, analytics engineering, or data architecture initiatives in complex enterprise environments.
- Practical understanding of Databricks, AWS data services, SQL Server, Airflow, dbt, data ingestion patterns, orchestration, monitoring, and platform operations.
- Demonstrated ability to translate data governance, data quality, metadata, lineage, access control, and observability requirements into practical engineering standards.
- Experience coordinating platform migrations or modernization initiatives from legacy or on-premises environments to cloud-based architectures.
- Experience with Databricks Lakehouse architecture, Unity Catalog, data quality frameworks, CI/CD pipelines, and cloud-native monitoring practices.
- Experience with AWS services commonly used in data platforms, such as S3, IAM, networking, security controls, monitoring, and infrastructure automation.
- Familiarity with regulatory, security, and audit expectations in banking or financial services.
- Highly desirable fluency in Portuguese and/or Spanish.
About the company
ITTConnect is seeking a Data Intelligence Platform Lead for a direct-hire full time position with a client that is a large financial institution.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
Stephan Gillich - Bringing AI Everywhere
Navigating the AI Shift
Making Data Warehouses Fast: A Developer’s Story
Top Big Data Technologies That You Need to Know