Manager, Data Engineering Architect
Role details
Job location
Tech stack
Job description
We encourage consideration of flexible ways of working, both formal and informal arrangements that allow for the best outcomes for our people and our clients. If this opportunity is of interest to you with some flexibility, please do discuss with us. Your role As a Data Engineering Architect in AI&D, you are responsible for designing and delivering robust, scalable, and secure Data Engineering architectures, frameworks and pipelines on Cloud projects. You are encouraged to devise innovative architectural solutions to help our clients address their biggest data challenges, including developing modern analytics platforms. In your role, you will have responsibility for architectural integrity, technical strategy, and client stakeholder engagement, delivering solutions for our clients using agile methodologies. You will often be working in multi-disciplinary teams across a range of industries, subject matters and locations. Our projects vary greatly and your responsibility as a Manager will differ based on the focus of the client engagement and your skillset, but could include and may require you to
- Lead architectural assessments of existing data platforms, define target state architectures, and develop strategic roadmaps leveraging Cloud IaaS and PaaS components.
- Define and evolve the architectural blueprint for robust data engineering pipelines, guiding their implementation to ensure scalability, performance, and strategic alignment.
- Work effectively in diverse teams within an inclusive team culture where people are recognised for their contribution.
- Define and guide the technical roadmap for data platforms, ensuring architectural alignment and robust delivery through advanced DevOps practices.
- Provide technical leadership, mentorship, and architectural guidance to diverse engineering teams (onshore and offshore), fostering a culture of technical excellence and innovation.
- Evaluate and champion the adoption of emerging open-source and proprietary data technologies, assessing their architectural fit, strategic value, and potential impact.
- Drive the architectural vision for our market-leading analytics and cognitive offerings, contribute to technical solutioning in proposals, and significantly shape the growth of our Strategy, Governance & Architecture community.
- Provide architectural oversight, technical and engineering governance for key client project workstreams, ensuring the delivery of high-quality, scalable, and commercially viable solutions.
- Contribute to client project delivery by owning one or more workstream(s) and ensuring commercially successful conclusion of the client engagements
Requirements
- Must have Python, Scala, C++ or Java development experience deploying workload to production
- Must have either one of the following:
o Cloud Developer Associate, or o Cloud Data Engineer Associate, or o Similar certification, with a strong preference for Architect-level certifications (e.g., Azure Solutions Architect Expert, AWS Certified Solutions Architect - Professional, Google Cloud Professional Cloud Architect).
- Ability to demonstrate advanced stakeholder management skills and collaborate effectively with multidisciplinary teams, including presenting complex architectural concepts to non-technical audiences.
- Ability to provide technical leadership, coaching, and mentorship to engineering teams, driving architectural best practices and fostering a culture of continuous improvement.
Candidates must have extensive experience in Cloud-based Data Platforms, demonstrating deep architectural understanding and hands-on delivery across some or all of the following areas:
- Provide subject matter expertise and hands-on delivery of data capture, curation, and consumption pipelines on cloud platforms using native and Hadoop-based services.
- Ability to conduct comprehensive technical and architectural assessments of existing platforms, define future-state architectures, and articulate the migration strategy.
- Ability to design and build enterprise-grade cloud data solutions, providing expert perspective on storage options (e.g., object storage, data lakes, data warehouses) and compute engine options (e.g., Spark, Databricks, Synapse Analytics, BigQuery).
- Implementing and optimising data lake and data warehouse solutions on cloud platforms using services such as object storage (e.g., S3, ADLS, GCS), cloud data warehouses (e.g., Snowflake, BigQuery, Synapse Analytics), streaming services (e.g., Kinesis, Event Hubs, Pub/Sub), and security services (e.g., KMS, KeyVault), with a focus on architectural governance.
- Developing logical and physical data models for NoSQL data stores such as CosmosDB, MongoDB, Cassandra, etc.
- Developing and orchestrating highly performant, scalable, and re-usable data ingestion and transformation pipelines across various cloud components and services such as Databricks, AWS Glue, Google Dataflow, Azure Data Factory, or similar.
- Developing event-based and streaming data ingestion and processing using cloud-native PaaS services or Apache Kafka.
- Data ingestion, data engineering, and/or data curation using native cloud services or tools available in cloud marketplaces.
- Developing data governance, data cataloguing, and data lineage solutions using tools such as Informatica Data Catalog, Talend Data Catalog, IBM Information Governance Catalog, or cloud-native equivalents.
- Developing RESTful and GraphQL APIs for inter-service and external data exchange.
- Have worked with and architected solutions on platforms from key cloud vendors such as Databricks, Snowflake, or similar.
- Have worked in agile delivery teams with DevOps ways of working to continuously deliver iterative deployments with experience in using Git, Jira, Confluence, or similar.
- Have had experience in data migration activities in the past, including migration strategy and approach, source and target system discovery, analysis, mapping, development, and reconciliation.
About the company
Deloitte drives progress. Our firms around the world help our clients become market leaders wherever they compete. Deloitte invests in outstanding people with diverse talents and backgrounds, empowering them to achieve more than they can elsewhere. Our work combines consulting with action and integrity. We believe that when our clients and society are stronger, so are we.