Senior Architect, Data Engineering

WEST Inc
New York, NY, United States
2 months ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
5 years minimum
Compensation
$199,100.0 - $223,400.0
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Microsoft Azure Big Data Code Review Data Architecture Information Engineering Data Infrastructure Data Integrity Extract Transform Load (ETL) Data Structures
+25 more
Relational Databases Distributed Systems Microsoft SQL Server SQL Azure Performance Tuning Power BI Azure Data Lake Sqoop Data Streaming Tableau (Software) Unstructured Data Google Cloud Azure Data Factory Large Language Models Snowflake Prompt Engineering Apache Spark Generative AI Microsoft Fabric Apache Flume Data Management Machine Learning Operations Tools for Reporting Data Pipelines Databricks

Job description

  • Provide guidance and platform selection advice for Databricks, Snowflake, and/or Microsoft Fabric
  • Design data flow and processing pipelines for analysis using modern toolsets such as Spark on Scala, Storm, Flume, Sqoop
  • Design data structures for ingestion and reporting, specific to use case and technology
  • Provide data management expertise to our clients in evaluating requirements and developing data architecture and performing platform selection and design. Data management includes appropriate structuring, stewardship of data, semantics/syntax of data attributes, coding structures, and mapping schemes
  • Architect and implement scalable AI/ML and Generative AI solutions leveraging modern data platforms such as Databricks, Snowflake, and Microsoft Fabric
  • Design data architectures that enable AI/ML workloads through high-quality, governed, secure, and scalable data pipelines and lakehouse environments
  • Guide and coach consultants, share best practices, perform code reviews
  • Coordinate activities with data source application owners to ensure integration with analytics platform and source systems
  • Ensure that data integrity issues are addressed
  • Liaise and attend meetings necessary to perform duties and aid business and technical development
  • Partner with business development teams to identify client needs, propose tailored solutions, and build long-term relationships with key stakeholders to drive growth opportunities
  • Collaborate on crafting compelling proposals, presentations, and technical demonstrations that showcase innovative architecture solutions and align with client objectives to win new business.

Requirements

Do you have experience in Sales proposal development?, * 10+ years of professional experience and 5+ within consulting ecosystem

  • Very strong technical expertise in Databricks and/or Snowflake including modern lakehouse architecture, performance optimization, governance, orchestration, and enablement of AI/ML and Generative AI workloads
  • Experience with modern AI frameworks and services such as Azure OpenAI, OpenAI APIs, LangChain, Semantic Kernel, MLflow, Mosaic AI, or comparable technologies
  • Hands-on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation (RAG) architectures
  • Knowledge of standard methodologies, concepts, best practices, and procedures within a Big Data environment
  • Development of or architecture of modern distributed architectures using modern messaging patterns and tools
  • Strong data engineering experience with the following core competencies:
  • Experience with Databricks, Snowflake, and/or Fabric
  • Experience working with relational databases (Microsoft SQL Server) and working with large unstructured data sets
  • Strong experience with ETL procedures and ideation from scratch
  • Experience using cloud platforms such as AWS, Azure, GCP etc.
  • Experience with reporting tools such as PowerBI and Tableau
  • Working knowledge or experience working with Azure SQL, Azure Data Lake or Azure Data Factory.
  • Excellent organizational, verbal and written communication skills
  • A commitment to inclusion and diversity, and openness to new ideas and perspectives
  • Proven experience in supporting business development efforts, including identifying client needs, crafting technical solutions, contributing to proposals, and participating in pre-sales activities to drive revenue growth.
  • Travel to client sites as needed (30% to 50%)

About the company

West Monroe is seeking a Senior Architect to join our thriving Technology and Experience Practice. This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a variety of industries including Healthcare, Financial Services, Insurance, Consumer & Industrial Products, and Energy & Utilities., We’re a global business and technology consulting firm passionate about creating measurable value for our clients, delivering real-world solutions.

The combination of business and technology is not new, but how we bring them together is unique. We’re fluent in both. We know that technology alone is not the answer, but how we apply it is. We rely on data to constantly adapt and solve new challenges. Actions that work today with outcomes that generate value for years to come.

At West Monroe, we zero in on the heart of the opportunity, getting to results faster and preparing people for what’s next.

You’ll feel the difference in how we work. We show up personally. We’re right there in the room with you, co-creating through the challenges. With West Monroe, collaboration isn’t a lofty promise, but a daily action. We work together with you to turn vision into clear action with lasting impact.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy · LIVE

1:24 min

Moving the semantic layer upstream to avoid vendor lock-in

Piotr Menclewicz Piotr Menclewicz · Europe 2026 Virtual

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy · LIVE

2:48 min

Daily responsibilities and alignment practices for technical engineering leadership

Edoardo Dusi · LIVE

3:48 min

Standardizing data access schemas with OData

Florian Bader Florian Bader · WWC Europe 2026

Videos

See all

Related articles

See all