Big Data Architect

Bright Vision Technologies
Cary, NC, United States
16 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Compensation
$100,000.0 - $150,000.0
Working hours
Regular working hours

Tech stack

Amazon Web Services Microsoft Azure Big Data BigQuery Cloud Computing Cyber Security Information Systems Data Architecture Information Engineering Data Infrastructure Disaster Recovery Open Source Technology
+16 more
Simple Data Format Data Streaming Google Cloud Snowflake Apache Spark Data Layers Data Lakes Information Technology Collibra Apache Flink Apache Kafka Data Management Stream Processing Data Pipelines Amazon Redshift Databricks

Job description

We are seeking a Big Data Architect to define and lead the architecture of our enterprise data platform, spanning ingestion, storage, processing, governance, and consumption layers. The role drives the strategic direction of data infrastructure, sets standards for data modeling and lifecycle management, and partners with data engineering, analytics, ML, and business stakeholders to deliver a coherent, scalable data foundation. The ideal candidate combines deep technical mastery of modern data platforms with strong architectural judgment, and has led data-platform programs of meaningful scope and complexity., * Define the target-state architecture of the enterprise data platform, including ingestion, storage, processing, and consumption layers.

  • Establish standards for data modeling, schema evolution, partitioning, file formats, and storage organization.
  • Architect lakehouse, warehouse, and streaming patterns leveraging technologies such as Snowflake, Databricks, BigQuery, Redshift, Iceberg, Delta Lake, or Hudi.
  • Design end-to-end data pipelines that balance latency, cost, reliability, and maintainability across batch and streaming workloads.
  • Lead the integration of governance, lineage, and catalog tools such as Collibra, Alation, Atlan, Unity Catalog, or DataHub.
  • Define security architecture including row- and column-level controls, masking, encryption, and identity-aware access patterns.
  • Partner with ML, BI, and product teams to ensure platform capabilities align with downstream consumption needs.
  • Establish data contract and data product principles to drive ownership, quality, and decoupling between producers and consumers.
  • Lead architecture reviews and provide guidance on pipeline and warehouse design proposals across teams.
  • Drive cost optimization and capacity planning across the data platform estate.
  • Design disaster recovery, multi-region, and high-availability strategies for critical data assets.
  • Mentor data engineers and architects on platform standards and emerging best practices.
  • Produce architecture artifacts including context diagrams, decision records, and reference patterns.
  • Stay current with data platform research, vendor offerings, and open-source ecosystem developments.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Information Systems, or a related field.
  • Eight or more years of experience in data engineering, with significant time in architecture roles.
  • Deep expertise across at least two major data platforms such as Snowflake, Databricks, BigQuery, or Redshift.
  • Strong understanding of lakehouse architectures, modern table formats, and streaming systems.
  • Hands-on experience with Spark, Flink, or Kafka at production scale.
  • Strong data modeling expertise across dimensional, normalized, and data-vault patterns.
  • Experience implementing governance, lineage, and catalog capabilities.
  • Solid grasp of cloud platforms, networking, identity, and cost optimization.
  • Excellent communication, facilitation, and stakeholder management skills.
  • Track record of leading large data platform initiatives across teams., * Experience with data mesh or data product architectures.
  • Familiarity with semantic layers such as dbt Semantic Layer, Cube, or LookML.
  • Exposure to regulated industries with strict data residency or audit requirements.
  • Cloud or platform certifications (Snowflake, Databricks, AWS, Azure, GCP).
  • Public talks or writing on data architecture.

About the company

Bright Vision Technologies is a technology consulting and software development company delivering cloud, AI, data, and enterprise solutions across the United States. This is a fantastic opportunity to join an established and well-respected organization offering tremendous career growth potential.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerjet.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou Ā· Coffee With Developers

3:28 min

Defining big data and machine learning fundamentals

Ayon Roy Ā· LIVE

3:27 min

Explaining query execution overhead and caching limitations in BigQuery

Adnan Rahic Ā· JS Congress

2:14 min

Solving complex platform architecture challenges at an enterprise scale

Maria Apazoglou Ā· Coffee With Developers

2:10 min

Why organizations combine big data and machine learning

Ayon Roy Ā· LIVE

2:30 min

Leveraging BigQuery ML for scalable SQL-based segmentation experiments

Julian Joseph Ā· LIVE

Videos

See all

Related articles

See all