Data Platform Architect (DataBricks)

Codeforce 360
Jersey City, United States
about 1 month ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) Amazon Web Services Business Analytics Applications Microsoft Azure Big Data Cloud Computing Information Engineering Data Governance Data Infrastructure Data Migration Data Security Data Warehousing
+20 more
Distributed Systems Apache Hadoop Python (Programming Language) Enterprise Messaging Systems Object-Oriented Software Development Oracle (Applications) Performance Tuning Software Engineering SQL Databases Teradata SQL Enterprise Data Management Google Cloud Data Storage Technologies Snowflake Apache Spark Apache Kafka Vertica Stream Analytics Serverless Computing Databricks

Job description

  • Define the target-state architecture for enterprise data platforms and cloud-native analytics solutions.
  • Lead the migration of large-scale data environments from on-premises platforms to a cloud environment.
  • Design scalable, resilient, and secure data architectures capable of supporting petabyte-scale workloads.
  • Establish architectural standards, governance frameworks, and engineering best practices.
  • Partner with infrastructure, security, and application teams to ensure alignment with enterprise cloud strategies.
  • Evaluate and recommend technologies for data storage, processing, streaming, governance, and observability.
  • Provide technical leadership and mentorship to engineering teams implementing Spark, Kafka, Databricks, and cloud-native services.
  • Drive performance optimization, cost management, and operational excellence across the data platform.
  • Support executive stakeholders with migration roadmaps, risk assessments, and modernization strategies.

Requirements

About the Job- We are looking for an experienced D365 Sr Finance Consultant to join one of our enterprise client engagements. The ideal candidate should have strong expertise in Spark, Kafka, AWS, Azure, or Google Cloud Platform along with experience working in fast-paced enterprise environments., * Large-scale data migration and modernization experience - greenfield large data platform implementation preferred

  • Expertise in Medallion Architectures
  • Big data movement and transport
  • Data warehousing fundamentals - schema design (star/snowflake), fact and dimensions, SCDs
  • Spark
  • Kafka
  • AWS, Azure, or Google Cloud Platform
  • Java/Python programming background, * 10+ years of experience in data platform architecture, data engineering, or distributed systems.
  • Demonstrated experience leading enterprise-scale cloud migration initiatives involving hundreds of terabytes or petabytes of data.
  • Experience migrating data from platforms such as Vertica, Hadoop, Teradata, Oracle, Snowflake, or similar technologies.
  • Experience designing highly available, scalable distributed systems.

Technical Skills:

  • Strong experience with Databricks, Apache Spark, Apache Kafka, AWS cloud services, and large-scale data warehouse or lakehouse platforms.
  • Experience with AMPS, MQ, Hadoop, or other enterprise messaging systems.
  • Strong software engineering background with expertise in Java, Python, SQL, and other object-oriented programming languages.
  • Strong understanding of data governance, security, compliance, and operational monitoring.

Preferred Qualifications

  • Databricks certification(s)
  • AWS Solutions Architect certification(s)
  • Experience implementing lakehouse architectures.
  • Experience designing streaming and real-time analytics platforms.
  • Experience within highly regulated financial services or enterprise environments.
  • Master’s Degree

About the company

CodeForce 360 is a trusted global IT talent partner helping Fortune 500 companies, system integrators, and enterprise organizations build high-performing technology teams. With over 16 years of industry expertise, we combine speed, precision, and market intelligence to deliver exceptional talent across today’s most in-demand technologies.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…