Databricks Data Architect

We are looking for an experienced Databricks Data Architect to design and develop scalable data solutions for our client in Plano, Texas. The ideal candidate should have strong hands-on experience with Databricks, AWS, Python, Spark, and Scala, along with a solid understanding of modern data lake and data engineering architectures., * Design and implement scalable data architectures using Databricks and AWS.

• Develop and optimize data pipelines using PySpark, Python, and Scala.
• Build data processing solutions using Apache Spark and Databricks.
• Design data lake/lakehouse solutions and implement Bronze, Silver, and Gold data layers.
• Develop ETL/ELT pipelines for large volumes of structured and unstructured data.
• Perform data transformation, cleansing, validation, and integration from multiple data sources.
• Optimize Spark jobs and Databricks workloads for performance and scalability.
• Work with AWS services such as S3 for data storage and data processing.
• Implement data quality, security, governance, and access controls.
• Create technical design documents and architecture specifications.
• Work closely with data engineers, developers, business teams, and other stakeholders.
• Support migration of legacy data platforms and ETL processes to modern Databricks-based solutions.

• Strong experience with Databricks (DBX).
• Strong hands-on experience with AWS, especially AWS S3.
• Strong programming experience in Python.
• Strong experience with Apache Spark / PySpark.
• Experience with Scala and Spark applications.
• Good understanding of data lake/lakehouse architecture.
• Strong knowledge of ETL/ELT and data engineering concepts.
• Experience with large-scale data processing and performance tuning.
• Strong SQL and data modeling skills.
• Experience working with enterprise data platforms and cloud environments.

Preferred

• Databricks certification is a plus.
• Experience with Delta Lake and Medallion Architecture.
• Experience with data migration and modernization projects.
• Experience with data governance and data security.
• Experience in large enterprise environments.

Ideal Candidate: A senior-level Databricks/Data Engineering professional with strong architecture skills and hands-on expertise in DBX, AWS, Python, Spark, and Scala.