Databricks Architect - R01573990

Brillio
San Francisco, CA, United States
1 day ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours

Tech stack

Java (Programming Language) Amazon Web Services Amazon S3 Microsoft Azure Cloud Computing Databases Continuous Integration Data Architecture Information Engineering Data Governance Data Infrastructure Extract Transform Load (ETL)
+27 more
Data Transformation Data Systems Data Warehousing Software Design Patterns Digital Architecture Digital Assets Distributed Data Store Python (Programming Language) Microsoft Software Performance Tuning Query Optimization Cloud Services Azure Data Lake SQL Stored Procedures PL-SQL SQL Databases Data Streaming Technical Data Management Systems Transact-SQL Scripting Data Ingestion Data Lakes Information Technology Data Analytics Google Bigquery Data Pipelines Databricks

Job description

  • ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures, 1. Design and architect scalable, high-performance data solutions utilizing Databricks and leading cloud data platforms 2. Develop, optimize, and maintain ETL pipelines with SQL, Python, and Databricks to ensure efficient data ingestion, transformation, and loading 3. Implement robust data models and data warehousing solutions to drive analytics, reporting, and business intelligence outcomes 4. Automate and streamline data workflows to enhance system efficiency and minimize processing times 5. Monitor, troubleshoot, and resolve performance bottlenecks in data pipelines and platform components 6. Ensure data quality, consistency, and security across all data assets and platforms 7. Collaborate with cross-functional teams to translate business requirements into technical data architecture solutions 8. Document architecture designs, data flows, and best practices to support operational excellence and knowledge sharing

Requirements

Database Extract Transform and Load (ETL), SQL (Structured Query Language), Data Warehousing, Stored Procedures, Microsoft Transact-SQL (T-SQL), Data Modeling, Oracle PL-SQL, Python Programming/Scripting Language, Cloud Computing, Business Intelligence, * Experience Range: With at least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms, 1. Advanced proficiency with Databricks platform and ecosystem

  1. Expertise in designing and developing ETL pipelines using SQL and Python
  2. Expert-level SQL, including advanced query optimization
  3. Proficiency in Python for data engineering and automation
  4. Comprehensive knowledge of data warehousing concepts and design patterns
  5. Experience with data modeling techniques and best practices
  6. Hands-on experience with PLSQL and T-SQL
  7. Ability to develop and maintain stored procedures for data transformation
  8. Experience with performance tuning and troubleshooting in distributed data environments Preferred Skills:

  9. Experience with Azure Data Lake, AWS S3, or Google BigQuery
  10. Familiarity with Delta Lake and lakehouse architecture concepts
  11. Knowledge of CI/CD practices for data engineering pipelines
  12. Working experience with Scala or Java in data engineering contexts
  13. Exposure to data governance, cataloging, and lineage tools Desired Qualifications:

  14. Bachelor’s degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline
  15. Databricks Certified Data Engineer Associate or Professional certification
  16. Certification in cloud data platforms such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…