Databricks Architect - R01573990
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+27 more
Job description
- ETL Fundamentals, SQL, SQL (Basic + Advanced), Python, Data Warehousing, Modern Data Platform Fundamentals, Data Modelling Fundamentals, PLSQL, T-SQL, Stored Procedures, 1. Design and architect scalable, high-performance data solutions utilizing Databricks and leading cloud data platforms 2. Develop, optimize, and maintain ETL pipelines with SQL, Python, and Databricks to ensure efficient data ingestion, transformation, and loading 3. Implement robust data models and data warehousing solutions to drive analytics, reporting, and business intelligence outcomes 4. Automate and streamline data workflows to enhance system efficiency and minimize processing times 5. Monitor, troubleshoot, and resolve performance bottlenecks in data pipelines and platform components 6. Ensure data quality, consistency, and security across all data assets and platforms 7. Collaborate with cross-functional teams to translate business requirements into technical data architecture solutions 8. Document architecture designs, data flows, and best practices to support operational excellence and knowledge sharing
Requirements
Database Extract Transform and Load (ETL), SQL (Structured Query Language), Data Warehousing, Stored Procedures, Microsoft Transact-SQL (T-SQL), Data Modeling, Oracle PL-SQL, Python Programming/Scripting Language, Cloud Computing, Business Intelligence, * Experience Range: With at least 7 years of experience in data architecture and engineering, including substantial hands-on expertise with Databricks and modern data platforms, 1. Advanced proficiency with Databricks platform and ecosystem
- Expertise in designing and developing ETL pipelines using SQL and Python
- Expert-level SQL, including advanced query optimization
- Proficiency in Python for data engineering and automation
- Comprehensive knowledge of data warehousing concepts and design patterns
- Experience with data modeling techniques and best practices
- Hands-on experience with PLSQL and T-SQL
- Ability to develop and maintain stored procedures for data transformation
-
Experience with performance tuning and troubleshooting in distributed data environments Preferred Skills:
- Experience with Azure Data Lake, AWS S3, or Google BigQuery
- Familiarity with Delta Lake and lakehouse architecture concepts
- Knowledge of CI/CD practices for data engineering pipelines
- Working experience with Scala or Java in data engineering contexts
-
Exposure to data governance, cataloging, and lineage tools Desired Qualifications:
- Bachelorβs degree in Computer Science, Information Technology, Data Engineering, or a closely related discipline
- Databricks Certified Data Engineer Associate or Professional certification
- Certification in cloud data platforms such as Microsoft Azure Data Engineer Associate, AWS Certified Data Analytics, or Google Professional Data Engineer
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦