Senior Technical Lead
HCLTech
London, UK
about 2 months ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on uk.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source
Tech stack
Architectural Patterns
Data Governance
JSON
SAP (Applications)
SQL Databases
Data Streaming
Apache Spark
Data Lakes
Pyspark
Data Pipelines
Databricks
Job description
Configure Databricks Auto Loader or Apache Spark Structured Streaming to securely subscribe to the relevant SAP AEM topics. Develop the PySpark/SQL data pipelines to process the incoming JSON payloads through the Delta Lake layers. Carry out data modelling in Databricks. Expose the Delta tables to the visualisation layer. Ensure that the data pipelines are optimised.
Requirements
Expert in Apache Spark Structured Streaming and Databricks Auto Loader. Fluent in PySpark and Databricks SQL. Proven experience building Databricks architecture patterns.
Familiarity with Unity Catalog for data governance and access control.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on uk.indeed.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this role…