Python Data Engineer
Hays plc
Charing Cross, United Kingdom
8 days ago
Role details
Contract type
Temporary contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Compensation
£ 124KJob location
Charing Cross, United Kingdom
Tech stack
Azure
Cloud Computing Security
Data Governance
Data Systems
Distributed Data Store
Python
Infrastructure as Code (IaC)
Data Lake
PySpark
Docker
Databricks
Job description
My client is an International Consultancy who require a Security Cleared Data Engineer, with Active Security Clearance (SC), and strong Python skills to design and deploy scalable Data solutions in a containerized Azure environment.
Requirements
- Proven experience as a Data Engineer with Active Security Clearance (SC)
- Strong Python skills with modular, test-driven design
- Experience with Behave for unit and BDD testing (mocking, patching)
- Proficiency in PySpark and distributed Data processing
- Solid understanding of Delta Lake (design and maintenance)
- Hands-on with Docker for development and deployment
- Familiarity with Azure services: Functions, Key Vault, Blob Storage
- Ability to build configurable, parameter-driven applications
- Exposure to CI/CD pipelines (ideally Azure DevOps) and cloud security best practices
- Strong collaboration and communication skills
Nice to have:
- Immediate availability
- Experience with Databricks or Synapse
- Knowledge of Data governance in Azure ecosystems
- Infrastructure as Code (IaC) tooling
