Azure Databrick Engineer
Role details
Job location
Tech stack
Job description
- Develop, configure, and maintain scalable data pipelines using Azure Databricks, ensuring high performance and reliability across diverse datasets.
- Collaborate with cross-functional teams to design cloud architecture solutions utilizing services such as Azure Data Lake, Azure SQL Database, and other related tools.
- Implement best practices for system hardening, security, and compliance within the cloud environment to safeguard sensitive data.
- Automate deployment processes using DevOps tools like Jenkins, Terraform, Ansible, and PowerShell to streamline continuous integration/continuous deployment (CI/CD).
- Optimize data storage and retrieval by working with NoSQL databases such as Cosmos DB and traditional RDBMS like MySQL, PostgreSQL, and Oracle.
- Integrate various APIs and web services using RESTful API standards to facilitate seamless data exchange across platforms.
- Support virtualization environments including VMware, OpenStack, and Docker containers to enhance scalability and resource management.
- Contribute to system monitoring, troubleshooting, and performance tuning of cloud infrastructure components on platforms including AWS, Google Cloud Platform, Rackspace, Citrix, and Azure.
- Engage in agile development cycles (SDLC) to deliver robust software solutions aligned with business needs while adhering to system security protocols like VPNs and system hardening procedures.
Requirements
Do you have experience in Linux?, We are seeking a dynamic and innovative Azure Databricks Engineer to join our cutting-edge cloud computing team. In this role, you will leverage your expertise in big data analytics, cloud architecture, and software development to design, implement, and optimize data solutions on the Azure platform. Your contributions will drive data-driven decision-making and support enterprise-wide digital transformation initiatives. This is an exciting opportunity for a motivated professional passionate about harnessing the power of cloud-based data platforms to solve complex business challenges., * Proven experience designing and deploying cloud-based data solutions using Azure Databricks in conjunction with services such as S3 or Google Cloud Platform.
- Strong background in IT infrastructure management including virtualization technologies like VMware, OpenStack, Docker, Kubernetes, and cloud architecture principles.
- Hands-on expertise with programming languages such as Python, JavaScript, Java, Go, Ruby on Rails, PowerShell, Bash shell scripting, and .NET frameworks for application development.
- Familiarity with database systems including Microsoft SQL Server, MySQL, PostgreSQL, Oracle SQL/PLSQL; experience with NoSQL databases is a plus.
- Knowledge of microservices architecture utilizing RESTful APIs for scalable web service development.
- Experience working within Agile methodologies supporting DevOps practices for software deployment automation using tools like Jenkins or Git.
- Strong understanding of IT security standards including system hardening techniques for operating systems (Windows/Linux), VPN configurations, and network security protocols.
- Educational background in computer science or related fields with certifications in cloud computing (Azure certifications preferred), virtualization (VMware), or DevOps tools highly desirable. Join us to be at the forefront of cloud innovation! Bring your passion for technology into a collaborative environment where your skills will shape the future of enterprise data solutions while enjoying the opportunity to grow professionally in a vibrant team dedicated to excellence.