Azure Databrick Engineer

J. S. Vig Construction Co.
Buffalo, United States of America
3 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Compensation
$ 135K

Job location

Buffalo, United States of America

Tech stack

Java
JavaScript
.NET
Microsoft Windows
Agile Methodologies
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Azure
Bash
Big Data
Cloud Computing
Cloud Database
Cloud Engineering
Databases
Continuous Delivery
Continuous Integration
Data Systems
Relational Databases
Linux
DevOps
Electronic Data Interchange (EDI)
Cryptographic Protocols
Monitoring of Systems
Virtual Private Networks (VPN)
Python
PostgreSQL
Microsoft SQL Server
SQL Azure
MySQL
Citrix Systems
NoSQL
OpenStack
Oracle Applications
Oracle SQL Developer
Performance Tuning
Powershell
Systems Development Life Cycle
Ruby on Rails
Ansible
Azure
Software Deployment
Software Engineering
Software Systems
PL-SQL
Virtualization Technology
Web Services
Scripting (Bash/Python/Go/Ruby)
Data Storage Management
Google Cloud Platform
Cloud Platform System
GIT
Kubernetes
Information Technology
Deployment Automation
Cosmos DB
REST
Terraform
Data Pipelines
Docker
Jenkins
Databricks
Web Api
Go
VMware
Programming Languages
Microservices

Job description

  • Develop, configure, and maintain scalable data pipelines using Azure Databricks, ensuring high performance and reliability across diverse datasets.
  • Collaborate with cross-functional teams to design cloud architecture solutions utilizing services such as Azure Data Lake, Azure SQL Database, and other related tools.
  • Implement best practices for system hardening, security, and compliance within the cloud environment to safeguard sensitive data.
  • Automate deployment processes using DevOps tools like Jenkins, Terraform, Ansible, and PowerShell to streamline continuous integration/continuous deployment (CI/CD).
  • Optimize data storage and retrieval by working with NoSQL databases such as Cosmos DB and traditional RDBMS like MySQL, PostgreSQL, and Oracle.
  • Integrate various APIs and web services using RESTful API standards to facilitate seamless data exchange across platforms.
  • Support virtualization environments including VMware, OpenStack, and Docker containers to enhance scalability and resource management.
  • Contribute to system monitoring, troubleshooting, and performance tuning of cloud infrastructure components on platforms including AWS, Google Cloud Platform, Rackspace, Citrix, and Azure.
  • Engage in agile development cycles (SDLC) to deliver robust software solutions aligned with business needs while adhering to system security protocols like VPNs and system hardening procedures.

Requirements

Do you have experience in Linux?, We are seeking a dynamic and innovative Azure Databricks Engineer to join our cutting-edge cloud computing team. In this role, you will leverage your expertise in big data analytics, cloud architecture, and software development to design, implement, and optimize data solutions on the Azure platform. Your contributions will drive data-driven decision-making and support enterprise-wide digital transformation initiatives. This is an exciting opportunity for a motivated professional passionate about harnessing the power of cloud-based data platforms to solve complex business challenges., * Proven experience designing and deploying cloud-based data solutions using Azure Databricks in conjunction with services such as S3 or Google Cloud Platform.

  • Strong background in IT infrastructure management including virtualization technologies like VMware, OpenStack, Docker, Kubernetes, and cloud architecture principles.
  • Hands-on expertise with programming languages such as Python, JavaScript, Java, Go, Ruby on Rails, PowerShell, Bash shell scripting, and .NET frameworks for application development.
  • Familiarity with database systems including Microsoft SQL Server, MySQL, PostgreSQL, Oracle SQL/PLSQL; experience with NoSQL databases is a plus.
  • Knowledge of microservices architecture utilizing RESTful APIs for scalable web service development.
  • Experience working within Agile methodologies supporting DevOps practices for software deployment automation using tools like Jenkins or Git.
  • Strong understanding of IT security standards including system hardening techniques for operating systems (Windows/Linux), VPN configurations, and network security protocols.
  • Educational background in computer science or related fields with certifications in cloud computing (Azure certifications preferred), virtualization (VMware), or DevOps tools highly desirable. Join us to be at the forefront of cloud innovation! Bring your passion for technology into a collaborative environment where your skills will shape the future of enterprise data solutions while enjoying the opportunity to grow professionally in a vibrant team dedicated to excellence.

Apply for this position