Cloud Data Engineer

York Solutions, LLC
Westchester, United States of America
12 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
Westchester, United States of America

Tech stack

Java
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Data analysis
Azure
Big Data
Cloud Computing
Cloud Database
Cloud Storage
Data Validation
Information Engineering
Data Governance
ETL
Data Retrieval
Data Security
Data Systems
Data Warehousing
Disaster Recovery
Github
Hadoop
Python
PostgreSQL
NoSQL
Cloud Services
Scala
SQL Databases
Google Cloud Platform
Data Storage Technologies
Data Lake
Kubernetes
Data Lineage
Data Management
Cloudwatch
Data Pipelines

Job description

Position Overview: Cloud Data Engineer: - Mandatory 5 Years of Hands on Experience, ? Designing and implementing scalable and secure data storage solutions in the cloud, ensuring optimal performance and accessibility. ? Developing and maintaining robust data pipelines for the ingestion, transformation, and distribution of large datasets. ? Automating data processes and integrating third-party services ? Utilizing cloud services and tools to automate data workflows and streamline the data engineering process. ? Ensuring compliance with data governance and security policies, including data encryption and access controls. ? Monitoring cloud data systems' performance (Cloud Watch), identifying bottlenecks, and implementing improvements to enhance efficiency. ? Conducting data quality checks and implementing measures to ensure data accuracy and integrity. ? Optimizing data retrieval and developing APIs for data consumption by various enterprise consumers. ? Providing technical expertise and support for data-related issues, including troubleshooting and resolving data pipeline failures. ? Collaborating with IT and security teams to plan and execute disaster recovery strategies for cloud-based data systems. ? Documenting data engineering processes, creating data flow diagrams, and maintaining metadata for data lineage and cataloging. ? Collaborating with architects, analysts, and other engineers to support data modeling, analysis, and reporting needs. ? Staying current with emerging cloud technologies and data engineering practices to recommend and adopt innovations that improve data systems.

Requirements

? Cloud Platforms: AWS ( Kubernetes), Google Cloud, Microsoft Azure. ? Data Storage: Data lakes, data warehouses, cloud storage service (S3) ? Data Pipelines: Developing and maintaining data pipelines for ETL processes leveraging GitHub Actions for promotions of code assets. ? Programming Languages: Python, Java, Scala ? Data Management Systems: SQL, NoSQL, Hadoop, Postgress ? Data Security and Governance: Understanding of data security best practices and compliance regulations. ? Problem-Solving and Analytical Skills: Ability to troubleshoot issues and analyze data to identify patterns and trends.

Benefits & conditions

York Solutions Offers a generous benefits package for eligible full-time employees:

  • BCBS Medical with 3 Plans to choose from (PPO and High deductible PPO plans with Health Savings Program)
  • Delta Dental plan with 2 free cleanings and insurance discounts
  • Eye Med Vision with annual check-ups and discounts on lens
  • Life and Accidental Death Insurance paid by company
  • John Hancock 401(k) Retirement Plan with discretionary company match
  • Voluntary Insurance programs such as: Hospital Indemnity, Identity Protection, Legal Insurance, Long Term Care, and Pet Insurance.
  • Flexible work environment with some remote working opportunities
  • Strong fun and teamwork environment
  • Learning, development, and career growth

Apply for this position