SENIOR DATA ENGINEER

RKube Inc
United States
17 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Working hours
Regular working hours
Job source

Tech stack

Amazon Web Services Microsoft Azure Big Data Data Architecture Information Engineering Data Infrastructure Extract Transform Load (ETL) Data Systems Data Visualization Data Warehousing DevOps Apache Hadoop
+13 more
Python (Programming Language) Machine Learning Power BI SQL Databases Tableau (Software) Data Processing Google Cloud Data Storage Technologies Containerization Pyspark Apache Kafka Data Pipelines Docker

Job description

Join our dynamic team as a Senior Data Engineer, where you will play a pivotal role in shaping our data infrastructure and strategy. In this position, you will be responsible for designing, implementing, and maintaining our data architecture on Google Cloud Platform (Google Cloud Platform). You will work closely with data scientists, analysts, and other stakeholders to ensure data is accessible, reliable, and scalable. Your expertise in Python and PySpark will be crucial in developing efficient data pipelines and performing complex data transformations., * Design and implement scalable data architectures on Google Cloud Platform.

  • Develop, deploy, and maintain data pipelines using Python and PySpark.
  • Collaborate with data scientists and analysts to understand their data needs and provide solutions.
  • Ensure data quality, integrity, and security across all data systems.
  • Optimize data storage solutions and manage data lifecycle processes.
  • Mentor junior data engineers and contribute to the overall team knowledge base.
  • Stay updated with the latest trends and technologies in data engineering and big data.

Requirements

  • Proven experience as a Data Engineer with a strong background in Google Cloud Platform.
  • Proficiency in Python and PySpark for data processing and analysis.
  • Experience with data warehousing solutions and SQL databases.
  • Strong understanding of data modeling and ETL processes.
  • Ability to write clean, efficient, and well-documented code.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills and ability to work in a collaborative environment.

<>Preferred Skills

  • Experience with other cloud platforms such as AWS or Azure.
  • Knowledge of containerization technologies like Docker and Kubernetes.
  • Familiarity with data visualization tools such as Tableau or Power BI.
  • Experience with machine learning frameworks and libraries.
  • Background in DevOps practices and CI/CD pipelines.
  • Experience with big data technologies such as Apache Hadoop or Apache Kafka.

``` This job description provides a comprehensive overview of the Senior Data Engineer role, highlighting the key responsibilities and required and preferred skills. It is structured to attract qualified candidates who are passionate about data engineering and have the necessary expertise to contribute to the team.

Benefits & conditions

Depends on Experience

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…