Full Stack Data Engineer

rockITdata, LLC
San Jose, United States of America
6 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Remote
San Jose, United States of America

Tech stack

Query Performance
Java
API
Agile Methodologies
Artificial Intelligence
Amazon Web Services (AWS)
Azure
Google BigQuery
Cloud Computing
Computer Programming
Continuous Integration
Data as a Services
Information Engineering
Data Governance
Data Infrastructure
Data Integrity
ETL
Data Transformation
Data Systems
Data Warehousing
Database Applications
Database Theory
Document-Oriented Databases
Python
NoSQL
Raw Data
Power BI
Software Engineering
Software Systems
SQL Databases
Data Streaming
Tableau
Workflow Management Systems
Software Organization
Data Processing
Data Storage Management
Data Storage Technologies
Data Ingestion
Snowflake
GIT
Containerization
Data Lake
Kubernetes
Information Technology
Apache Flink
QlikView
Kafka
Software Version Control
Data Pipelines
Docker
Redshift

Job description

Driven by Innovation and built on Trust, rockITdata is a unique SDVOSB services company that partners with leading commercial healthcare/life sciences organizations on cutting edge innovations - think AI, automation and data transformation. We then bring those commercially tested solutions to government entities to deliver predictable, measurable impact for the American taxpayer and consumer. We are seeking a talented and experienced Full Stack Data Engineer to join our team. The ideal candidate will have a strong background in both data engineering and software development, with expertise in building end-to-end data solutions. This role offers an exciting opportunity to work on diverse data projects and contribute to the development of innovative data-driven applications. This is a Remote position. Key Responsibilities

  • Data Ingestion and Integration:
  • Design and implement scalable data ingestion pipelines to efficiently collect and process data from various sources.
  • Integrate data from different systems and platforms to create unified datasets for analysis and reporting.
  • Data Storage and Management:
  • Develop and maintain data storage solutions such as data lakes, data warehouses, and NoSQL databases.
  • Optimize data storage and retrieval mechanisms for performance, scalability, and cost-effectiveness.
  • Data Processing and Transformation:
  • Implement data processing workflows for cleaning, transforming, and enriching raw data into usable formats.
  • Apply data transformation techniques such as ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes.
  • Data Modeling and Optimization:
  • Design and implement data models to support analytical and reporting requirements.
  • Optimize data models for query performance, data integrity, and storage efficiency.
  • Software Development and Integration:
  • Build software applications and APIs to expose data services and functionality to other systems and applications.
  • Integrate data engineering workflows with existing software systems and platforms.
  • Monitoring and Maintenance:
  • Establish monitoring and alerting mechanisms to track the health and performance of data pipelines and systems.
  • Conduct regular maintenance activities to ensure the reliability, availability, and scalability of data infrastructure.
  • Documentation and Collaboration:
  • Document data engineering processes, architectures, and solutions to facilitate knowledge sharing and collaboration.
  • Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand requirements and deliver solutions., + Design and implement scalable data ingestion pipelines to efficiently collect and process data from various sources.
  • Integrate data from different systems and platforms to create unified datasets for analysis and reporting.
  • Data Storage and Management:
  • Develop and maintain data storage solutions such as data lakes, data warehouses, and NoSQL databases.
  • Optimize data storage and retrieval mechanisms for performance, scalability, and cost-effectiveness.
  • Data Processing and Transformation:
  • Implement data processing workflows for cleaning, transforming, and enriching raw data into usable formats.
  • Apply data transformation techniques such as ETL (Extract, Transform, Load) and ELT (Extract, Load, Transform) processes.
  • Data Modeling and Optimization:
  • Design and implement data models to support analytical and reporting requirements.
  • Optimize data models for query performance, data integrity, and storage efficiency.
  • Software Development and Integration:
  • Build software applications and APIs to expose data services and functionality to other systems and applications.
  • Integrate data engineering workflows with existing software systems and platforms.
  • Monitoring and Maintenance:
  • Establish monitoring and alerting mechanisms to track the health and performance of data pipelines and systems.
  • Conduct regular maintenance activities to ensure the reliability, availability, and scalability of data infrastructure.
  • Documentation and Collaboration:
  • Document data engineering processes, architectures, and solutions to facilitate knowledge sharing and collaboration.
  • Collaborate with cross-functional teams including data scientists, analysts, and business stakeholders to understand requirements and deliver solutions.

Requirements

  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Proficiency in programming languages such as Python, Java, or Scala for data engineering and software development.
  • Expert-level skills in data visualization platforms beyond Tableau and Power BI (e.g. Qlik)
  • Strong understanding of database concepts, data modeling techniques, and SQL programming.
  • Hands-on experience with cloud platforms such as AWS, Azure, or GCP for building and deploying data solutions.
  • Knowledge of data warehousing concepts and technologies (e.g., Redshift, BigQuery, Snowflake).
  • Familiarity with version control systems (e.g., Git) and software development best practices (e.g., Agile, CI/CD)., * Experience building solutions for Commercial clients in Pharma, Biotech, CPG, Retail or Manufacturing industries.
  • Experience with containerization technologies such as Docker and orchestration tools like Kubernetes.
  • Knowledge of streaming data processing frameworks (e.g., Apache Flink, Apache Kafka Streams).
  • Familiarity with data governance and security practices for protecting sensitive data.
  • Strong problem-solving skills and the ability to troubleshoot complex data engineering issues.
  • Excellent communication skills and the ability to collaborate effectively in a team environment.

Benefits & conditions

Here at rockITdata, we are committed to following our 10 Guiding Principles. Our Guiding Principles define our culture. They're who we are, how we work, and what inspires us to be the best. We empower our people to be themselves and encourage an entrepreneurial way of thinking. In our challenging, fast-paced environment, no day is the same.

Know the Why.

Value People Above All Else.

Transparency to a Fault.

Progress, Not Perfection.

Be Good by Doing Good.

Smart People Can Disagree.

Bend but Don't Break.

Represent Your Brand.

Think Differently.

Be Amazing, Be Fearless, Smile, Have Fun!

Interested in joining something unique? Join us on our rockIT ship as we begin to blast off to the next chapter in our organization!

About the company

Driven by Innovation and built on Trust, rockITdata is a unique SDVOSB services company that partners with leading commercial healthcare/life sciences organizations on cutting edge innovations - think AI, automation and data transformation. We then bring those commercially tested solutions to government entities to deliver predictable, measurable impact for the American taxpayer and consumer. We are seeking a talented and experienced Full Stack Data Engineer to join our team. The ideal candidate will have a strong background in both data engineering and software development, with expertise in building end-to-end data solutions. This role offers an exciting opportunity to work on diverse data projects and contribute to the development of innovative data-driven applications. This is a Remote position. Key Responsibilities

Apply for this position