Data Engineer

MARKET STREET TALENT INC
Portsmouth, United States of America
19 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Senior

Job location

Portsmouth, United States of America

Tech stack

Java
API
Amazon Web Services (AWS)
Big Data
Information Systems
Databases
Information Engineering
Data Infrastructure
ETL
Data Security
Data Systems
Database Queries
Database Storage Structures
Distributed Computing Environment
Monitoring of Systems
Python
NoSQL
Cloud Services
Scala
Software Engineering
Systems Integration
Unstructured Data
Visual Systems
Web Services
Data Storage Management
Data Storage Technologies
Data Lake
Information Technology
Data Management
REST
Data Pipelines
Programming Languages

Job description

We are seeking a Data Engineer to join a high-technology team supporting advanced production systems. This role focuses on data management and infrastructure to ensure reliable, high-performance data pipelines and support for digital transformation initiatives. You'll work closely with cross-functional teams to design, implement, and maintain systems that collect, process, store, and make data accessible for production and operational use., * Design, implement, and optimize end-to-end data pipelines for large volumes of structured and unstructured data

  • Develop robust ETL processes to integrate data from diverse sources
  • Design and maintain data models, schemas, and database structures to support analytical and operational needs
  • Optimize data storage and retrieval mechanisms for performance and scalability
  • Evaluate and implement data storage solutions, including relational and NoSQL databases, data lakes, and cloud services
  • Build and maintain integrations with internal and external data sources and APIs
  • Implement RESTful APIs and web services for data access and consumption
  • Configure and manage data infrastructure components, including databases, warehouses, and distributed computing frameworks
  • Monitor system performance, troubleshoot issues, and implement optimizations to enhance reliability and efficiency
  • Collaborate with data scientists, analysts, and stakeholders to understand requirements and deliver tailored solutions
  • Document technical designs, workflows, and best practices
  • Provide technical guidance and support to team members as needed
  • Support Digital Transformation projects, including risk management
  • Create visual management standards to communicate performance metrics

Requirements

  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field
  • 5+ years of experience in data engineering, software development, or related roles
  • Strong problem-solving skills and attention to detail
  • Ability to collaborate with multi-functional teams and manage complex data solutions
  • Experience with digital transformation initiatives and system deployment support
  • Data pipeline and ETL development experience
  • SQL proficiency and database management skills
  • Strong written and verbal communication, including the ability to explain technical concepts to non-technical stakeholders
  • Experience with cloud platforms (AWS, etc.)
  • Proficiency in Python, Java, Scala, or similar programming languages
  • Familiarity with big data technologies and frameworks

Benefits & conditions

  • Health, dental, vision, 401k match
  • Generous PTO and sick leave

About the company

We are a specialized staffing and consulting firm focused on IT and Creative positions. We understand the nuances of placement-the platforms, positions, backgrounds, and intricacies of specific jobs-and we know what it takes to find highly skilled specialists that fit seamlessly into a company's culture. Our Vision: To promote and foster the growth of technology and creative talent, one candidate, one client, one community at a time. Our Goal: To coach clients and candidates through the entire placement process and cultivate long-term, healthy business relationships. Our Culture: At MST, we believe in pursuing excellence in everything we do, treating everyone with respect, and showing empathy for our community.

Apply for this position