Data Engineer

Computer Enterprises Inc
United States
2 months ago

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$135,200.0
Working hours
Regular working hours
Job source

Tech stack

Java (Programming Language) JavaScript (Programming Language) Agile Methodology Amazon Web Services Amazon Elastic Compute Cloud Amazon S3 Software as a Service Cloud Computing Information Engineering Data Integration Data Migration Persistent Data Structure
+31 more
Relational Databases Software Debugging DevOps Distributed Systems Amazon DynamoDB Python (Programming Language) Network Security Network Architecture Node.Js NoSQL Platform as a Service (PAAS) Cloud Services Salesforce.Com Software Systems Systems Architecture Apache Spark Amazon Relational Database Service Pyspark Information Technology Low Latency AWS Fargate Functional Programming Api Gateway Software Version Control Data Pipelines Software Library Predix Databricks Golang Programming Languages Microservices

Job description

  • Creation, management and operation of a diverse set of Dev-Ops-related tools, processes, paradigms and technologies that enable the creation and ongoing operation of the Signify IoT Platform.
  • Focus on the creation of horizontal tools, technologies and best-practices that enable and support all the IoT Platform engineering teams to build, debug, test, release, manage and secure the IoT Platforms modern, microservices-based cloud infrastructure.
  • Collaborate in defining the methodologies and ways-of-working that will enable our fast-paced engineering teams to flourish as we collectively build-out the IoT Platform. You will help promote and implement best practices and supporting tools/technologies for source control management, CI and CD architectures, performance, SLAs, security, audit and monitoring that will be used by every engineer within the IoT Platform organization.
  • Define common frameworks and software libraries, in various programming languages, that support the creation of efficient, scalable and highly available microservice-based architectures.
  • Support with the management of the running IoT Platform system architecture. You will troubleshoot issues and identify areas for continuous improvement with a particular emphasis on quality, performance and security.
  • Work closely with architects and technical product managers and other members of your team to translate overall system architecture and product requirements into well-designed, implemented and tested software solutions.
  • Work in an Agile environment to deliver high-quality software in an incremental manner.
  • Help promote the adoption of best-in-class software engineering practices, frameworks, and tools. You are providing guidance and feedback to other software developers.

Requirements

  • B.Sc. in Computer Science or related Engineering (Masters degree desirable)
  • 8+ years of proven, hands-on track-record as a software engineer, focused on cloud-based systems
  • Mastery of a variety of programming languages - at least Java, Python, with knowledge of Golang or JavaScript (NodeJS) desirable. Strong Java Development skills, preferably with Ver. 1.8
  • Proven track record developing cloud-based services (SaaS) and platforms (PaaS)
  • Proven hands-on in-depth experience of AWS, including EC2, S3, DynamoDB, RDS, Lambda, API Gateway, Fargate
  • Proven experience of developing microservices and complex microservice-based platform architectures
  • Excellent understanding of distributed systems, designing for scalability, performance and availability
  • Experience establishing non-functional best-practices and deploying supporting technologies for security (including audit) and reliability (latency, availability, scalability)
  • Knowledge of distributed network architectures and network security
  • Good knowledge of data persistence technologies including relational databases and no-SQL solutions
  • Excellent interpersonal and technical communication skills with a can-do attitude
  • 3+ years in teams applying modern agile software development practices

Preferred Skills

  • Salesforce experience (plus)
  • Spark and PySpark expertise
  • Data pipelines and data integration projects experience, specifically with Data Bricks
  • 7-9 years of experience in data engineering and data migration projects

Benefits & conditions

Contract: W2 only, 6-month contract with potential for extension or conversion to full time with either the client or CEI Pay: $65/hour + optional medical, dental, vision, 401(k) match

Overview This role involves working on a Salesforce data migration project, focusing on data pipelines into Data Bricks. The candidate will collaborate with a senior engineer and participate in weekly Scrum ceremonies, contributing to the development of core CRM databases for Comcast advertising. The position emphasizes data engineering, ETL development, and cloud data platform integration.

About the company

This position offers the opportunity to work on a high-impact cloud data platform project with a leading organization, utilizing cutting-edge technologies in a collaborative, agile environment. It is ideal for experienced data engineers seeking to advance their expertise in cloud and data platform development.

About CEI: As a trusted technology partner, CEI delivers solutions that help our customers transform their business and achieve meaningful results. From strategy and custom application development through application management - our technology and digital experience services are tailored to meet each unique need of our customers. Our staffing solutions bring specialized skills to complement our customers’’ workforce and project requirements.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

2:37 min

Comparing traditional SQL tables versus NoSQL non-tabular databases

Stanimira Vlaeva · JS Congress

1:08 min

Building solutions with open source GoLang infrastructure tools

Jad Wahab · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

3:16 min

Terminology differences between relational and NoSQL databases

Tim Faulkes · LIVE

1:33 min

Case study on adopting Kubernetes and Golang effectively

Andrew Holway · LIVE

Videos

See all

Related articles

See all