GCP/Linux Data Engineer (Remote)

Da Vinci Software
United States
about 1 month ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source

Tech stack

C (Programming Language) Java (Programming Language) Application Programming Interfaces (APIs) Agile Methodology C Sharp (Programming Language) C++ (Programming Language) Cloud Computing Software Documentation Code Review Data Validation Information Engineering Linux
+12 more
Linux System Administration Software Engineering Scripting Data Ingestion Information Technology Build Process Database Replication Software Coding Software Version Control Data Pipelines Golang Programming Languages

Job description

Our client is seeking resources that will be supporting an engineering team tasked with building a research data platform which will ingest and make discoverable research generated data., * Data Engineering Skills & Experience:

  • Create, verify, and maintain data replication scripts
  • Create, verify, and maintain data validation, processing, and ingestion pipelines
  • Deploy and automate the execution of data replication scripts and data pipelines in cloud infrastructure
  • Create and maintain data catalogs that describe datasets and their contents (i.e. files, file types, tables/views, columns, fields, etc.)
  • Create, verify, and maintain dashboards and reports that characterize ingested datasets
  • Create, verify, and maintain data validation scripts/APIs that verify the production dataset contains the correct number of samples/records, expects values/fields/columns are populated, and values are of the correct data type, format, and range.
  • Deploy and automate the execution of data validation scripts/APIs
  • Create and maintain user documentation (dataset descriptions, tutorials, code examples, etc.)
  • Define entitlements, user groups, roles, and permissions utilized to grant access to datasets Programming Languages

Requirements

  • Strong GCP
  • Linux system administration and scripting
  • Pro Desk API
  • Required qualifications for this position include: Bachelor’s Degree in Computer Science/Engineering or related field with 5 years of experience as noted below; OR an Associate’s degree in Computer/Science/Engineering or related field with 7 years of experience.
  • Have in-depth knowledge of software engineering with experience coding applications or services in a high-level language (C, C++, Golang, Java, C# etc.) and a basic knowledge of related fields.
  • Demonstrated problem solving and time management skills.
  • Possesses strong technical aptitude for designing and implementing software solutions. Experience with modern application development frameworks
  • Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
  • Deep hands-on technical expertise, excellent verbal and written communication skills.
  • Experience with Agile software development techniques.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.indeed.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

52 sec

Running persistent Linux environments directly on Windows

Ben Breard Ben Breard · WWC 2025

1:08 min

Building solutions with open source GoLang infrastructure tools

Jad Wahab · LIVE

1:04 min

Introduction to Bitcoin script parsing tools

Steve Shadders · LIVE

1:06 min

Developer experience and project variety at scale

Alexandra Petri · WWC 2023

3:55 min

Demonstrating .NET installation on Debian and Azure Linux

Silvano Coriani Silvano Coriani · Europe 2026 Virtual

1:20 min

Identifying multi-disciplinary talent for developer experience engineering roles

Hazal Mestci +1 · Coffee With Developers

Videos

See all

Related articles

See all