GCP/Linux Data Engineer (Remote)
Da Vinci Software
United States
about 1 month ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source
Tech stack
C (Programming Language)
Java (Programming Language)
Application Programming Interfaces (APIs)
Agile Methodology
C Sharp (Programming Language)
C++ (Programming Language)
Cloud Computing
Software Documentation
Code Review
Data Validation
Information Engineering
Linux
+12 more
Linux System Administration
Software Engineering
Scripting
Data Ingestion
Information Technology
Build Process
Database Replication
Software Coding
Software Version Control
Data Pipelines
Golang
Programming Languages
Job description
Our client is seeking resources that will be supporting an engineering team tasked with building a research data platform which will ingest and make discoverable research generated data., * Data Engineering Skills & Experience:
- Create, verify, and maintain data replication scripts
- Create, verify, and maintain data validation, processing, and ingestion pipelines
- Deploy and automate the execution of data replication scripts and data pipelines in cloud infrastructure
- Create and maintain data catalogs that describe datasets and their contents (i.e. files, file types, tables/views, columns, fields, etc.)
- Create, verify, and maintain dashboards and reports that characterize ingested datasets
- Create, verify, and maintain data validation scripts/APIs that verify the production dataset contains the correct number of samples/records, expects values/fields/columns are populated, and values are of the correct data type, format, and range.
- Deploy and automate the execution of data validation scripts/APIs
- Create and maintain user documentation (dataset descriptions, tutorials, code examples, etc.)
- Define entitlements, user groups, roles, and permissions utilized to grant access to datasets Programming Languages
Requirements
- Strong GCP
- Linux system administration and scripting
- Pro Desk API
- Required qualifications for this position include: Bachelor’s Degree in Computer Science/Engineering or related field with 5 years of experience as noted below; OR an Associate’s degree in Computer/Science/Engineering or related field with 7 years of experience.
- Have in-depth knowledge of software engineering with experience coding applications or services in a high-level language (C, C++, Golang, Java, C# etc.) and a basic knowledge of related fields.
- Demonstrated problem solving and time management skills.
- Possesses strong technical aptitude for designing and implementing software solutions. Experience with modern application development frameworks
- Knowledge of professional software engineering practices & best practices for the full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations.
- Deep hands-on technical expertise, excellent verbal and written communication skills.
- Experience with Agile software development techniques.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.indeed.comGood distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
LM
Luis Minvielle
about 2 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
LM
Luis Minvielle
Where To Find Software Engineering Jobs
over 2 years ago
LM
Luis Minvielle
How Much Does a Software Engineer Make? Realistic Software Engineering Salaries
over 2 years ago
LM
Luis Minvielle
Where to Find Entry-Level Software Engineering Jobs
over 2 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago