Data Engineer- Columbus OH

Georgia Tek Systems
Columbus, OH, United States
3 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
10 years minimum
Working hours
Regular working hours

Tech stack

Airflow Amazon Web Services Amazon S3 Cloud Computing Cloud Engineering Databases Information Engineering Extract Transform Load (ETL) Data Transformation DevOps Python (Programming Language) NoSQL
+22 more
Software Tools Standard Sql Software Engineering SQL Databases Extensible Markup Language (XML) XPath XQuery Scripting Marklogic Software Application Programming AWS Lambda Git Containerization Triple Store Kubernetes Information Technology AWS Fargate Functional Programming Amazon Simple Queue Service (SQS) Data Pipelines Serverless Computing Docker

Job description

  • Data Engineer is responsible for developing Life Sciences content curation and delivery system for the purpose of building life sciences databases.
  • Develops data transformation and integration pipelines and infrastructure foundations of life sciences content in support of scientific databases and data curation
  • Combines strong software development and data engineering skills with a working knowledge of basic biology/chemistry/physics to develop sophisticated informatics solutions that drive efficiencies in content curation and workflow process. Applies data transformation and other data-engineering software development capabilities to contribute to the building of new scientific information management systems supporting scientific database building activities.

Requirements

Database Extract Transform and Load (ETL), Python Programming/Scripting Language, XPath, XML (EXtensible Markup Language), SQL (Structured Query Language), AWS Lambda, Amazon Simple Storage Service (S3), Simple Queue Service (SQS), Cloud Computing, DevOps, * Data Engineering tools and techniques (any ETL/ ELT skills are good to have )

  • Python, XML, XPath
  • SQL
  • AWS Lambda, SQS, Fargate, S3,
  • Dev Ops
  • 10-12 year of exp must have
  • Proficiency in Python
  • Proficiency in Linux/Unix environments
  • Experience building applications for public cloud environments (AWS preferred)
  • Experience with AWS DevOps tools (git, Cloud Development Kit, CDK Pipeline) is highly desired
  • Experience building applications using AWS Serverless technologies such as Lambda, SQS, Fargate, S3 is highly desired
  • Experience with Apache Airflow is a plus
  • Experience building containerized applications (Docker, Kubernetes) is a plus, * Experience with databases technologies (NoSQL, relational, property graph, RDF/triple store)
  • Experience with data engineering tools and techniques is highly desired
  • Experience working with XML and XPath is highly desired
  • Experience with MarkLogic/Xquery is a plus

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…