Data Engineer with Python and SQL

Northern Base
Charlotte, NC, United States
14 days ago
Apply on www.thejobnetwork.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours

Tech stack

Bash Shell Big Data Code Review Data Governance Extract Transform Load (ETL) Data Warehousing Relational Databases Linux Elasticsearch Python (Programming Language) Machine Learning MongoDB
+15 more
OpenShift Oracle (Applications) Performance Tuning Cloud Services Apache Solr SQL Databases Unstructured Data Data Ingestion Indexer Git Fastapi Build Management Information Technology Api Design Data Pipelines

Job description

  • Python & SQL
  • Data Ingestion & ETL
  • API Development & Integration
  • MongoDB
  • Oracle & Relational Databases
  • Elasticsearch or Solr
  • Vector Databases
  • Linux/Bash
  • OpenShift Containers
  • Git & Jenkins
  • CI/CD Pipelines
  • Data Modeling

Secondary Skills:

  • FastAPI
  • Data Quality & Validation
  • Performance Tuning, * Design and build large-scale data pipelines using Python
  • Develop and support data ingestion, processing, indexing, and retrieval pipelines for structured and unstructured data
  • Lead the architecture of cloud-native data lakes and data warehouses
  • Optimize big data processing jobs for performance and cost efficiency
  • Establish data governance, data quality, and monitoring frameworks
  • Partner with data scientists to deploy machine learning models
  • Mentor junior data engineers and lead technical code reviews

Requirements

  • Bachelor’s or Master’s Degree in Computer Science or related field

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.thejobnetwork.com
Prepare application

Good distractions

Loading talks and stories from around this role…