Data Engineer

Sonar, Inc.
Chattanooga, United States of America
15 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Remote
Chattanooga, United States of America

Tech stack

API
Airflow
Data analysis
Google BigQuery
Software as a Service
Cloud Computing
Cloud Engineering
Cloud Storage
Data as a Services
Directed Acyclic Graph (Directed Graphs)
Information Engineering
Data Structures
Relational Databases
Database Queries
DevOps
Elasticsearch
Data Flow Control
Python
PostgreSQL
Linux System Administration
Machine Learning
Microsoft SQL Server
MongoDB
MySQL
NoSQL
Standard Sql
Software Construction
Software Engineering
T-SQL
S3 Bucket
Scripting (Bash/Python/Go/Ruby)
File Transfer Protocol (FTP)
Data Ingestion
Google Data Studio
Multi-Cloud
HybridCloud
FastAPI
Pytest
Kubernetes
Data Analytics
Terraform
Network Server
Data Pipelines

Job description

  • Implementing ingestion pipelines, using Airflow as the orchestration platform, for consuming data from a wide variety of sources (API, SFTP, Cloud Storage Bucket, etc.).
  • Implementing transformation pipelines using software engineering best practices and tools (DBT)
  • Working closely with Software Engineering and DevOps to maintain reproducible infrastructure and data that serves both API-only customers and in-house SaaS products
  • Defining and implementing data ingestion/transformation quality control processes using established frameworks (Pytest, DBT)
  • Building pipelines that use multiple technologies and cloud environments (for example, an Airflow pipeline pulling a file from an S3 bucket and loading the data into BigQuery)
  • Create and ensure data automation stability with associated monitoring tools.
  • Review existing and proposed infrastructure for architectural enhancements that follow both software engineering and data analytics best practices.
  • Working closely with Data Science and facilitating advanced data analysis (like Machine Learning)

Requirements

Do you have experience in RDBMS?, * 3+ years of Data Engineering experience

  • Strong working knowledge of Apache Airflow
  • Proficiency in Python for writing DAGs & cloud functions
  • Experience supporting a SaaS or DaaS product, bonus points if you were creating new data products/features
  • Strong in Linux environments and experience in scripting languages
  • Strong understanding of software best practices and associated tools.
  • Experience in any major RDBMS (MySQL, Postgres, SQL Server, etc.).
  • Strong SQL Skills, bonus points for having used both T-SQL and Standard SQL
  • Experience with NoSQL (Elasticsearch, MongoDB, etc.)
  • Multi-cloud and/or hybrid-cloud experience
  • Strong interpersonal skills
  • Comfortable working directly with data providers, including non-technical individuals
  • Experience with the following (or transitioning from equivalent platform services):
  • Cloud Storage
  • Cloud Pubsub
  • BigQuery
  • Apache Airflow
  • dbt
  • DataFlow

Bonus knowledge/experience:

  • Experience implementing cloud architecture changes
  • Working knowledge of how to build and maintain APIs using Python/FastAPI
  • Transforming similar data from disparate sources to create canonical data structures
  • Surfacing data to BI platforms such as Looker Studio
  • Experience with R
  • Orchestration methodologies - Kubernetes, Helm
  • Infrastructure as Code - Terraform, etc.
  • Experience working with MCP Servers, Claude plugins, etc.

Benefits & conditions

Pulled from the full job description

  • Professional development assistance
  • Tuition reimbursement
  • Parental leave
  • 401(k)
  • Health insurance
  • 401(k) matching
  • Paid time off, * An excellent work environment, flat hierarchies, and short decision paths.
  • A generous benefits package including 100% employer-paid options for health, dental, vision insurance. Life insurance, STD, LTD employer-paid.
  • Stock options
  • Appealing 401k matching plan
  • Career Mentorship Opportunities
  • Personal Development Credit (Can be used toward Student loans or relevant PD Courses)
  • Annual life achievement bonus of $2000 for having a baby, buying a house, or getting married (max one per year)
  • No set days off Vacation policy (our team takes time off as needed with supervisor approval)
  • Up to $50 for Gym or Virtual Gym membership.
  • Audible or Kindle Unlimited subscription
  • Flexible work options, hybrid or remote work available.

Preference for Chattanooga, or regional area such as Knoxville, Atlanta, Nashville, or Birmingham.

Hybrid - expectations to come into the office twice a month

SONAR is an equal opportunity employer., * 401(k)

  • 401(k) matching
  • Dental insurance
  • Employee assistance program
  • Health insurance
  • Health savings account
  • Life insurance
  • Paid time off
  • Parental leave
  • Professional development assistance
  • Tuition reimbursement
  • Vision insurance

Apply for this position