Data Engineer

After School Matters, Inc.

United States

3 days ago

Apply on nitkatechnologies.applytojob.com

Prepare application

Role details

Contract type

Permanent contract

Employment type

Full-time (> 32 hours)

Experience level

Expert

Experience required

5 years minimum

Working hours

Regular working hours

Languages

English

Job source

nitkatechnologies.applytojob.com

Tech stack

Artificial Intelligence Airflow Amazon Web Services Information Engineering Extract Transform Load (ETL) Data Warehousing Dimensional Modeling Fault Tolerance Python (Programming Language) SQL Databases Apache Spark Apache Kafka

+4 more

Virtual Agents Data Delivery Data Pipelines Databricks

Job description

Lead discovery and requirements-gathering sessions with business stakeholders; document source schemas and define analytics-ready data model specifications;
Build, optimize and maintain end-to-end data pipelines ETL/ELT frameworks with reusable dbt macros, incremental models, and snapshot patterns to ensure fault-tolerant, scalable data delivery;
Design and implement data models following medallion architecture patterns (bronze/silver/gold), creating foundational tables, star schemas, and reporting marts with defined SLAs and data quality contracts;
Tune Spark jobs and pipeline components to meet SLA requirements by optimizing partitions, reducing shuffle, and implementing efficient transformation patterns;
Implement automated data quality checks using frameworks like Great Expectations, establishing quality contracts across pipeline layers;
Diagnose complex, multi-system pipeline issues-profiling Spark UI stages, tracing Kafka consumer lag, identifying dbt dependency failures-and design mitigations proactively;
Create and maintain technical documentation, data model diagrams, and operational runbooks for production support

Requirements

5+ years of Data engineering experience;
Advanced proficiency in Python, Spark, and SQL;
Strong experience with AWS and Databricks;
Familiarity with Kafka and modern Data stack tools (DBT, Airflow or equivalent);
Deep understanding of dimensional modeling (star/snowflake schemas), medallion architecture, data warehouse design principles;
AI fluency: able to structure problems to leverage AI assistance and design pipelines that assume AI-assisted development;
Knowledge of system topologies (lambda, kappa, lakehouse);
Strong spoken English (Intermediate level and higher).

Benefits & conditions

Remote work
Full-time (8 hours/day)
Attractive USD compensation
Paid vacation, holidays

About the company

Nitka Technologies develops software for customers in the US and Europe and brings together about 300 professionals from Eastern Europe, North and South America, Armenia, Georgia and Kazakhstan.

We are looking for an experienced Data Engineer for a long-term project. The customer is a company in California, an industry leader in the sale of tickets to events in Europe and the USA.

We offer 100% remote, full-time work