Data Engineer
Zapata Technology
9 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
Intermediate Compensation
$ 110KJob location
Remote
Tech stack
ASP.NET
Agile Methodologies
Airflow
Amazon Web Services (AWS)
C Sharp (Programming Language)
Data as a Services
Information Engineering
Data Infrastructure
ETL
Data Systems
Database Design
Distributed Computing Environment
Python
PostgreSQL
Performance Tuning
Standard Sql
Shell Script
SQL Stored Procedures
SQL Databases
Data Ingestion
Spark
SC Clearance
Vba Programming Language
Apache Nifi
Operational Systems
Data Pipelines
Databricks
Job description
- Replace fragile VBA and ad-hoc scripts with robust, testable data workflows
- Design high-performance Postgres data models, queries, and stored procedures
- Build ingestion and transformation services using Python, ASP.NET, and SQL
- Lead the migration from custom ETL processes to modern tools (NiFi, Airflow)
- Create data pipelines that power analytics, reporting, and operational systems
- Improve data quality, observability, and governance across the platform
- Partner with stakeholders to translate messy requirements into clean data solutions
- Document and automate everything so the system scales beyond any one person
The Environment Today
- Custom ASP.NET data ingestion apps
- Heavy Postgres logic and stored procedures
- Legacy VBA automation that needs to be retired
- Growing need for cloud migration and modern orchestration
The Environment You'll Help Build
- Python-driven pipelines
- Apache NiFi / Airflow orchestration
- Clean Postgres architecture
- AWS-based data infrastructure
- Scalable, observable ETL workflows, * You get real ownership of architecture decisions
- You are hired to modernize, not maintain
- High impact, visible work that affects the entire organization
- Freedom to introduce modern tooling and best practices
- Remote flexibility with a team that values autonomy
- A rare opportunity to rebuild a data platform the right way
Requirements
- Strong experience building ETL/data pipelines without relying solely on ETL tools
- Deep SQL and Postgres performance tuning experience
- Experience writing data services in Python, C#, or ASP.NET
- Experience modernizing legacy data environments
- Comfort owning architecture decisions and working independently
- Experience migrating systems to AWS
- Familiarity with Spark, Databricks, or distributed processing is a plus
- Shell scripting and automation experience
- Experience working in Agile teams
- 4+ years of software or data engineering experience
- Strong SQL and database design background
- Experience building and maintaining ETL processes, This position requires an active Secret clearance with the ability to obtain TS/SCI.
Benefits & conditions
$110,000.00
About the company
Zapata Technology is hiring a Software / Data Engineer to own and modernize a mission-critical data ecosystem. This is not a "run the pipeline" role - this is a build the next generation data platform role. You'll take an environment currently powered by custom ASP.NET apps, Postgres stored procedures, and legacy VBA scripts and architect the transition to modern, scalable ETL and orchestration frameworks like Apache NiFi and Airflow. If you enjoy untangling complex data systems, designing clean pipelines, and turning "it works but no one knows how" into "it's automated, documented, and scalable" - this role is for you.
100% Remote