Mid-Level Python Data Engineer [$320k/yr+] TS/SCI-FS Poly

SYSTOLIC, INC.
Herndon, United States of America
8 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 320K

Job location

Herndon, United States of America

Tech stack

Java
Artificial Intelligence
Amazon Web Services (AWS)
Apache HTTP Server
Bash
Databases
System Configuration
Custom Software
Information Engineering
ETL
Software Debugging
Software Design Patterns
Amazon DynamoDB
Python
PostgreSQL
MySQL
Operational Databases
Performance Tuning
Query Optimization
Azure
Software Deployment
SQL Databases
Data Streaming
Workflow Management Systems
Data Processing
Cloud Platform System
Spark
GIT
Containerization
Data Lineage
Terraform
Data Pipelines
Docker

Job description

  • Build complex data flows, production data pipelines, and ETL workflows.
  • Develop with Python, Java, SQL, and Bash scripting.
  • Utilize orchestration tools for Apache Spark jobs, containerize applications with Docker in AWS environments.
  • Manage MySQL, PostgreSQL, and DynamoDB databases.
  • Implement code control with Git and Infrastructure as Code with Terraform.
  • Integrate AI/ML services and work with Apache Iceberg and Trino.
  • Understand data requirements and contribute to documentation., * Work with a small team to build complex data flows for custom applications.
  • Build end-to-end data pipelines leveraging advanced Python programming skills.
  • Utilize orchestration tools to deploy and manage data pipelines, including configuring and updating Spark Jobs.
  • Containerize and deploy applications in cloud environments like AWS.
  • Manage and optimize databases such as MySQL and PostgreSQL, including performance tuning, schema design, and query optimization for complex, analytical workloads.
  • Leverage industry standard tools for code control (Git, IaaC control) and Infrastructure as Code (Terraform).
  • Work with data catalogs, track data lineage, and handle various data formats, including Geospatial.
  • Employ Bash scripting for automation and data processing tasks.
  • Integrate AI/ML services and models.
  • Collaborate with stakeholders to understand data requirements, assess feasibility, and design solutions with minimal oversight.
  • Apply strong problem-solving and debugging skills for data quality issues, pipeline failures, and performance bottlenecks.
  • Contribute to data engineering documentation, best practices, and design patterns.
  • Familiarity with Java, DynamoDB, Apache Iceberg, and Trino is beneficial.

Requirements

  • Degree: Technical bachelor's degree or equivalent experience
  • Years of experience: 8+ years
  • Total Compensation: $320k+ yearly (tentative)

Apply for this position