Senior Python Data Processing Developer

REVEAL GLOBAL CONSULTING, LLC
Suitland-Silver Hill, MD, United States
4 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
6 years minimum
Working hours
Regular working hours

Tech stack

Agile Methodology Amazon Web Services Amazon S3 Automation of Tests Big Data Cloud Engineering Code Review Continuous Integration Data Validation Extract Transform Load (ETL) Data Transformation Software Debugging
+17 more
Python (Programming Language) PostgreSQL Operational Databases Standard Sql DataOps Software Engineering SQL Databases Data Processing Freeform SQL Apache Spark AWS Lambda Git Pandas Pyspark Production Code AWS Glue Serverless Computing

Job description

  • Develop and maintain Python-based data-processing and transformation workflows.
  • Translate business rules and technical requirements into tested, production-ready code.
  • Implement data validation, edit checks, aggregations, calculations, and transformation logic.
  • Develop and maintain cloud-based processing jobs using AWS services.
  • Build and optimize complex SQL queries and PostgreSQL-based data operations.
  • Work with large structured and semi-structured datasets using Spark, PySpark, Polars, or similar technologies.
  • Implement data-quality checks and validate processing outputs for accuracy and completeness.
  • Troubleshoot production data issues and optimize processing performance.
  • Collaborate with business, data, and engineering teams to support ongoing enhancements and releases.
  • Participate in code reviews, testing, documentation, and Agile development activities.

Requirements

  • 6+ years of hands-on Python development experience, with a strong focus on data processing and business-logic implementation.
  • Strong SQL and PostgreSQL experience.
  • Experience developing complex SQL using CTEs, joins, aggregations, update/merge operations, and data transformations.
  • Hands-on experience with AWS services such as:
  • AWS Glue
  • AWS Lambda
  • AWS Step Functions
  • Amazon S3
  • Strong experience with Spark, PySpark, Polars, or similar large-scale data-processing frameworks.
  • Experience designing and maintaining ETL/data-processing pipelines.
  • Strong experience with data validation, reconciliation, and data-quality checks.
  • Ability to work with large datasets and optimize data-processing performance.
  • Strong debugging and problem-solving skills.

Preferred Skills

  • Experience working with statistical, survey, financial, or other complex business-rule-driven datasets.
  • Experience with Pandas or other Python data-processing libraries.
  • Experience with cloud-native and serverless application development.
  • Familiarity with CI/CD pipelines, Git, automated testing, and Agile development practices.

Due to the nature of the engagement and background investigation requirements, U.S. Citizens and Lawful Permanent Residents (Green Card holders) are required. Location Suitland, MD, United States of America

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Loading talks and stories from around this role…