Lead Python Software Engineer (70% Python Development | 30% Data Engineering)

Data Inc
United States
10 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Working hours
Regular working hours
Job source

Tech stack

Agile Methodology Artificial Intelligence Airflow Amazon Web Services Application Performance Management Microsoft Azure Big Data Code Review Databases Continuous Integration Data Validation Information Engineering
+43 more
Extract Transform Load (ETL) Database Queries Distributed Systems Django Web Framework Github Monitoring of Systems Python (Programming Language) PostgreSQL MySQL Scrum Methodology Redis Prometheus Software Engineering SQL Databases Data Streaming Unstructured Data Workflow Management Systems Datadog Google Cloud Enterprise Software Applications Spring Cloud Flask (Web Framework) Snowflake Grafana Apache Spark Backend Git Cloudformation Fastapi Event Driven Architecture Pyspark Gitlab-ci Kubernetes AWS Glue Apache Kafka Cloudwatch Restful APIs Terraform Data Pipelines Docker Jenkins Databricks Microservices

Job description

We are seeking a highly skilled Lead Python Software Engineer with strong expertise in designing and developing scalable backend applications using Python. The ideal candidate should have approximately 70% hands-on Python backend development experience and 30% Data Engineering experience, including building ETL pipelines and processing large-scale data., Design, develop, and maintain scalable Python backend applications. Develop REST APIs and microservices for enterprise applications. Build and maintain ETL pipelines and data processing workflows. Collaborate with product owners, architects, and engineering teams to deliver high-quality software. Optimize application performance, scalability, and reliability. Develop cloud-native applications and deploy them using Docker and Kubernetes. Participate in architecture discussions, code reviews, and technical mentoring. Troubleshoot production issues and implement performance improvements. Follow best practices for software development, testing, security, and CI/CD. Nice to Have FastAPI PySpark Apache Airflow Kafka AWS Glue Terraform Kubernetes Redis Snowflake Databricks Google Cloud Platform Key Technologies

Python FastAPI Flask Django REST APIs Microservices Docker Kubernetes AWS Azure Google Cloud Platform PySpark Airflow Kafka SQL PostgreSQL ETL CI/CD Terraform Git Agile

This posting is aligned with a role where the primary focus is Python backend engineering (70%) with supporting Data Engineering responsibilities (30%), making it suitable for candidates who are Python-first engineers with hands-on experience in data pipelines and ETL processing.

Requirements

The candidate should have experience developing cloud-native applications, microservices, REST APIs, and distributed systems while collaborating with cross-functional teams in an Agile environment., 8+ years of software engineering experience with strong Python development. Expertise in Python, FastAPI, Flask, or Django. Strong experience designing and developing RESTful APIs and Microservices. Hands-on experience with Docker and Kubernetes. Experience working with AWS, Azure, or Google Cloud Platform (Google Cloud Platform). Experience with CI/CD pipelines using Jenkins, GitHub Actions, GitLab CI, or similar tools. Strong SQL skills with PostgreSQL, MySQL, or similar databases. Experience with Git and Agile/Scrum methodologies. Data Engineering Experience (30%) Experience building ETL/ELT pipelines. Hands-on experience with PySpark, Apache Spark, or similar technologies. Experience with Apache Airflow, AWS Glue, or other workflow orchestration tools. Experience processing structured and unstructured data. Knowledge of Kafka or other messaging/streaming platforms. Experience with data validation, transformation, and optimization. Preferred Skills Experience with distributed systems and event-driven architecture. Infrastructure as Code (Terraform or CloudFormation). Redis or other caching technologies. Monitoring tools such as Datadog, Prometheus, Grafana, or CloudWatch. Experience with AI/ML or GenAI integrations is a plus but not required.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

3:03 min

Career evolution in data engineering and AI platforms

Maria Apazoglou · Coffee With Developers

6:21 min

Investigating push inefficiencies with upstream Git experts

Jonathan Creamer · Coffee With Developers

3:55 min

Demonstrating semantic routing thresholds with the Redis vector library

2:18 min

Scaling MySQL databases for massive user growth

Johannes Nicolai Johannes Nicolai +1 · LIVE

3:09 min

Balancing data science skillings alongside systems engineering rigor

Nico Schmidt · LIVE

56 sec

Favorite git commands and the importance of patch commits

Eileen Uchitelle Eileen Uchitelle +1 · Coffee With Developers

Videos

See all

Related articles

See all