> Markdown version of [/jobs/ext/3002003-senior-python-kafka-engineer-drs-platform-modernization-boston-ma-remote](https://www.wearedevelopers.com/jobs/ext/3002003-senior-python-kafka-engineer-drs-platform-modernization-boston-ma-remote). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Python Kafka Engineer DRS Platform Modernization || Boston MA/Remote - **Company:** Ampstek LLC - **Location:** Boston, MA, United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Extract Transform Load (ETL), Database Queries, Distributed Systems, Event-Driven Programming, JSON, Python (Programming Language), PostgreSQL, Performance Tuning, Query Optimization, Software Engineering, Data Logging, Cloud Platform System, Concurrency, Fastapi, Event Driven Architecture, Pytest, Kubernetes, Data Lineage, Deployment Automation, Apache Kafka, Dynatrace, Api Management, Microservices - **Published:** September 19, 2026 - **Apply:** https://arc.dev/remote-jobs/j/redirect/pl4slsfdh8 ## About the Role Python Development Strong experience developing and maintaining production grade Python applications Understanding of concurrency multithreading and asynchronous processing Experience with API integrations and distributed systems Familiarity with Python testing frameworks PyTest preferred Apache Kafka Handson experience with Kafka in production environments Strong understanding of Consumer groups Offset management Partitioning strategies Retry mechanisms Deadletter queues Message delivery guarantees Consumer rebalancing and troubleshooting PostgreSQL Strong SQL skills Experience with PostgreSQL performance tuning Experience using JSONJSONB capabilities Data modelling and query optimization Observability Logging Design and implementation of structured JSON logging Log standardization across distributed services Monitoring ing and troubleshooting best practices EventDriven Architecture Understanding of distributed systems and event driven design patterns Experience with idempotency transactional processing and messaging reliability Secondary Skills Preferred OpenTelemetry Distributed tracing implementation Instrumentation of microservices End-to-end transaction visibility Open Lineage Data Lineage Solutions Event lineage tracking Workflow traceability Data movement and process visibility Kubernetes Working knowledge of containerized workloads Deployments ConfigMaps Secrets scaling and troubleshooting GitOps Deployment Tools, 8 years of software engineering experience 3 years working with Kafka based distributed systems Strong hands-on Python development experience Experience working in Kubernetes based environments Experience with observability and monitoring implementations Skills Mandatory Skills : Python ## Description We are seeking a hands-on Senior Software Engineer to support the enhancement of an event driven digital repository platform. The role will focus on improving observability event lineage workflow reconciliation and Kafka delivery reliability across a distributed microservices ecosystem built primarily on Python and Kafka The engineer will work closely with the clients internal engineering team to implement solutions in a live production environment, Implement structured logging standards across Python based services Enhance Kafka consumer and producer reliability Improve retry recovery and dead letter handling mechanisms Design and implement end-to-end event lineage and tracing capabilities Develop reconciliation and completion tracking mechanisms to identify incomplete workflows Analyse and resolve production issues related to event processing and workflow execution Collaborate with platform engineers to improve observability and operational excellence Contribute to architecture discussions and implementation decisions related to distributed systems ## Related Videos - [Let's Get Started With Apache Kafka® for Python Developers](https://www.wearedevelopers.com/videos/565-let-s-get-started-with-apache-kafka-for-python-developers) - [Intro to FastAPI](https://www.wearedevelopers.com/videos/462-intro-to-fastapi) - [pytest: Simple, rapid and fun testing with Python](https://www.wearedevelopers.com/videos/213-pytest-simple-rapid-and-fun-testing-with-python) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [Tips, Techniques, and Common Pitfalls Debugging Kafka](https://www.wearedevelopers.com/videos/838-tips-techniques-and-common-pitfalls-debugging-kafka) - [Building and Deploying Multi-Agent Systems with ADK and Vertex AI](https://www.wearedevelopers.com/videos/1918-building-and-deploying-multi-agent-systems-with-adk-and-vertex-ai) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Why Event-Driven Architecture Isn’t About Speed (and When You Actually Need It)](https://www.wearedevelopers.com/magazine/745-why-event-driven-architecture-isn-t-about-speed-and-when-you-actually-need-it) - [Dev Digest 168: Hacking Postgres, Blocking Meta and Fixing CSS](https://www.wearedevelopers.com/magazine/588-dev-digest-168-hacking-postgres-blocking-meta-and-fixing-css) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs)