> Markdown version of [/jobs/ext/3039266-python-developer](https://www.wearedevelopers.com/jobs/ext/3039266-python-developer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Python Developer - **Company:** Python Software Foundation - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Contract - **Skills:** Architectural Patterns, Software Quality, Software Debugging, Python (Programming Language), Performance Tuning, Software Engineering, Multithreading, Large Language Models, Asynchronous Programming, Code Restructuring - **Published:** September 23, 2026 - **Apply:** https://www.python.org/jobs/8103/ ## About the Role * 3+ years of strong experience with Python programming language. * Industry experience and knowledge of code quality, formatting, and best practices of software development * Experience with Python's testing ecosystem, including unit, integration, and property-based testing. * Knowledge of multi-threading and asynchronous programming in Python. * Ability to work with architectural patterns and refactor code without introducing regressions. * Strong debugging skills, including fixing memory and concurrency issues. * Fluent in conversational and written English communication skills ## Description This position is within a project with one of the foundational LLM companies. The goal is to assist these foundational LLM companies in enhancing their Large Language Models. One way we help these companies improve their models is by providing them with high-quality proprietary data. This data serves two main purposes: first, as a basis for fine-tuning their models, and second, as an evaluation set to benchmark the performance of their models or competitor models. For example, for SFT data generation, you might have to put together or be provided a prompt which contains provided code and questions, you will then provide the model responses, and write corresponding Python code to solve the questions. For RLHF data generation, you may need to create a prompt yourself or use one provided by the customer, ask the model questions, and evaluate the outputs generated by two versions of the LLM. You'll compare these outputs and provide feedback, which is then used to fine-tune the models. Please note that this role does not involve building or fine-tuning LLMs. Restrictions * Telecommuting is OK * Agencies are OK Requirements What does day-to-day look like: * Design, develop, and maintain efficient, high-quality Python code to train and optimize AI models. * Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement. * Familiarity with Python frameworks and libraries * Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria. * Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise. * Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets. * Collaborate with researchers and annotators to execute Reinforcement Learning with Human * Feedback (RLHF) and refine reward models. * Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines. * Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy. * Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement. * Collaborate with cross-functional teams to improve model performance and contribute to product enhancements. * Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes. ## Related Videos - [Enterprise Python: Software That Lives Long And Prosper](https://www.wearedevelopers.com/videos/946-enterprise-python-software-that-lives-long-and-prosper) - [Asynchronicity and multithreading in C#](https://www.wearedevelopers.com/videos/447-asynchronicity-and-multithreading-in-c) - [Let's Talk Quality! - Lilia Gargouri](https://www.wearedevelopers.com/videos/1815-let-s-talk-quality-lilia-gargouri) - [Using AI Without Losing Your Skills](https://www.wearedevelopers.com/videos/2045-using-ai-without-losing-your-skills) - [Devouring APIs with Python](https://www.wearedevelopers.com/videos/355-devouring-apis-with-python) - [The weekly developer show: Boosting Python with CUDA, CSS Updates & Navigating New Tech Stacks](https://www.wearedevelopers.com/videos/1293-the-weekly-developer-show-boosting-python-with-cuda-css-updates-navigating-new-tech-stacks) ## Related Articles - [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025) - [7 good reasons why you should learn Python in 2021](https://www.wearedevelopers.com/magazine/19-7-good-reasons-why-you-should-learn-python-in-2021) - [Python Basics](https://www.wearedevelopers.com/magazine/123-python-basics) - [Top 40 Python Developer Interview Questions And Answers](https://www.wearedevelopers.com/magazine/16-top-40-python-developer-interview-questions-and-answers) - [Mastering Remote Work: Tips for Developers](https://www.wearedevelopers.com/magazine/558-mastering-remote-work-tips-for-developers) - [Should senior developers refuse interview coding challenges?](https://www.wearedevelopers.com/magazine/29-should-senior-developers-refuse-interview-coding-challenges)