> Markdown version of [/jobs/ext/3099499-python-developer-associate](https://www.wearedevelopers.com/jobs/ext/3099499-python-developer-associate). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Python Developer - Associate - **Company:** iCapital Network - **Location:** United States (Remote available) - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** JavaScript (Programming Language), Application Programming Interfaces (APIs), Airflow, Amazon Web Services, Amazon S3, Authentication Protocols, Cloud Engineering, Information Engineering, Web Scraping, Extract Transform Load (ETL), Data Transformation, Data Mining, Multi-Factor Authentication, Fault Tolerance, Web Browsers, Identity and Access Management, JSON, Python (Programming Language), Reverse Engineering, Selenium, Software Engineering, Extensible Markup Language (XML), Data Logging, Captcha, State Machines, AWS Lambda, Cloudformation, Integration Tests, Information Technology, Playwright, Build Tools, Asynchronous Programming, Functional Programming, Api Design, Cloudwatch, Terraform, Data Pipelines, Serverless Computing, Docker - **Published:** September 26, 2026 - **Apply:** https://www.dice.com/job-detail/70575521-899f-48e8-8a62-cf5ff6b4c334 ## About the Role * 5+ years of experience in Python development, with a strong focus on automation and data extraction. * Proven expertise in web scraping using tools like Playwright, Selenium, Scrapy, BeautifulSoup, and requests. * In-depth experience handling multi-step authentication flows, including multi-factor authentication (MFA), CAPTCHA solving, and session/cookie management. * Proficient in deploying and managing scraping workloads in AWS, particularly Lambda, S3, IAM, CloudWatch, and Secrets Manager. * Experience with asynchronous programming, headless browsers, and JavaScript-rendered content. * Solid understanding of web protocols (HTTP, HTTPS, cookies, headers), and ability to reverse-engineer network calls and authentication mechanisms. * Comfortable working with APIs, JSON/XML, and data transformation., * Experience with CI/CD pipelines, Docker, and infrastructure as code (e.g., CloudFormation, Terraform). * Familiarity with data pipeline orchestration tools such as Apache Airflow or AWS Step Functions. * Prior experience scraping from secure or enterprise-level portals (e.g., financial, healthcare, legal). * Background in data engineering or ETL workflows is a plus. * Exposure to Python testing frameworks and writing unit/integration tests. Education: * Bachelor's or Master's degree in Computer Science, Software Engineering, or related field, or equivalent professional experience. We believe the best ideas and innovation happen when we are together. Employees in this role will work in the office four days, with the flexibility to work remotely one day (Friday). ## Description We are looking for an experienced Python Developer with expertise in web scraping, automated portal interactions, and cloud-native deployment using AWS. The ideal candidate will have hands-on experience working with Playwright for browser automation, managing multi-factor authentication (MFA) flows, and deploying scalable scraping tasks via AWS Lambda and related services. You will assist in architecting and building robust, secure, and scalable scraping solutions that interact with complex web applications and secured portals., * Assist with the design and implementation of advanced scraping solutions using Python, Playwright, and AWS services. * Automate interactions with JavaScript-heavy and authentication-secured websites, including handling MFA, CAPTCHAs, and session/token-based login flows. * Architect scraping pipelines using serverless AWS components such as Lambda, Step Functions, S3, CloudWatch, and Secrets Manager. * Build systems that scale to support high volumes of data extraction with fault tolerance, retries, and intelligent logging. * Integrate and manage complex workflows across multiple portals, APIs, and data sources. * Contribute to architectural decisions, tooling, and best practices. ## Related Videos - [From clicks to cribs - How to find your dream home with web scraping](https://www.wearedevelopers.com/videos/767-from-clicks-to-cribs-how-to-find-your-dream-home-with-web-scraping) - [Agentic employees in world's most downloaded FinTech app](https://www.wearedevelopers.com/videos/100123-agentic-employees-in-world-s-most-downloaded-fintech-app) - [Docker Compose: Rediscovered](https://www.wearedevelopers.com/videos/1978-docker-compose-rediscovered) - [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json) - [WeAreDevelopers LIVE - Bitpanda’s AI First Approach](https://www.wearedevelopers.com/videos/1841-wearedevelopers-live-bitpanda-s-ai-first-approach) - [Secure and Accessible Login Systems - Ramona Schwering](https://www.wearedevelopers.com/videos/1847-secure-and-accessible-login-systems-ramona-schwering) ## Related Articles - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [The 13 Best Python Libraries for Developers in 2025](https://www.wearedevelopers.com/magazine/371-the-13-best-python-libraries-for-developers-in-2025) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Find a Developer Job: 12 Best Job Sites For Developers](https://www.wearedevelopers.com/magazine/165-find-a-developer-job-12-best-job-sites-for-developers) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 137 - AI'm not sure about this](https://www.wearedevelopers.com/magazine/485-dev-digest-137-ai-m-not-sure-about-this)