Government Bid Data Automation Specialist - Web Scraping, APIs & CRM Integration

We are seeking a technical and detail-oriented Government Bid Data Automation Specialist to build and maintain automated workflows for collecting, processing, and organizing public construction procurement opportunities.

The role will focus on extracting project opportunities, bid information, contractor data, and solicitation documents from government procurement platforms and agency websites, converting unstructured information into structured Excel databases, and integrating refined data into our CRM system.

The ideal candidate has experience with web scraping, APIs, PDF/document extraction, data cleaning, and CRM integrations.

Primary Data Sources & Websites

The role will work with public procurement platforms and agency websites, including:

Federal Procurement

• SAM.gov
• U.S. Army Corps of Engineers
• General Services Administration (GSA)

City of New York Agencies

• NYC Department of Design and Construction (DDC)
• NYC Department of Transportation (NYCDOT)
• NYC Department of Environmental Protection (DEP)
• NYC Parks Department
• New York City School Construction Authority (SCA)
• New York City Housing Authority (NYCHA)
• City University of New York (CUNY)

New York State Agencies

• New York State Department of Transportation (NYSDOT)
• Office of General Services (OGS)
• New York State Department of Environmental Conservation (DEC)
• State University of New York (SUNY)

Transportation & Public Authorities

• Metropolitan Transportation Authority (MTA)
• Port Authority of New York and New Jersey (PANYNJ)
• Dormitory Authority of the State of New York (DASNY)
• New York Power Authority (NYPA)

Additional Platforms

• BidNet / BidNet Direct
• BidExpress / Bidx.com
• Agency-specific procurement portals

Responsibilities

• Develop automated methods to collect construction bid opportunities and project information.
• Build API integrations and web scraping tools to extract data from procurement websites.
• Extract information from PDFs including solicitations, advertisements, bid documents, scopes of work, and project requirements.
• Convert extracted information into structured Excel/CSV databases.
• Clean, normalize, and validate data before CRM upload.
• Create workflows to transfer refined data into CRM systems.
• Maintain CRM data accuracy, including duplicate management and field mapping.
• Track changes and updates to procurement opportunities.
• Automate repetitive data collection and reporting processes.
• Document automation workflows and data pipelines.

• Experience with web scraping and data extraction.
• Experience working with APIs and JSON data.
• Experience extracting and processing PDF documents.
• Strong Excel and data-cleaning skills.
• Experience with CRM data import/export and integrations.
• Programming experience with Python preferred.
• Familiarity with automation tools such as Power Automate, Zapier, Make, or similar platforms.
• Strong attention to detail and ability to organize large datasets.

Preferred Experience

• Experience working with government procurement websites.
• Experience with construction bidding, public contracts, or AEC industry data.
• Experience with CRM systems and business development workflows.
• Experience creating automated data pipelines., * Do you have a Bachelors Degree?
• Did you check the websites in the job post and confirmed the ability to scrape it or use API Integration for Lead Generation?

$16 - $22 an hour - Part-time, Full-time, Contract