Software Engineer, LLM & Automation

Basis Research Institute
New York, NY, United States
2 days ago
Apply on startup.jobs
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Artificial Intelligence Amazon Web Services Applicant Tracking Systems Microsoft Azure Cloud Computing Databases Concurrent Computing Continuous Integration Distributed Systems JSON Python (Programming Language)
+17 more
Key Management PostgreSQL Multiprocessing OAuth Open Source Technology Performance Tuning Scientific Computating Flask (Web Framework) Large Language Models Fastapi Event Driven Architecture Kubernetes Production Code Celery GPT Docker Microservices

Job description

We’re seeking Software Engineers to develop scalable systems that integrate large language models (LLMs) with our everyday operational workflows. This role involves designing and deploying automated “pipelines” for tasks like recruiting, finance, and project management-often powered by GPT, Claude, or similar LLMs. We’re flexible on your arrangement: we’re hiring contractors, part-time, or full-time teammates., * Architect and maintain automation pipelines combining internal tools with GPT/Claude and other LLMs

  • Integrate data across third-party APIs (e.g., ATS platforms, Slack, Google) into unified, automated workflows
  • Leverage structured generation (JSON schemas, function calling, etc.) to ensure robust, correct LLM outputs
  • Collaborate with Ops and R&D to identify high-impact automation opportunities
  • Write production-grade code, with emphasis on modularity, reliability, and error handling
  • Deploy, scale, and optimize your solutions in a secure, cloud-based environment
  • Document solutions for both technical and non-technical audiences, ensuring easy updates and maintenance

Requirements

  • Have experience programming in Julia and/or Python (3+ years of production-level coding, or equivalent)
  • Understand how to integrate LLMs using structured prompts, scaffolding frameworks (LangChain-like), or advanced text generation approaches
  • Can handle concurrency, scaling, and performance optimizations in real-world deployments
  • Are comfortable with complex API orchestration: dealing with rate limits, OAuth, error retries, etc.
  • Have good collaboration and communication skills, especially when gathering requirements from non-technical staff
  • Are flexible and creative problem solvers, comfortable with iterative, experimental development cycles
  • Embrace data-security best practices (e.g., handling PII, encryption, secrets management)
  • Are excited to learn quickly and adapt to new developments in the LLM/AI ecosystem

Technical Skills

Preferred (not all required):

  • Julia: Type-driven or multiple-dispatch approaches; performance tuning, HPC, or scientific computing workflows
  • Python: Building microservices with FastAPI, Flask, or other frameworks; advanced concurrency (async, multiprocessing)
  • LLM Tools & Frameworks: Familiarity with LangChain, open source LLM clients, or custom chain-of-thought integrations
  • Cloud Infrastructure: Docker/Kubernetes, CI/CD pipelines, AWS/GCP/Azure deployment patterns
  • Distributed Systems & Queues: Experience with concurrent processing, task queues (Celery, Sidekiq), or event-driven systems
  • Database Interaction: Ability to design schemas and queries in PostgreSQL or similar databases
  • Security & Privacy: Understanding of OAuth flows, secrets management, data encryption, and role-based access controls

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on startup.jobs
Prepare application

Good distractions

Talks and stories from around this role — technically off-topic, practically not.

5:30 min

Building components of a real-world LLM lifecycle

Maxim Salnikov Maxim Salnikov · LIVE

40 sec

Generative pre-trained transformer models powering code completions

lgonta lgonta +1 · World Congress 2024

3:47 min

Exploring JSON, CBOR, and JOSE for data serialization

Aaron Russell · LIVE

2:49 min

Adopting OAuth best practices and removing outdated grants

Alexander Schwartz Alexander Schwartz · World Congress 2026 Europe

2:08 min

Applying large language models to infrastructure tasks

Alfonso Sandoval Rosas Alfonso Sandoval Rosas · Europe 2026 Virtual

51 sec

Assessing GPT-4o performance for pull request feedback

Merrill Lutsky Merrill Lutsky · World Congress 2025

Videos

See all

Related articles

See all