Senior Software Engineer- Big Data & MCP, Data Foundations

RevSpring Inc
Portland, OR, United States
3 days ago
Apply on www.careerbuilder.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours

Tech stack

Query Performance Java (Programming Language) Application Programming Interfaces (APIs) Artificial Intelligence Airflow Data Analysis Apache HTTP Server Big Data BigQuery Code Review Databases Continuous Integration
+37 more
Data as a Services Data Cleansing Information Engineering Data Files Data Infrastructure Extract Transform Load (ETL) Data Warehousing Relational Databases Elasticsearch Data Flow Control Github Information Retrieval Java Virtual Machine (JVM) Python (Programming Language) Simple Object Access Protocol (SOAP) Software Engineering Datadog Data Logging Pulumi Google Cloud Sql Optimization Great Expectations (Foster Youth College-readiness and Support Program) Fast Healthcare Interoperability Resources SOAPAPI Indexer Backend Git Containerization Health Level Seven International Apache Kafka Data Management Data Delivery Model Context Protocol Terraform Data Pipelines Apache Beam Docker

Job description

  • Collaborate and Innovate: Partner with product managers, data engineers, and business leaders to translate complex product and data requirements into scalable, reliable data pipelines and the search experiences they power.
  • Architect Data Pipelines: Design, build, and optimize large-scale distributed batch and streaming pipelines (using Apache Airflow, Apache Beam/Dataflow, and DBTon BigQuery) to ingest, model, and transform high-volume healthcare data into clean, well-tested, query-ready datasets and search indices.
  • Build Data Models & Backend Services: Develop resilient Python services and DBT models that power data delivery and self-service analytics, including Model Context Protocol (MCP) servers that expose curated data and tooling to downstream and AI consumers, and integrate with external REST/SOAP APIs and third-party data sources.
  • Optimize Data & Search Performance: Deeply tune pipeline throughput, data warehouse performance, and search indexing - optimizing BigQuery cost and query performance and Elasticsearch index design to ensure data freshness, relevance, and scalability across high-volume datasets.
  • Drive Engineering Excellence: Write clean, maintainable, well-tested code and lead by example through rigorous code reviews, architectural and data-modeling design discussions, and mentoring, driving a culture of high-quality software and trustworthy data.
  • Pioneer New Technologies: Stay at the forefront of modern data engineering, the analytics-engineering ecosystem (e.g., DBT, BigQuery), and information retrieval, proactively applying these advancements to strengthen our data platform and the products it powers., Ability to read, analyze and interpret general business periodicals, professional journals, technical procedures or governmental regulations. Ability to write reports, business correspondence and procedure manuals. Ability to effectively present information and respond to questions from a variety of both internal and external sources. Physical Capabilities: Standard categories The physical capabilities described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.

Requirements

MCP - Microsoft Certified Professional, Software Engineering, Big Data, Data Management, Data Sets, Apache, Healthcare, Data Cleaning, SOAP (Simple Object Access Protocol), Application Programming Interface (API), * Data Engineering: Proven experience designing and orchestrating large-scale ETL/ELT pipelines using Apache Beam/Google Cloud Dataflow (or similar), and DBT, built on modern cloud data warehouses. BigQuery experience is a plus.

  • Databases & SQL: 4+ years of experience working with relational databases and analytical data warehouses, with deep, advanced SQL skills and solid data-modeling fundamentals (e.g., dimensional and normalized modeling).
  • Search & Indexing: Working experience with search indexing and Elasticsearch, including index management, mappings, and building and maintaining search indices from pipeline output. Familiarity with hybrid (BM25 + semantic/vector) search is a plus.
  • Backend & Data Services: Experience building scalable Python services and high-performance data APIs, including developing Model Context Protocol (MCP) servers that expose data and tooling to downstream and AI consumers.
  • Infrastructure & DevOps: Strong understanding of containerization (Docker), CI/CD methodologies (e.g., GitHub Actions), Git, Infrastructure as Code (e.g., Terraform/Pulumi), and managing services within cloud platforms (3+ years of GCP experience preferred).

*

  • Familiarity with healthcare data standards (e.g., NPPES/NPI registries, NUCC Provider Taxonomy, machine-readable files (MRFs) for cost transparency, and FHIR).
  • Experience with data quality and pipeline testing frameworks (e.g., dbt tests, Great Expectations) and streaming/event ingestion (e.g., Pub/Sub, Kafka).
  • Experience integrating graph-based data and healthcare taxonomy ontologies to enrich datasets and search query context.
  • Experience with observability and logging platforms (e.g., DataDog) for monitoring pipeline health and data freshness.

Education: Bachelor’s Degree Experience: 5+ years of professional experience with Python, with strong software-engineering fundamentals (testing, code review, design). 3+ years experience with Java or another JVM language is also high desired, particularly for Beam/Dataflow., While performing the duties of this job, the employee is regularly required to sit; use hands to finger, handle, or feel; reach with hands and arms; and talk or hear. The employee is occasionally required to stand and walk. The employee must occasionally lift and/or move up to 10 pounds. Specific vision abilities required by this job include close vision, distance vision, color vision, peripheral vision, depth perception, and ability to adjust focus.

About the company

RevSpring is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerbuilder.com
Prepare application

Good distractions

Loading talks and stories from around this role…