Senior Data Engineer

Amivero LLC
United States
4 days ago
Apply on www.dice.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
3 years minimum
Working hours
Regular working hours
Job source

Tech stack

Application Programming Interfaces (APIs) Amazon Web Services Amazon S3 Code Review Encodings Databases Relational Databases Github Identity and Access Management Java Database Connectivity JSON Python (Programming Language)
+23 more
PostgreSQL Performance Tuning Query Optimization Role-Based Access Control Standard Sql Search Technologies Software Engineering Verification and Validation (Software) SQLAlchemy Data Streaming Web Applications Extensible Markup Language (XML) Cloudbees Large Language Models State Machines Indexer Data Layers Amazon Relational Database Service Pgvector Api Gateway Serverless Computing OpenSearch Jenkins

Job description

Our Senior Data Engineer will work as part of a team supporting a serverless, AWS-based web application the Postgres data layer it runs on, the migrations that evolve it, and the retrieval pipeline behind its generative AI features. You will use your passion for data, background in problem solving, and customer engagement to advance the build of this platform and its associated environment., * Working with the team to design and maintain the application’s Postgres data model on AWS RDS, including schema design, indexing strategy, and query optimization.

  • Writing and reviewing SQLAlchemy models and queries, and developing Alembic migrations that run cleanly across environments.
  • Supporting the vector search and similarity search capabilities behind the application’s generative AI features.
  • Helping build and maintain ingestion and embedding pipelines that integrate with AWS Bedrock, with inline verification and validation.
  • Supporting data flows for both structured relational data and unstructured document content.
  • Contributing to CI/CD pipelines in Jenkins and CloudBees.
  • Working within GitHub repositories and the team’s code review process.
  • Evaluating data models and making optimization recommendations as usage and data volume grow.
  • Working within AWS GovCloud constraints, including IAM security and Role Based Access Control (RBAC).
  • Partnering closely with application engineers and other IT units to improve the overall computing environment.

Requirements

  • ship required to obtain DHS Public Trust
  • Bachelor’s degree +3 years of relevant experience
  • Python and AWS RDS experience, * 3+ years industry experience with software development projects and a passion for solving complex problems.
  • Expertise in Python.
  • Production experience with SQLAlchemy and Alembic, including writing and troubleshooting migrations against live databases.
  • Advanced working SQL knowledge with PostgreSQL specifically - query authoring, execution plan analysis, indexing, and performance tuning.
  • Experience with AWS serverless services (Lambda, API Gateway, Step Functions, S3) and AWS RDS.
  • Hands-on experience with vector search and embeddings - PGVector, OpenSearch Serverless, or a comparable vector store.
  • Experience integrating with AWS Bedrock or comparable LLM and embedding APIs.
  • Experience building and maintaining CI/CD pipelines, ideally with Jenkins and CloudBees, and working in GitHub-hosted repositories.
  • Experience with APIs (REST, JDBC) and data formats (JSON, XML, CSV).
  • Familiarity with AWS IAM security and Role Based Access Control (RBAC).

About the company

Amivero’s team of IT professionals delivers digital services that elevate the federal government, whether national security or improved government services. Our human-centered, data-driven approach is focused on truly understanding the environment and the challenge, and reimagining with our customer how outcomes can be achieved.

Our team of technologists leverage modern, agile methods to design and develop equitable, accessible, and innovative data and software services that impact hundreds of millions of people.

As a member of the Amivero team you will use your empathy for a customer’s situation, your passion for service, your energy for solutioning, and your bias towards action to bring modernization to very important, mission-critical, and public service government IT systems.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.dice.com
Prepare application

Good distractions

Loading talks and stories from around this role…