Senior Data Engineer
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+23 more
Job description
Our Senior Data Engineer will work as part of a team supporting a serverless, AWS-based web application the Postgres data layer it runs on, the migrations that evolve it, and the retrieval pipeline behind its generative AI features. You will use your passion for data, background in problem solving, and customer engagement to advance the build of this platform and its associated environment., * Working with the team to design and maintain the applicationβs Postgres data model on AWS RDS, including schema design, indexing strategy, and query optimization.
- Writing and reviewing SQLAlchemy models and queries, and developing Alembic migrations that run cleanly across environments.
- Supporting the vector search and similarity search capabilities behind the applicationβs generative AI features.
- Helping build and maintain ingestion and embedding pipelines that integrate with AWS Bedrock, with inline verification and validation.
- Supporting data flows for both structured relational data and unstructured document content.
- Contributing to CI/CD pipelines in Jenkins and CloudBees.
- Working within GitHub repositories and the teamβs code review process.
- Evaluating data models and making optimization recommendations as usage and data volume grow.
- Working within AWS GovCloud constraints, including IAM security and Role Based Access Control (RBAC).
- Partnering closely with application engineers and other IT units to improve the overall computing environment.
Requirements
- ship required to obtain DHS Public Trust
- Bachelorβs degree +3 years of relevant experience
- Python and AWS RDS experience, * 3+ years industry experience with software development projects and a passion for solving complex problems.
- Expertise in Python.
- Production experience with SQLAlchemy and Alembic, including writing and troubleshooting migrations against live databases.
- Advanced working SQL knowledge with PostgreSQL specifically - query authoring, execution plan analysis, indexing, and performance tuning.
- Experience with AWS serverless services (Lambda, API Gateway, Step Functions, S3) and AWS RDS.
- Hands-on experience with vector search and embeddings - PGVector, OpenSearch Serverless, or a comparable vector store.
- Experience integrating with AWS Bedrock or comparable LLM and embedding APIs.
- Experience building and maintaining CI/CD pipelines, ideally with Jenkins and CloudBees, and working in GitHub-hosted repositories.
- Experience with APIs (REST, JDBC) and data formats (JSON, XML, CSV).
- Familiarity with AWS IAM security and Role Based Access Control (RBAC).
About the company
Amiveroβs team of IT professionals delivers digital services that elevate the federal government, whether national security or improved government services. Our human-centered, data-driven approach is focused on truly understanding the environment and the challenge, and reimagining with our customer how outcomes can be achieved.
Our team of technologists leverage modern, agile methods to design and develop equitable, accessible, and innovative data and software services that impact hundreds of millions of people.
As a member of the Amivero team you will use your empathy for a customerβs situation, your passion for service, your energy for solutioning, and your bias towards action to bring modernization to very important, mission-critical, and public service government IT systems.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦