Generative AI Data Engineer

Talascend LLC
Washington, United States of America
2 days ago

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate
Compensation
$ 110K

Job location

Remote
Washington, United States of America

Tech stack

Agile Methodologies
Artificial Intelligence
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Azure
Bash
Continuous Integration
Information Engineering
Data Integration
Amazon DynamoDB
Github
Identity and Access Management
Python
Microsoft SQL Server
SQL Azure
Open Source Technology
PCI Data Security Standards
Performance Tuning
Powershell
Systems Development Life Cycle
Query Optimization
Role-Based Access Control
Search Technologies
Solr
SQL Stored Procedures
SQL Databases
SQL Server Integration Services
Systems Integration
Data Ingestion
Large Language Models
Spark
Software Troubleshooting
Multi-Cloud
Generative AI
Indexer
Firewalls (Computer Science)
Amazon Web Services (AWS)
Cloudformation
Apache Flume
Infrastructure Automation Frameworks
Information Technology
Data Lineage
HuggingFace
Amazon Web Services (AWS)
Bicep
Amazon Web Services (AWS)
Kafka
REST
Terraform
Data Pipelines
Jenkins
Databricks

Job description

This role involves designing and implementing innovative, AI-driven automation solutions across cloud environments, building intelligent data pipelines, and integrating Generative AI technologies to support analytics and reporting platforms. The candidate will work remotely with quarterly travel to Washington, D.C., * Design and maintain data pipelines in AWS using services such as S3, RDS/SQL Server, Glue, Lambda, EMR, DynamoDB, and Step Functions

  • Develop ETL/ELT processes to transfer data between multiple systems including DynamoDB, SQL Server (AWS), and Azure SQL
  • Integrate AWS Connect CRM data into enterprise data pipelines for analytics and operational reporting
  • Engineer ingestion pipelines with Apache Spark, Flume, Kafka for real-time and batch processing
  • Leverage Generative AI services (AWS Bedrock, Amazon Q, Azure OpenAI, Hugging Face, LangChain) to automate vector generation, data quality checks, and enhance ingestion processes
  • Build conversational BI interfaces for natural language access to data
  • Develop AI-powered copilots for pipeline monitoring and troubleshooting
  • Implement SQL Server stored procedures, indexing, query optimization, and performance tuning
  • Apply CI/CD practices using GitHub, Jenkins, or Azure DevOps for data pipelines and AI model integration
  • Maintain security and compliance using IAM, KMS encryption, VPC, RBAC, and firewalls
  • Support Agile DevOps through sprint-based delivery of data and AI features

Requirements

  • BS in Computer Science or related field
  • 2+ years of data engineering and automation experience
  • Hands-on experience with SQL, SSIS, Python, Spark, Bash, PowerShell, AWS/Azure CLIs
  • Experience with AWS services such as S3, RDS/SQL Server, Glue, Lambda, EMR, DynamoDB
  • Familiarity with Apache Flume, Kafka, Solr for data ingestion and search
  • Knowledge of LLM, Generative AI frameworks with AWS Bedrock, Azure OpenAI, or open source tools
  • Experience integrating REST APIs in data workflows
  • Proficiency with SDLC tools like JIRA, GitHub, Azure DevOps, Jenkins
  • Strong troubleshooting and performance optimization skills
  • Experience operationalizing Generative AI pipelines including deployment and lifecycle management
  • Ability to obtain Federal Public Trust clearance, * Certifications such as AWS Data Engineer, AWS AI/ML Specialty, Azure AI Engineer, Databricks Data Engineer
  • Experience implementing RAG pipelines, embeddings, and vector search technologies
  • Knowledge of multi-cloud data integration (AWS and Azure SQL)
  • Experience with coding tools for GenAI, such as Claude Code, OpenAI Codex, VS Code
  • Familiarity with data lineage and governance tools (e.g., Purview, Unity Catalog, AWS Glue Catalog)
  • Experience with Infrastructure-as-Code tools like Terraform, CloudFormation, or Bicep
  • Knowledge of compliance frameworks such as FedRAMP, PCI-DSS, HIPAA

Benefits & conditions

Pay range is not a guarantee of compensation or salary, as final offer amount may vary based on factors including but not limited to experience and geographic location. Talascend also offers a variety of benefits including: health and disability insurance, 401(k), EAP, paid time off, and company-paid holidays. The specific programs and options available to an employee may vary depending on date of hire, plan requirements, schedule type, and client work site mandates.

Apply for this position