Full-Stack Data Engineer - Mid

Nalley Consulting
Doral, United States of America
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Intermediate

Job location

Doral, United States of America

Tech stack

API
Amazon Web Services (AWS)
Data analysis
ArcGIS (Software)
User Authentication
Cloud Computing
Cloud Database
Databases
Information Engineering
Data Integration
Data Retrieval
Data Security
Data Visualization
Identity and Access Management
Interoperability
Role-Based Access Control
Web Application Security
Systems Integration
Web Services
Esri GIS (Software)
Data Storage Technologies
Azure
Delivery Pipeline
Database Optimization
Indexer
Containerization
Data Lake
Kubernetes
Information Technology
Data Analytics
GraphQL
REST
Data Pipelines
Api Management
Databricks

Job description

  • Develop and maintain the data pipeline infrastructure, ensuring scalable ingestion, transformation, and integration of structured and unstructured datasets within the cloud-based CIP platform.
  • Optimize data storage strategies, implementing efficient query execution, indexing, and retrieval techniques for high-volume mission datasets.
  • Integrate APIs for secure data sharing across operational environments, ensuring controlled access and compliance with security frameworks.
  • Submit the Data Pipeline Optimization Report, detailing improvements in ingestion speed, storage efficiency, and API integrations.
  • Integrate all ingestion and transformation workflows with the Identity and Access Management (IAM) framework provisioned under IAM Engineers
  • Coordinate with the IAM Engineer team to define required roles, enforce RBAC policies, and maintain compliance with authentication and access standards across IL environments., * AWS Certified Data Analytics - Specialty, Microsoft Certified: Azure Data Engineer Associate, or ESRI ArcGIS Developer Certification.

Requirements

Do you have experience in Systems integration?, Do you have a Bachelor's degree?, Required education: Bachelor's degree in Computer Science, Data Engineering, or a related field, or five (5) years of equivalent experience in full-stack development and data engineering., * Possess the knowledge and capability to develop, maintain, and optimize data integration pipelines, API services, and front-end interfaces for accessing and visualizing geospatial and structured data.

  • Must be proficient in Data Lakes splatforms such as Databricks, Kubernetes, ESRI ArcGIS environments, and cloud-based data engineering.
  • Expertise in building scalable, secure web applications, implementing metadata-driven search and retrieval features, and integrating APIs for seamless data interoperability is required.
  • Must have demonstrated experience in developing and deploying full-stack applications that enable data visualization, dashboarding, and analytics within ESRI-based GIS platforms, Unity Catalog, and cloud-based databases.
  • Must have demonstrated experience in implementing RESTful and GraphQL APIs for seamless data retrieval and integration between Data Lake, ESRI ArcGIS, and external sources.
  • Must have demonstrated experience in managing CI/CD pipelines, containerized deployments in Kubernetes, and API authentication mechanisms to ensure secure access to research products.
  • Must have demonstrated experience in optimizing database queries and indexing strategies for large-scale geospatial and structured datasets.

Benefits & conditions

Pulled from the full job description

  • Flextime
  • Tuition reimbursement
  • Paid parental leave
  • Parental leave
  • Health insurance
  • 401(k) matching
  • Paid time off, Nalley Consulting is a Service Disabled Veteran Owned Small Business working with prime partners to staff Department of Defense and Intelligence Community positions. Created by a U.S. Navy intelligence veteran, Nalley Consulting has grown to include multiple IDIQ vehicles in several states.

Nalley Consulting fringe benefits include:

  • Excellent medical, dental, and vision benefits
  • PTO
  • 11 paid federal holidays
  • Tuition assistance
  • Paid military-reserve leave
  • Paid parental leave for birth or adoption
  • 401k matching up to 5 percent of the base salary
  • Flex time
  • Company-paid short-term disability, long-term disability, and life insurance.

5QLqQlofSb

Apply for this position