Data Engineer Lead

VSE Aviation
Miramar, FL, United States
3 days ago
Apply on www.careerboard.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours

Tech stack

Query Performance Microsoft Azure Continuous Integration Data Governance Data Integration Extract Transform Load (ETL) Data Systems Github Meta-Data Management Microsoft SQL Server Oracle (Applications) Power BI
+17 more
SQL Databases Data Streaming Unstructured Data Azure Service Bus Data Storage Technologies Azure Data Factory Snowflake Change Data Capture Microsoft Fabric Containerization Infrastructure Automation Frameworks Information Technology Apache Kafka Data Lakehouse Restful APIs Data Pipelines Databricks

Job description

  • Design, implement, and evolve the organization’s enterprise Data Lake/Data Lakehouse architecture.
  • Build and maintain a scalable Medallion Architecture (Bronze, Silver, Gold) for trusted, reusable data assets.
  • Develop ingestion frameworks for structured, semi-structured, and streaming data sources.
  • Create scalable ELT/ETL pipelines using cloud-native technologies and orchestration tools including Informatica and Azure Data Factory.
  • Design dimensional models, curated data products, and semantic layers to support Business Intelligence and advanced analytics.
  • Implement data quality, lineage, cataloging, and metadata management best practices.
  • Optimize data storage, query performance, and workload management.
  • Establish CI/CD pipelines and Infrastructure-as-Code practices for data engineering solutions.
  • Collaborate with business stakeholders and application teams to understand data requirements and deliver scalable solutions.
  • Define and help enforce enterprise data engineering standards with technical and business partners.
  • Work with security and governance teams to implement role-based security, data privacy, and compliance controls.

Requirements

  • Bachelor’s degree in computer science, MIS, engineering, or a related field.
  • Or an additional 3 years of specific work experience in lieu of degree.
  • 7 years of significant experience in an enterprise data engineering role.
  • Strong professional proficiency in SQL.
  • Proven technical experience with one or more: Snowflake, Microsoft Fabric, Databricks.
  • Data Governance, Data Systems Architecture, and Data Modeling experience.

Technologies

  • Snowflake, Microsoft Fabric, Databricks
  • Informatica, Azure Data Factory
  • SQL, MSFT SQL Server, Oracle
  • Microsoft Azure
  • Power BI
  • Microsoft Purview
  • Azure DevOps, GitHub Actions
  • Kafka, Event Hubs
  • REST APIs
  • CI/CD, Infrastructure-as-Code

Preferred Requirements

  • Informatica and Azure Data Factory
  • MSFT SQL Server and Oracle
  • Microsoft Azure
  • Power BI
  • Golden Gate/Change Data Capture/Data Streaming
  • Aviation/Aerospace ERP
  • Structured, semi-structured, and unstructured data warehousing
  • Microsoft Purview
  • Azure DevOps or GitHub Actions
  • Kafka or Event Hubs
  • REST APIs and modern data integration techniques

Other

  • Background check and drug testing required.
  • Travel within the US and internationally may be required 10-25% of the time.
  • Ability to work from a VSE office at least four days per week (onsite location: Miramar, FL).

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.careerboard.com
Prepare application

Good distractions

Loading talks and stories from around this role…