Data Engineer Lead
VSE Aviation
Miramar, FL, United States
3 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.careerboard.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
7 years minimum
Working hours
Regular working hours
Job source
Tech stack
Query Performance
Microsoft Azure
Continuous Integration
Data Governance
Data Integration
Extract Transform Load (ETL)
Data Systems
Github
Meta-Data Management
Microsoft SQL Server
Oracle (Applications)
Power BI
+17 more
SQL Databases
Data Streaming
Unstructured Data
Azure Service Bus
Data Storage Technologies
Azure Data Factory
Snowflake
Change Data Capture
Microsoft Fabric
Containerization
Infrastructure Automation Frameworks
Information Technology
Apache Kafka
Data Lakehouse
Restful APIs
Data Pipelines
Databricks
Job description
- Design, implement, and evolve the organizationβs enterprise Data Lake/Data Lakehouse architecture.
- Build and maintain a scalable Medallion Architecture (Bronze, Silver, Gold) for trusted, reusable data assets.
- Develop ingestion frameworks for structured, semi-structured, and streaming data sources.
- Create scalable ELT/ETL pipelines using cloud-native technologies and orchestration tools including Informatica and Azure Data Factory.
- Design dimensional models, curated data products, and semantic layers to support Business Intelligence and advanced analytics.
- Implement data quality, lineage, cataloging, and metadata management best practices.
- Optimize data storage, query performance, and workload management.
- Establish CI/CD pipelines and Infrastructure-as-Code practices for data engineering solutions.
- Collaborate with business stakeholders and application teams to understand data requirements and deliver scalable solutions.
- Define and help enforce enterprise data engineering standards with technical and business partners.
- Work with security and governance teams to implement role-based security, data privacy, and compliance controls.
Requirements
- Bachelorβs degree in computer science, MIS, engineering, or a related field.
- Or an additional 3 years of specific work experience in lieu of degree.
- 7 years of significant experience in an enterprise data engineering role.
- Strong professional proficiency in SQL.
- Proven technical experience with one or more: Snowflake, Microsoft Fabric, Databricks.
- Data Governance, Data Systems Architecture, and Data Modeling experience.
Technologies
- Snowflake, Microsoft Fabric, Databricks
- Informatica, Azure Data Factory
- SQL, MSFT SQL Server, Oracle
- Microsoft Azure
- Power BI
- Microsoft Purview
- Azure DevOps, GitHub Actions
- Kafka, Event Hubs
- REST APIs
- CI/CD, Infrastructure-as-Code
Preferred Requirements
- Informatica and Azure Data Factory
- MSFT SQL Server and Oracle
- Microsoft Azure
- Power BI
- Golden Gate/Change Data Capture/Data Streaming
- Aviation/Aerospace ERP
- Structured, semi-structured, and unstructured data warehousing
- Microsoft Purview
- Azure DevOps or GitHub Actions
- Kafka or Event Hubs
- REST APIs and modern data integration techniques
Other
- Background check and drug testing required.
- Travel within the US and internationally may be required 10-25% of the time.
- Ability to work from a VSE office at least four days per week (onsite location: Miramar, FL).
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.careerboard.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦