Data Engineer
Zachary Piper
Norfolk, VA, United States
2 days ago
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Apply on www.clearancejobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Experienced
Experience required
3 years minimum
Compensation
$90,000.0 - $100,000.0
Working hours
Regular working hours
Job source
Tech stack
Microsoft Azure
Cloud Computing
Cloud Database
Information Systems
Computer Programming
Databases
Information Engineering
Data Integration
Extract Transform Load (ETL)
Data Transformation
Data Migration
Data Mining
+27 more
Data Normalization
Data Stores
Data Visualization
Data Warehousing
Database Development
Database Queries
Information Security Management
Information Systems Security Architecture Professional
Python (Programming Language)
Microsoft SQL Server
Network Connections
Windows PowerShell
Power BI
SQL Databases
SQL Server Integration Services
Data Streaming
Systems Integration
Transact-SQL
Extensible Markup Language (XML)
Enterprise Data Management
Enterprise Software Applications
Data Ingestion
Azure Data Factory
SC Clearance
Tools for Reporting
Splunk
Data Pipelines
Job description
- Design, develop, & maintain Azure-based data pipelines using Azure Data Factory (ADF) to ingest, transform, stage, aggregate, & prepare data for enterprise reporting
- Connect & integrate legacy, disparate, & enterprise systems, establishing reliable data flows between databases, repositories, & downstream reporting platforms
- Analyze new & unclean datasets to determine appropriate data ingestion, transformation, storage, staging, & aggregation strategies
- Develop & optimize SQL queries & database solutions to support data extraction, transformation, validation, & reporting requirements
- Support the development of Power BI dashboards & reports, ensuring reporting tools are fed with accurate, clean, & properly structured data
- Troubleshoot & resolve data pipeline and integration issues while ensuring data quality, reliability, security, & performance
- Collaborate with technical teams to identify opportunities for ETL, data integration, automation, & business intelligence improvements, Keywords: Data Engineering, Data Engineer, Azure Data Engineer, Data Engineering, Data Pipeline, Data Pipelines, Data Integration, Data Transformation, Data Ingestion, Data Staging, Data Aggregation, ETL, ELT, Enterprise Data, Data Migration, Cloud, Azure, Microsoft Azure, Azure Data Factory, ADF, Azure Data Pipelines, Azure Data Engineering, Cloud Data Engineering, Database, SQL, SQL Server, SQL Databases, T-SQL, Database Development, Database Integration, Data Extraction, Data Warehousing, Business Intelligence, Power BI, BI, Reporting, Dashboards, Data Visualization, Enterprise Reporting, ETL, Integration, ETL, SSIS, Data Integration, System Integration, Legacy System Integration, Data Connectivity, Data Repositories, Data Transformation, Programming / Supporting: Python, PowerShell, XML, Splunk, Automation, DOD Secret, Active Secret Clearance, Security+, IAT Level II, 8570, DoD 8570, CASP, CISSP, CASP+ CE, CASP+ce, certified information systems security professional, certified informations systems security professional, certified information system security professional, certified advanced security practitioner, comptia casp, comptia CASP+, Iat III, iat level iii, iat3, iat 3, iat level three, iat three, iatthree, iat3, CISA, GCED, GCIH, certified information systems auditor, certified information system auditor, GIAC Certified enterprise defender, GIAC certified incident handler, dod cleared, dod clearance, secret clearance, secret, secret cleared, secret security clearance, security clearance, security cleared
Requirements
- 3-4+ years of hands-on Data Engineering experience, with a focus on enterprise data transformation, staging, aggregation, & pipeline development
- Hands-on experience developing Azure Data Factory (ADF) pipelines and integrating data from multiple systems and databases
- Strong experience with SQL & SQL databases, including writing queries and working directly with enterprise data
- Hands-on experience with Power BI, including developing reports/dashboards and working with the underlying data
- Experience with ETL, data integration, data transformation, data staging, & data aggregation
- Experience connecting legacy and/or disparate systems and moving data between systems and repositories
- Ability to independently evaluate unfamiliar datasets and determine how to ingest, transform, store, & prepare data for reporting
- Active DoD Secret security clearance
- IAT Level II certification
- Experience with Python, PowerShell, XML, SSIS, Splunk, or Azure/cloud data environments is a plus
Benefits & conditions
- Salary: $90,000-$100,000 depending on experience
- Benefits: Medical, Dental, Vision, 401k Plan, Holidays, PTO, sick leave as required by law
About the company
Zachary Piper Solutions is seeking a Data Engineer to support the U.S. Navy. This role is 100% onsite in Norfolk, VA; San Diego, CA; or Jacksonville, FL. The Data Engineer will design, build, and maintain Azure-based data pipelines that ingest, transform, stage, aggregate, and prepare data for enterprise reporting. This role combines hands-on Azure Data Factory (ADF), SQL, data integration, ETL, and Power BI to connect disparate systems and turn new or unstructured data into reliable, actionable information.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Apply on www.clearancejobs.com
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Talks and stories from around this role — technically off-topic, practically not.
Moments
Explore playlistsVideos
See allRelated articles
See all
EM
Eli McGarvie
about 3 years ago
AJ
Austin Joy
What Are The Top Skills Required For Azure Developers?
over 4 years ago
EM
Eli McGarvie
Highest Paying Tech Companies for Developers
over 3 years ago
BB
Benedikt Bischof
Making Data Warehouses Fast: A Developer’s Story
about 4 years ago
LM
Luis Minvielle
The Most Popular IT Jobs on the Market
over 2 years ago
LM
Luis Minvielle
Top-Paying Tech Jobs (with Salaries)
over 2 years ago