Data Engineer

The Data Engineer (DE) works with the Sponsor, Mission Partners, Platform and Operations team to engineer, install, operation, and sustain database/repositories (data lake, lake house, specialized databases) to include the data lifecycle from acquisition and ingest through curation and disposition. The DE ensures the data collections are processed from time of delivery at the landing zone. The DE works with Mission Partners to support their metrics, analytics, and dissemination. Daily tasks include, but are not limited to:

• Develop and maintain data and metadata policies and procedures for structural design and development to build, maintain and leverage the unified data storage, data lake, and lake house. ensuring integration with SYSTEM data standards.

• Engineer the design, development, deployment, implementation and support of major databases and metadata structures to include the review and evaluation of database performance and optimization.

• Develop plans for, and tools to enhance, the transition of legacy data to the SYSTEM during install as well as transition of development and/or production environment to new technology

• Recommend and plan server/ cloud compute/storage resource recapitalization for Sponsor consideration

• Provide comprehensive assessments of the technical characteristics of proposed installations and alternatives considered to optimize database performance

• Develop methods of ensuring data incompatibilities among systems are systematically eliminated

• Diagnose, isolate and expediently resolve complex problems pertaining to data infrastructure

• Baseline and forecast server performance data; refine server hardware and software configurations

• Manage, monitor and administer database system performance/schedule activities; oversee daily performance; perform backups/restores; archive data; provide technical assistance and support

• Monitor industry trends and directions in database technology and tools; develop and present substantive technical recommendations to the Sponsor.

• Compose technical documents including Design, Deployment, System specifications and Mission Partner baselines, updates, user's manuals, training materials, installation guides, proposals, and reports.

• SQL: Proficiency in writing and executing SQL queries for data manipulation and analysis.

• Data Modeling: Understanding of data modeling principles and ability to design data structures that meet business requirements.

• ETL/ELT Processes: Experience with Extract, Transform, and Load (ETL) or Extract, Load, and Transform (ELT) processes and tools.

• Cloud Platforms: Familiarity with cloud computing platforms such as AWS, Azure, or Google Cloud Platform.

• Programming Languages: Proficiency in Python or Java for data manipulation and scripting.

• Data Warehousing: Understanding of data warehousing concepts and experience with data warehouse technologies.

• Data Governance and Security: Knowledge of data governance principles and best practices for data security and privacy.

Desired Skills:

• Big Data Technologies: Experience with technologies like Apache Hadoop, Spark, or Kafka.

• Data Visualization: Ability to create data visualizations using tools like Tableau or Power BI.

• Data Pipeline Orchestration: Experience with data pipeline orchestration tools like Airflow or Luigi.

• Data Quality Tools: Familiarity with data quality tools and techniques for identifying and resolving data quality issues.

• Data Wrangling: Experience with data wrangling techniques for cleaning, transforming, and preparing data for analysis.

_At Nightwing, we value collaboration and teamwork. You'll have the opportunity to work alongside talented individuals who are passionate about what they do. Together, we'll leverage our collective expertise to drive innovation, solve complex problems, and deliver exceptional results for our clients._ _Thank you for considering joining us as we embark on this new journey and shape the future of cybersecurity and intelligence together as part of the Nightwing team._ _Nightwing is An Equal Opportunity/Affirmative Action Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or veteran status, age or any other federally protected class._