Sr. Data Engineer (OBI Advanced Analytic Method Augmentation)

• Designs, Implements, and Operates data management systems for intelligence needs.
• Designs how data will be stored, accessed, used, integrated and managed by different data regimes and digital systems.
• Works with data users to determine, create, and populate optimal data architectures, structures, and systems.
• Plans, designs, and optimize data throughput and query performance.
• Participates in the selection of backend database technologies (eg. SQL, NoSQL, HPC, et.c) their configuration utilization, and the optimization of the full data pipeline infrastructure to support the actual content, volume, ETL, and periodicity of data to support the intended kinds of queries and analysis to match expected responsiveness.
• Manage complex, long-term projects involving design, development, and installation of new information systems.
• Performs technical studies to ensure the design meets user requirements, Develops, integrates, and installs data management capabilities and databases.
• Collaborate with team members to develop or refine resilient and scalable extract, transform, load (ETL) pipelines using industry-standard tools and frameworks (e.g., Apache NiFi) to support and enable data acquisition, normalization, enrichment, and delivery across enterprise systems and platforms.
• Collaborate with team members to ensure ETL pipelines operate in accordance with security controls and rules, SLA requirements, and evolving data architecture needs.
• Collaborate with team members to develop, implement, and maintain GraphQL APIs to enable flexible and” efficient access and aggregation of data across distributed sources Designs data management capabilities, data integration solutions, and databases to ensure optimization, efficiency, and sustained operations.
• Performs systems analysis and feasibility studies to define concepts and design specifications for new or existing databases and content management solutions.
• Collaborate with team members to design, implement, and maintain scalable, performant relational and non-relational database solutions (e.g., PostgreSQL) to support ingestion, storage, retrieval, and analytics of data across enterprise systems.
• Conducts testing and promotes the integration of new databases within the existing IT infrastructure.
• Discovers sources of redundancy and designs solutions for efficient integration or consolidating these sources to reduce costs of storage and maintenance, and to provide consistency to the enterprise.
• Creates test plans and scenarios and executes and documents database test activities (i.e., component, integration, systems, compatibility/interface, user acceptance, and performance/stress tests).
• Conducts operational readiness testing and transitional user support.
• Conducts monitor services and upgrades data services, content management systems, and databases.
• Produces technical data and reporting outlining the performance characteristics of specified databases and data services in the DIA infrastructure.
• Conducts analysis of databases and system reports to ensure optimal performance.
• Develops disaster recovery planning to ensure data and access reliability and database integrity during crisis.
• Analyzes, evaluates and provides recommendations and associated artifacts (e.g., OV/SV-I s, reference models, integration plans and patterns) on new, current, and planned data service, data management and database technologies and architecture based on performance, cost, and security requirements.
• Conducts assessments of current trends and determines the impact of’ emerging technologies upon the existing infrastructure.
• Analyzes, evaluates and provides recommendations for current and planned programmatic solutions and capabilities to manage, organize, and transform data outside of databases to ensure unstructured data integrity, security, access, and formats.
• Identify and leverage containerization capabilities (e.g., Docker, Kubernetes) and infrastructure as code tools to manage and provision resources and ensure repeatability and automation.
• Independently designs, develops, tests, and implements unstructured data management solutions, content extraction and tagging capabilities, data integration solutions, and complex data web services.
• Designs, upgrades, and maintains data service versioning to ensure uninterrupted availability and access across DIE.
• Conducts analysis of service and database failures and user system interface problems.
• Conducts the development of immediate temporary fixes and implements final corrections.
• Interfaces with vendors, programmers, and users to identify, isolate and resolve problems. Evaluates user requested changes and plans the implementation, enhancement and update of databases and data services as necessary.
• Prepares and presents briefings to senior management to effectively communicate technical and complex data management issues.
• Supports capability development by contributing, editing, and storing code in Government owned/controlled source version control repositories.

• Minimum 12 years of experience related to the specific labor category with at least a portion of the experience within the last 2 years.

Desired education:

• Master’s Degree in an area related to the labor category from a college or university accredited by an agency recognized by the U.S. Department of Education: or have a bachelor’s degree related to the labor category from a college or university accredited by an agency recognized by the U.S. Department of Education and an additional 5 years of related Senior experience for a total of 17 years, as a substitute to the master’s degree.

Security Clearance:

• Security clearance required TS/SCI with CI POLY or the ability to obtain CI POLY.

At Prescient Edge, we believe that acting with integrity and serving our employees is the key to everyone’s success. To that end, we provide employees with a best-in-class benefits package that includes:

• A competitive salary with performance bonus opportunities.
• Comprehensive healthcare benefits, including medical, vision, dental, and orthodontia coverage.
• A substantial retirement plan with no vesting schedule.
• Career development opportunities, including on-the-job training, tuition reimbursement, and networking.
• A positive work environment where employees are respected, supported, and engaged.
• Salary range: $160,000 - $180,000. Salary to be determined by the education, experience, knowledge, skills and the abilities of the applicant internal equity, and alignment with market data