Data Integration Specialist
Role details
Job location
Tech stack
Job description
-
Develop and maintain scalable data pipelines that enable real-time and batch processing of structured and unstructured data.
-
Implement Extract, Transform, Load (ETL) workflows that facilitate data interoperability across cloud and on-premises environments.
-
Manage schema alignment, metadata tagging, and data governance to ensure data quality and traceability.
-
Coordinate with the AI/ML Engineer to ensure data transformations meet model training and analytical requirements.
-
Submit the Data Ingestion & Transformation Report, documenting data sources, pipeline optimizations, and integration updates
Requirements
-
Active TS/SCI clearance.
-
Bachelor's degree in Data Science, Information Management, or a related field, OR five (5) years of equivalent experience in data integration.
-
Demonstrated experience in developing and managing ETL workflows, integrating data from multiple sources, and ensuring data quality and consistency.
-
Experience with tools such as Apache NiFi, Databricks, and SQL-based data warehouses is required.
-
Possess the knowledge and capability to manage data ingestion, transformation, and interoperability across cloud-based and on-premises environments.
-
Personnel must be proficient in data integration tools, API development, ETL pipelines, and schema management.
Preferred Qualifications:
- Certifications include Certified Data Management Professional (CDMP) or Microsoft Certified: Azure Data Engineer Associate.