ETL Developer - TSSCI w/ Poly

We are seeking an experienced ETL Developer to provide onsite support for a geospatial visualization platform. This role focuses on developing, maintaining, and optimizing data pipelines to ensure reliable data flow into a PostgreSQL database. The ideal candidate will have strong experience in ETL processes, data integration, and working with large, complex datasets, including geospatial data. Key Responsibilities * Design, develop and manage ETL workflows using Apache NiFi to support a geospatial visualization platform * Learn the nuances of the existing NiFi system and the related AWS and PostgreSQL infrastructure in order to monitor and troubleshoot real time issues * Obtain an understanding of existing NiFi flows with minimal support from others * Develop new NiFi flows that adopt best practices of existing NiFi flows * Take feedback on NiFi flows and develop requested changes * Take direction and communicate status via a ticketing system * Interface with analysts via email, chat, and in person meetings to comprehend future data flow needs and refine general requirements into specific actions * Interface with a development cycle using a local development environment of containerized infrastructure and version control via Git and NiFi Registry * Gain competency in geospatial database design and employ best practices for table creation, indexing, and unique constraints * Take feedback from analysts on nuances to support application data layers * Programmatically manipulate and transform data from multiple sources * Query and analyze large datasets using SQL * Retrieve and process data from external systems via APIs * Support data quality, integrity, and performance optimization efforts * Understand Python and data science frameworks while differentiating between experimental prototypes and enterprise level software requirements * Develop Python in support of data science related efforts or ETL prototypes

• Willingness to develop NiFi flows using existing best practices
• Strong understanding of ETL concepts and best practices
• Strong experience with databases for data management
• Proficiency in SQL for querying large datasets
• Experience with API integration and data retrieval
• Demonstrated experience with programmatic data manipulation
• Competency to rapidly adopt containerized development proficiency
• Competency to rapidly adopt AWS architecture proficiency
• Competency to rapidly adopt NiFi registry and Git for code management Preferred Qualifications
• Creativity to experiment and recommend best practice coding improvements
• Drive to adopt and recommend AI into development processes
• Ability to design and develop custom NiFi processors using Java
• Experience with AWS cloud services for data ingestion and processing
• Strong experience with PostgreSQL for data management
• Hands-on experience with Apache Airflow
• Hands-on experience with Apache NiFi
• Hands-on experience with NiFi registry and Git
• Hands-on experience with Git and repository actions and pull requests
• Hands-on experience in Python for data manipulation and API interfacing
• Experience working with geospatial data and related tool
• Understanding of basic data science concepts and tools