SENIOR DATA ENGINEER - 72004170

The Senior Data Engineer is expected to possess programming and engineering skills to assist the Office of the State Chief Data Officer (OSCDO). The position leads the technical design and development of data pipelines, integrations, and data services that enable secure access to data across distributed agency systems. The Senior Data Engineer will be joining a team of professionals that are dedicated to streamlining data sharing, promoting interoperability within the State, reducing duplication of data received and assisting the State of Florida’s Enterprise Data Community in finding efficiencies in business operations throughout.

Responsibilities:

• Leads the technical support for the State Chief Data Officer Interoperability initiatives.

• Develops data virtualization and federated access solutions that connect agency data sources while minimizing unnecessary data movement and duplication.
• Uses Python and SQL to develop maintainable integration code, queries, transformations, and automated data processing workflows.
• Implements data engineering solutions using Snowflake and AWS to support data access, integration, processing, and delivery.
• Incorporates validation, logging, monitoring, error handling, and performance optimization into data pipelines and services.
• Leads the design architect integration frameworks that support multiple types of secure data exchanges from various sources throughout the enterprise.
• Maintains regular coordination with the Enterprise Architecture team to align solution designs with enterprise standards, security requirements, and agency system constraints.
• Evaluates data virtualization, federated queries, and data movement approaches to determine the appropriate integration method for each use case.
• Leads the technical development in reusable integration components and design patterns to support consistent and efficient system connections, that promote interagency interoperability efforts.
• Designs and develops application programming interfaces (APIs) and backend data services that enable authorized systems and applications to access data.
• Develops extract, transform, and load (ETL) and extract, load, and transform (ELT) processes and secure file transfer integrations when data movement is necessary.
• Assists in the design and development of database architectures to support analytical workloads, including but not limited to, data modeling, structural design, process and performance optimizations.
• Assists and supports efforts of implementation of enterprise Identity Access Management mechanisms for internal and external applications and systems.
• Provide mentoring and training to newer team members including the Data Interoperability Analyst, Business Data Analyst, and the Data Architect.
• Assists with analysis reviews for technical feasibility assessments for proposed data integrations and system interoperability requirements for enterprise agency modernization efforts as requested.
• Documents integration interfaces, data dependencies, transformation rules, and operational procedures.
• Build data visualizations using business intelligence software.
• Collaborates in requirements gathering and design reviews for scalable systems, as needed.
• Other Duties as needed., Under the direction of Governor Ron DeSantis, Secretary Tom Berger and DMS’ Executive Leadership Team, the Florida Department of Management Services (DMS) is a customer-oriented agency with a broad portfolio that includes the efficient use and management of real estate, procurement, human resources, group insurance, retirement, telecommunications, fleet, and federal property assistance programs used throughout Florida’s state government. It is against this backdrop that DMS strives to demonstrate its motto, “We serve those who serve Florida.”

• Advanced proficiency in Python and SQL for data integration, transformation, querying, and automation.

• Familiarity with a variety of datasets, structured, semi-structured and unstructured, etc.
• Experience designing and developing data pipelines, APIs, and backend data services.
• Knowledge of data virtualization, federated query approaches, and distributed data architectures.
• Knowledgeable in performance optimization surrounding data delivery and process automation.
• Proficiency in using business intelligence software.
• Ability to analyze the current state of data, identify the gaps and issues, and provide recommendations for prioritizing actions and improvements.
• Knowledge of Agile delivery practices and the ability to apply iterative development methods within collaborative, multi-team environments.
• Proficiency in building and modifying interactive dashboards.
• Problem solving and critical thinking skills.
• Ability to communicate effectively with different stakeholders.

Preferred Skills:

• Experience with Git or other source code repositories.

• Experience with developing and implementing data pipeline integrations in multiple environments.
• Experience contributing to data mesh or data fabric architectures.
• Experience managing technical metadata, data lineage, and schema changes.
• Experience with Snowflake and other database software.
• Experienced in AWS environments.
• Experience with Single Sign On and Identity Access Management tool integration., * Bachelor’s Degree or 6 years’ experience in Computer Engineering, Computer Science, Statistics, Mathematics, Information Systems, Information Technology or another quantitative field.