Data Engineer (Intermediate or Senior)

The Data Engineer is responsible for designing, developing, and optimizing data pipelines, data modeling, and platform management to support seamless integration and operation of data systems. The incumbent will maintain the data warehouse, generate complex reports, and perform in-depth data analysis, while actively contributing to Agile team activities. This position will proactively collaborate with the Data Engineering Team, IT staff, other enterprise stakeholders and agency employees. The Data Engineer Senior is responsible for designing, developing, architecting, and enhancing data platforms and pipelines, ensuring robust data models and system integrations for enterprise operations. The incumbent will oversee advanced data warehouse maintenance, drive strategic data initiatives, and perform comprehensive analysis while actively contributing to Agile team activities. This position will proactively collaborate with the Data Engineering Team, IT staff, other enterprise stakeholders, and agency employees. In addition to the above, the Data Engineer will have expertise in DevOps principle and experience in CI/CD, Azure services, Kubernetes, and scripting skills (SQL, Python, PowerShell), along with testing automation. Terraform knowledge and Azure certifications are preferred. WHAT WILL YOU DO Data Engineering

• Develop and manage data platforms.
• Design and implement ETL processes and perform basic data lake management.
• Implement and manage CI/CD pipelines with intermediate proficiency.
• Create and maintain basic data models to ensure structured data storage and accessibility.
• Manage data catalogs to maintain an organized and easily accessible repository of data resources.
• Develop and maintain data warehouses.
• Perform administrative tasks and assist in basic system administration duties, contributing to the overall management and upkeep of data systems.
• Manage data permission, ensuring proper access control and data security.
• Contribute to the maintenance and optimization of the data warehouse, ensuring data integrity and availability.
• Develop data-driven applications, contributing to the creation of data solutions that support business needs.
• Conduct data analysis and assist in larger data analysis projects, providing insights and support to business stakeholders.
• Engage in scrum activities and actively participate in Agile methodologies.
• Generate reports using reporting tools, and provide support in more advanced reporting tasks as required.
• Collaborate with stakeholders to gather requirements and contribute to defining project scopes and objectives.
• Develop visually appealing and intuitive dashboards that provide visibility into key performance, risk, and control indicators across agency divisions and departments.

Performs related work as assigned. Data Engineering Senior

• Develop and manage data platforms.
• Design and maintain ETL processes and perform advanced data lake management.
• Oversee and manage the implementation of CI/CD pipelines utilizing advanced DevOps practices.
• Create and maintain advanced data models to ensure structured data storage and accessibility.
• Enhance data catalogs to maintain an organized and easily accessible repository of data resources.
• Enhance the efficiency of data warehouses and oversee complex warehousing.
• Optimize system performance and manage complex systems, improving ease of management and reliability of systems.
• Maintain complex data permissions, ensuring proper access control and data security.
• Improve the maintenance and optimization of data warehouses, ensuring data integrity and availability.
• Develop data-driven applications, contributing to the creation of data solutions that support business needs.
• Conduct advanced data analysis and lead larger data analysis projects, providing insights and support to business stakeholders.
• Lead scrum activities, ensuring team adherence to Agile practices.
• Automate reports using reporting tools and provide support for more advanced reporting tasks as required.
• Partner with stakeholders to align data strategies with business goals.
• Develop visually appealing and intuitive dashboards that provide visibility into key performance, risk, and control indicators across agency divisions and departments.

Performs related work as assigned.

Do you have experience in Stakeholder management?, Do you have a Master’s degree?, * Bachelor’s degree from an accredited college or university in computer information systems, computer science, data management, information systems, information science, mathematics, or a closely related field.

• High School diploma or equivalent and additional full-time experience in data pipeline builds and implementation may be substituted on an equivalent year-for-year basis.

Required Experience

• Three(3) - Five (5) years of full-time directly related, progressively responsible experience in data pipeline builds and implementation; utilizing ETL tools for creating ETL scripts; Power BI or equivalent modern data visualization package or related experience.
• Experience may be concurrent.
• A master’s degree or doctoral degree in a closely related field may be substituted on an equivalent year-for-year basis.

Required Registration, Certification, or Licensure

• None., * Experience/Advanced experience with data architecture and modeling.
• Experience/Advanced experience with Microsoft Fabric, Databricks, Snowflake, Spark, SQL, Python, and cloud platforms.
• Experience/Advanced experience with data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates).

Knowledge, Skills, and Abilities Knowledge of:

• Strong knowledge of business intelligence tools, databases, SQL, and object-oriented programming languages to support data analysis and predictive analytics.
• Database modeling and data warehousing principles.
• System development life cycle concepts.
• Knowledge/Advanced knowledge of data platforms, assist in platform management.
• Knowledge/Advanced knowledge of ETL concepts, assist in building pipelines.
• Knowledge/Advanced knowledge of data architecture and modeling.
• Knowledge/Advanced knowledge of Microsoft Fabric, Databricks, Snowflake, Spark, and cloud platforms.
• Knowledge/Advanced knowledge of data encryption (REST, SOAP, XML, JSON) and web services (SSL, SSH, SFTP, Certificates).
• Proficiency/Advanced proficiency in Python and SQL.

Skills in:

• Experience using technical and statistical analysis skills to deliver clear, concise, and visually appealing management metrics and reports to inform decision making and actions.
• Writing report queries, including an understanding of relational databases.
• Business process analysis and problem solving.
• Completing detailed work with a high degree of accuracy.
• Planning, organizing, and prioritizing work assignments to manage a high-volume workload in a fast-paced and changing environment.
• Using a computer in a Windows environment with Microsoft Office word processing, spreadsheet, and other business software.
• Effective written and verbal communications, including explaining complex information to others in an understandable manner and writing clear and precise policies, procedures, and training or other materials.
• Working in a team environment and influence a diverse group of stakeholders.

Ability to:

• Operate effectively in a fast-paced environment with competing and shifting priorities.
• Continually learn new concepts and tools to support job needs, and strive for ongoing professional development.
• Establish and maintain harmonious working relationships with co-workers, agency staff, and external contacts.
• Work effectively in a professional team environment.
• Participate in Scrum activities, advanced understanding of Agile.

The Information Technology (IT) Division lays the foundation for TRS to deliver excellent service experiences across the organization and with our members. We serve with purpose through mentorship and collaboration across a broad variety of teams unified by innovation to create technology and information solutions that have a positive impact on our members’ lives.

We invite you to join one of Austin’s Top Workplaces. TRS offers a best-in-class combination of technology and continuous learning opportunities to equip you to solve problems, expand your knowledge, and create impact for 1 in 20 Texans.