Data Engineer

Performs advanced (seniorlevel) development work in support of the TxDMV, Information Technology Services Division. Work involves designing, developing, implementing, and maintaining robust and scalable ETL and data pipeline solutions to ingest, transform, and load data from various sources into target data warehouse and reporting structures. Data Engineer will be responsible for ensuring system security, optimizing ETL solutions for performance and accuracy, and integrating modern and AIdriven technologies., The Data Engineer will manage both legacy and modern ETL solutions, ensuring compatibility and security while transitioning to more advanced solutions where applicable. The position requires a deep understanding of data integration workflows, data lineage, data transformations, database modeling, data warehousing, and relational databases. The Data Engineer will work closely with data/enterprise architects, data analysts, database administrators and infrastructure teams to ensure data quality, consistency, and accessibility for business users and analytics teams., + Design, develop, test, and deploy ETL pipelines using industrystandard ETL tools and technologies.

• Translate business requirements into technical specifications and efficient ETL processes.
• Implement data quality checks and validation rules within ETL pipelines.
• Optimize ETL processes for performance, scalability, and reliability.
• Document ETL processes, data flows, and technical specifications.
• Data Integration
• Extract data from various sources, including databases, APIs, flat files, and cloud storage.
• Transform data into the required formats and structures for target systems.
• Load data into the data warehouse and data lake.
• Work with data source owners to understand data structures and ensure data accuracy.
• Maintenance and Support
• Monitor ETL pipeline performance and identify areas for improvement.
• Troubleshoot and resolve data integration issues.
• Maintain and update existing ETL processes to accommodate changing business needs.
• Collaboration
• Collaborate with data/enterprise architects, BI developers, and other stakeholders to understand their data requirements.
• Work closely with database administrators and infrastructure teams to ensure proper system performance.
• Participate in code reviews and knowledge sharing.
• May travel up to 5% of the time. Travels by car (may include flying). May include overnight travel. May require working extended hours and some evenings and weekends, as needed.
• Required to attend work regularly and adhere to approved work hours in accordance with department policies and procedures.
• Performs other duties as assigned.

• Bachelor’s degree from an accredited college or university in the areas of data science, data management, computer information systems, management information systems, computer science, cybersecurity or information security, or in a field related to assignment or a related field, or equivalent experience.
• Two (2) years of experience in a Data Engineer or Developerrelated role creating ETL pipelines with a focus on Enterprise Analytics projects.
• Five (5) years of experience working with a variety of relational databases (e.g. DB2, SQL Server).
• Two (2) years of experience in ETL development using industrystandard ETL tools (e.g., Informatica, Azure Data Factory, Microsoft Fabric).
• Two (2) years of experience in administration, configuration, development, and management of data storage, integration, and ETL solutions on cloud (AWS, Azure) and on premise.
• Experience in building data pipelines in AWS or Azure public clouds.

NOTE: Experience may substitute for education. Education may not substitute for the experience requirement.

Experience & Training Preferred

• Five (5) years of experience with development following the Agile formal/structured methodology.
• Five (5) years in implementing scalable and efficient data workflows, including data warehousing, data lakes, and data marts.
• Four (4) years of experience in trouble shooting and performance tuning ETL Workflows and SQL.
• Four (4) years of experience with batch processing in mainframe, DB2, or Oracle batch framework.
• Two (2) years of experience with Data Governance and Data Catalog tools such as Informatica Data Catalog
• Proficient in scripting (SQL, R, Python, etc).
• Azure or AWS cloud certifications.
• AI Knowledge will be preferred., * Knowledge of master data, metadata, reference data, relational data modeling, data warehousing, and business intelligence principles and processes, including the technical architecture of enterprise information management processes and methodologies, relational database management systems, metadata management, business intelligence, and business analytics tools.
• Knowledge and handson experience of the limitations and capabilities of computer systems, information technology equipment, applicable programming languages, computer hardware and software, and computer operating systems.
• Knowledge of Data Governance tools like Informatica Enterprise Data Catalog, Axon or similar tools from other Industry providers.
• Knowledge of new cloud technologies and the analytical services available from the major cloud services providers.
• Knowledge of cloud delivery models: PaaS, SaaS, IaaS.
• Knowledge of cloudbased services for AWS, Microsoft Azure or Google Cloud Platform.
• Skills with data engineering, including acquisition/ETL tools such as Informatica PowerCenter, IDQ, and cloud technologies like MS Fabric, Azure Data Factory, Informatica IICS etc.
• Skills and experience acquiring data from multiple data sources/technologies for use by data visualization tools like Power BI and COGNOS. Examples of technologies include DB2 and others such as Oracle, SQL Server, Microsoft Excel, Postgres, MS SharePoint, sales force etc.
• Strong analytical and problemsolving skills with experience as a technical lead for software development, data analytics, performance management system, or data warehousing project.
• Strong technical writing and diagraming skills, including proficiency with modeling and mapping tools (e.g., Visio, Erwin), the Microsoft Office Suite (Word, Excel, PowerPoint, and MS Project).
• Ability to apply analytical, trouble shooting, and problemsolving skills in data related projects.
• An ability to effectively prioritize and manage multiple tasks and directional changes under short and firm deadlines.
• Ability to understand, follow and convey brief oral and/or written instructions.
• Ability to establish and maintain effective and cordial working relationships at all organizational levels, including agency management, direct supervisors, coworkers, internal and external customers.
• Ability to communicate both verbally and in writing, in a clear and concise manner.
• Knowledge of cloudbased services for AWS, Microsoft Azure or Google Cloud Platform.
• Ability to generate ETL Workflow pipelines to support Applications, Data Warehouse, and Reporting needs.
• Knowledge of AI technologies and experience implementing AI features.
• Ability to work independently and as part of a team, and to support and contribute to a cohesive team environment.
• Ability to work with limited supervision and to schedule workload to meet requirements and deadlines of the position.
• Ability to work under pressure and exacting schedules to complete assigned tasks.
• Proficiency in ETL tool(s) (e.g., Informatica Azure Data Factory, AWS Glue, Google Cloud Dataflow, Talend).
• Designing, coding, testing, and debugging complex ETL solutions.
• Ability to develop cloudbased data warehouses.
• Ability to lead advancedlevel ETL development tasks with minimal supervision, exercising initiative and independent judgment.
• Ability to document processes, requirements, and code for clarity, maintainability, and handoff readiness
• Ability to remain flexible and innovative in problemsolving while adhering to organizational standards and regulations., A valid Class “C” driver’s license is required. If not currently a Texas resident, must obtain a Texas Driver’s License within ninety (90) days after entering Texas as a new resident. A satisfactory driving record is required for operating state or personal vehicles to conduct department business.

The State of Texas offers a variety of benefits for you and your family that are comprehensive and, on average, make up about onethird of total compensation. Benefits include:

• Retirement Plan
• Paid Group Health & Life Insurance for employees
• Paid Holidays
• Paid Vacation Leave
• Paid Sick Leave
• Longevity Pay
• Dental
• Vision
• Dependent Optional Life Insurance
• Voluntary AD&D Insurance
• Dependent Health & Life Insurance
• Health & Dependent care flexible spending accounts
• Tuition Assistance Program

QUALIFIED EMPLOYER: In addition, the Texas Department of Motor Vehicles is considered a qualified employer for the Department of Education’s Public Student Loan Forgiveness (PSLF) program ., If selected for the position the following must be provided for proof of military employment preference:

• Veteran must provide form DD 214
• Surviving Spouse or Orphan must provide DD 1300 or DD 214.

Military Occupational Specialty (MOS) codes that may correspond to the state classification title for this position are listed on the State Auditor’s Office Job Descriptions ; click on the occupational category for the position. Additional MOS can be found at the State Auditor’s Office Military Crosswalk Guide .