Data Engineer - ITS4
Role details
Job location
Tech stack
Job description
It is the policy of Minnesota IT Services that a successful candidate must pass all legally required checks prior to employment which may consist of the following:
- SEMA4 Records Check (applies to current and past state employees only)
- Criminal History Check
- Reference Check
- Social Security and Address Verification
- Education Verification
- Other legally required checks
Minnesota IT Services does not participate in the federal E-Verify program. Minnesota IT Services is unable to sponsor applicants for work visas, including F-1 STEM OPT extensions, and cannot complete Form I-9 or any other documentation requiring employer participation in E-Verify. All applicants must be legally authorized to work in the United States at the time of application.
Requirements
This position is telework eligible for applicants who reside in Minnesota or in a bordering state, with supervisory approval and satisfactory performance. If you live in a state bordering Minnesota, you must live within 50 miles of less from the primary work location to be eligible for telework. Telework (https://mn.gov/mmb-stat/policies/1422-telework.pdf) arrangements and policy updates may be adjusted based on business needs., To qualify, candidates must clearly show all of the following qualifications in their resume. Resume tips available here (https://mn.gov/mnit/about-mnit/careers/hiringprocess.jsp) :
Position requires a minimum of four (4) years of IT related experience in Amazon Web Service (AWS) or related data technologies., * Automating AWS data pipeline/ETL technologies in a production data environment - S3, Glue, Lambda.
- Working with a variety of relational data storage options (AWS data lake, AWS RDS, or Amazon Redshift).
- Writing and interpreting data transformations in Python or R.
- Big Data processing utilizing PySpark.
- Utilizing version control (SVN, Git, or other version control system) to build transparent data pipelines.
- Demonstrated ability to communicate clearly and effectively in a manner that facilitates mutual understanding.
- Customer-focused approach grounded in active listening, empathy, and solution-oriented problem-solving to deliver positive user experiences.
Education in Information Technology (IT) or an IT related field may substitute for experience as follows: a master's degree for eighteen (18) months of experience; a bachelor's degree for one (1) year; and an associate's degree for six (6) months.
Preferred Qualifications
- Working with non-relational data storage options (vector stores or NoSQL databases) to support machine learning and AI data pipelines.
- An AWS Certification such as Cloud Practitioner or Data Engineer or Solutions Architect
- Knowledge of IAM Identity Center and Lake Formation
- Knowledge of containerization deployments utilizing Amazon ECS
- Comfort with troubleshooting data pipelines with little precedence and adjusting to multiple demands, shifting priorities, ambiguity and rapid changes.
- Passion in one or more of the following aspects of data governance: quality, integration, security, lifecycle management, stewardship, metadata management.
- Apply in-depth critical thinking and analytic thinking skills to a class of domain-specific problems and projects to provide practical assessment and solution generation.