Data Engineer
Role details
Job location
Tech stack
Job description
We are seeking a Technical Service Delivery: Data Engineer to join our dynamic team for the ENACT Modernization project. The ideal candidate will have strong experience in building data pipelines, big data ecosystems, and SQL-based analytics and a proven ability to deliver scalable data solutions that improve decision-making and operational performance. This role is onsite. Responsibilities:
- Analyze and organize raw data to support business objectives.
- Design and build data systems, models, and pipelines across Hadoop, Spark, and SQL environments.
- Evaluate business needs, interpret trends and patterns, and prepare data for prescriptive and predictive modeling.
- Develop algorithms, prototypes, and analytical tools using Python and Scala.
- Ingest data from databases, streams, and files; process data using Hadoop, Spark, SQL, and related tools.
- Combine and reconcile information from multiple sources to enhance data quality and reliability.
- Identify opportunities for data acquisition and improvements in data transparency.
- Collaborate with data scientists and data architects on project deliverables.
- Design and build data models and data product roadmaps to support business processes.
- Prototype solutions, prepare test scripts, conduct testing, and perform data replication, extraction, loading, cleansing, and warehouse modeling.
- Assist with integration and transformation of data resources using data engineering and data science principles.
- Gather and document business and functional requirements and develop reports, dashboards, and ad hoc analyses with enterprise BI and desktop tools.
Requirements
-
Previous experience as a data engineer or in a related role.
-
Bachelor's degree in Computer Science, Information Technology, or a related field. Master's degree is a plus.
-
Technical expertise with data modeling, data mining, and segmentation techniques.
-
Proficiency in SQL and data manipulation languages; experience with enterprise databases.
-
Hands-on experience with big data technologies such as Hadoop and Spark.
-
Programming skills in Python and Java; familiarity with Scala preferred.
-
Familiarity with machine learning algorithms and their data requirements.
-
Proven track record delivering data projects from requirements through deployment.
-
Certifications in data engineering or analytics are a plus (e.g., IBM Certified Data Engineer). Preferred Skills:
-
3+ years working on data migrations or implementations.
-
Experience building dashboards and reports with BI tools.