Data Engineer
Role details
Job location
Tech stack
Job description
In addition to creating and maintaining an optimal data and pipeline architecture, the Data Engineer responsibilities include coordinating with Business and Operations partners and other IT teams to create unique data infrastructure and applications, running tests on their designs to isolate errors and updating systems to accommodate changes to align to changing business strategies.
Job Purpose
The Data Engineer is a high profile role that will be responsible for delivery of the strategic data landscape for AIG's Japan General Insurance business. The lead role will create and maintains data architecture/data model/data pipeline and applications extensibility use AIG Japan data and support application development team members, solution architects, data architects and analytics team members across group companies. The target data architecture will be strategically focused on a cloud-based data ecosystem.
The ideal candidate will work collaboratively with the technology delivery and architecture teams as well as business partners to facilitate designs and ensure that the overall data foundation is delivered and in alignment with the AIG Data Strategy & Application blueprints. This role will manage vendor engineer resources as well.
Job Responsibilities
Design
-
Design and optimize data architecture/data model/data pipeline of group companies. Guide all stake holders in terms of data engineering such as data integration, data ingestion, data cleansing etc.
-
Create guidelines for design and implementation of group companywide data architecture/data model/data pipeline and oversee those implementations.
-
Provide and propose data solutions such as ETL/ELT, traditional RDB (Oracle / Sybase), big data processing such as Hadoop / Kafka, Spark etc including infrastructure design
-
Provide and propose data solutions such as Data model / Data Pipeline / BI tools / Data Ware House / Datalake / Master Data Management for analytics as well as business operations.
Deliver
-
Responsible for execution of Data related application development/enhancement, Data modeling, Data pipeline
-
Leads the technical team to understand and translate data requirements into consumable technical specifications for development delivery.
-
Assess data architecture/data model/data pipeline implementation along with compliance team to comply with global and local regulations.
-
Evaluate implemented data architecture/data model/data pipeline and workflow solutions to keep cost effective and to keep up with technology trend
-
Visualize data architecture/data model/data pipeline design across group companies and keep up to date
-
Reviews and accepts deliverables from vendors to meet expected quality.
Collaborate
-
Data Engineer is a technical leader who owns the end-to-end application lifecycle management of Data related applications.
-
Partners with business stakeholders in the Data Office on the rationalization of legacy data assets and drive decommissioning plans as new data assets become available.
-
Partners closely with both the Data & Application Delivery teams globally to ensure Business and Technical Data Delivery and the enablement of Business-driven Analytical solutions.
-
Work closely with the distribution and operations team to understand their needs and priorities and translate this into business solutions.
-
You will be a key stakeholder in building the future state of agent experience, which is the key critical factor in growing our business.
Key Relationships
Internal Interactions (Within the Organization)
Requirements
Educational Qualification
-
Bachelors degree or equivalent
-
TOEIC 800 / IELTS 6 and more, JLTP N3 and more
-
AWS certified (Solution Architect / Data etc)
-
Salesforce certified (Architect / Data etc)
-
ITIL Foundation certified
Specific Qualifications
- Japanese language: N3 & above. English business fluency
Total Experience
-
8+ years in insurance industry experience.
-
10+ years of experience in Overall knowledge/experience in IT
-
10+ years of experience in data management and/or business intelligence roles with the most recent experience in data application delivery.
Data Management / Technical
-
Demonstrated experience designing and building information assets in modern data technology platforms including Cloud (AWS, Azure, Snowflake, Spark) based solutions, and data system migrations.
-
Experience in developing and operationalizing a data strategy across various technology, infrastructure, and entities.
-
Possesses extensive technical data architecture and data delivery skills, including hands-on commercial mainstream data products experience to support the application delivery teams.
-
Strong knowledge and experience with data warehousing design both on premise and in the cloud.
-
Database solution experience (Oracle / Sybase / Hadoop ecosystem / Snowflake / Mongo database etc)
-
Big data solution experience (Hadoop, Spark, Kafka etc)
-
Stream-processing experience (Storm, Spark etc)
-
Programming experience (Python, Java, Scala etc)
-
BI solution experience (Tableau / Power BI)
-
Data modeling experience (logical / physical)
-
Some of business domain knowledge from - Life insurance / Property and Casualty / Call center / Marketing / Sales & distribution / Finance
-
Cloud platform experience (AWS / Azure / GCP / Salesforce)
Collaborative
-
Effective communication skills and facilitation experience with business and technology stakeholders to understand use cases and business needs. (including presentation skills)
-
Has growth mindset and can improve employee engagement.
-
Strong insurance knowledge across products representative in Japan in both the commercial and consumer spaces.
-
Ability to work effectively, be flexibility and adaptable in a fast-paced, challenging environment and with changing priorities.
-
Ability to influence change and drive results. Must be a self-motivated driver to identify issues and resolve them quickly. The should be a self-starter with curiosity about anything related to both technology and business
-
Agile methodologies experience (Scrum / Kanban)
Vendor management experience (Contract / SLA / KPI / Team management)