Data Engineer, Senior

The Data Engineer Senior is an integral member of the data platform team, assisting the solution architect to drive end-to-end technical design. The Data Engineer Senior interacts with the solution architect to understand the business stakeholder’s business and functional requirements and leads with the data engineers within the product team to design and deliver technical solutions, leveraging the data analytics platform where possible. The Data Engineer Senior’s key knowledge set includes system agile development life cycle, integration architectures, technology tools, database architectures, data management principles, data modelling techniques and methodologies, communication and problem solving. The Data Engineer Senior will assist the solution architect to design and implement large scale, enterprise-wide data processing solutions, database schemas and interfaces to relational and non-relational databases. The Data Engineer Senior will also implement and test the overall architectural solution by ingesting, cleaning, and organizing data into information used by analytics product. The goal is to provide data that is reliable, predictable, cost effective and secure to internal stakeholders within our data platform.

The Data Engineer Senior will work with other team members on the data analytics platform team to create plans and strategies for adopting new tools, technologies, and alternative solution architectures including leveraging the cloud.

Job Duties/Responsibilities

1.

Understand the complexity of data and design systems and models to handle different data sources/formats, which includes structured, semi-structured, and unstructured, as well as stream processing.

2.

Address governance and security challenges associated with solutions.

3.

Analyze data sources, design and evaluate feasible data pipeline solutions. The solutions might include database modeling and design, relational database architecture, metadata and repository creation and configuration management.

4.

Design and develop data pipelines or ETL processes.

5.

Support and adhere to the development of data management policies, standards and procedures.

6.

Define integrated views of data drawing together data from across the enterprise, both in real-time and as extracts.

Support test automation, troubleshooting ETL job functionality, validating data, as well as create test data and table structures through use of SQL.

9.

Must be able to work in an agile, rapid delivery environment.

Minimum Requirements

Minimum education required of the position

Bachelor’s or Master’s degree in a data-centric field: Computer Science, Mathematics, Information Systems, Information Processing, Engineering, etc.

Minimum experience required of the position

6+ years of experience as a data engineer utilizing standard data management principles.The Data Engineer should have experience on AWS GovCloud, the isolated AWS environment serving U.S. federal agencies and housing export controlled data, as well as the AWS Commercial cloud.

Minimum knowledge, skills and abilities required of the position

Technical Capabilities

• ETL experience
• Cloud Based Computing such as AWS or Azure
• Big data technologies
• Data warehousing, mining, analysis, self-service, or machine learning
• Data Governance
• Structured and Unstructured Data
• SQL and NoSQL database technologies
• Data Modelling
• Python, SQL, Spark
• Airflow, * Requires conceptual and practical expertise in own discipline and basic knowledge of related disciplines.
• Strong communicator at the technical levels.
• Strong, demonstrated writing and presentation skills.

Business Expertise

• Has knowledge of best practices and how own area integrates with others; is aware of the competition and the factors that differentiate them in the market.

Leadership

• Acts as a resource for colleagues with less experience; may lead small projects with manageable risks and resource requirements.

Problem Solving

• Solves complex problems; takes a new perspective on existing solutions; exercises judgment based on the analysis of multiple sources of information.

Impact

• Impacts a range of customer, operational, project or service activities within own team and other related teams; works within broad guidelines and policies.

Interpersonal Skills

• Explains difficult or sensitive information; works to build consensus.

Minimum knowledge, skills and abilities required of the position

• Proficiency in PC Windows environment (Word, Excel, Access, PowerPoint)

Additional Responsibilities: As a provider of essential services, Entergy expects its employees to be available to work additional hours, to work in alternate locations, and/or to perform additional duties in connection with storms, outages, emergencies, or other situations as deemed necessary by the company. Exempt employees may not be paid overtime associated with such duties., As a provider of essential services, Entergy expects its employees to be available to work additional hours, to work in alternate locations, and/or to perform additional duties in connection with storms, outages, emergencies, or other situations as deemed necessary by the company. Exempt employees may not be paid overtime associated with such duties.