Business Intelligence Data Engineer
Role details
Job location
Tech stack
Job description
JOB SUMMARY: The Data Engineer will be responsible for full cycle of DW development including analyzing the business requirements and designing the ETL processing using dimensional modeling, where applicable, to present the data to the presentation layer for reporting consumption, and post
deployment, e.g. production support. The Data Engineer will be responsible to gather, collect, store, transform, and schedule (batch or real time) pipelines on the data and serve it any visualization tools.
The Data Engineer will also be responsible for evaluating the many BI/DW tools. available, incorporating them into the data platform and educating others on how best to use them.
WHAT YOU'LL DO:
- Work with business requirements to identify and understand source data systems; provide resolutions to all data issues and coordinate with data analyst to validate all requirements, perform interviews with all users and developers.
- Map source system data to data warehouse tables
- Develop and perform tests and validate all data flows and prepare all ETL/ELT processes according to business requirements and incorporate all business requirements into all design specifications.
- Define and capture metadata and rules associated with ETL processes
- Adapt ETL processes to accommodate changes in source systems and new business user requirements
- Collaborate with all developers and business users to gather required data and execute all ETL programs and scripts on systems and implement all data warehouse activities and prepare reports for same.
- Provide support and maintenance on ETL processes and documentation
- Build partnerships across the application, business, and infrastructure teams
- Strive to continuously improve the software delivery processes and practices
- Champion company standards and best practices
Additional Responsibilities
- Accountable for properly following all IT standards, processes and methodologies as applicable including but not limited to Quality Assurance (QA)
- Other responsibilities and accountabilities may be assigned based on business and organization needs., Maintains the highest standards. Treats others the way you'd like to be treated. Makes the best product. Gives the customer a fair deal.
TRUST
Exhibits sense of fairness. Leads by example. Consistently lives the Values and Creed. Builds trust by being willing to say "I made a mistake". Assures that promises are met on time, every time.
INSPIRATION TO OTHERS
Walks the talk. Is supportive of others. Helps others develop great ideas. Looks for the best in others. Rewards positive performance. Finds ways to succeed, not reasons to fail. Is willing to do jobs "below them". Addresses failures in the process, not the people. Accepts responsibility for own failures. Creates vision for team.
DRIVES TOWARDS HIGHEST QUALITY RESULTS
Is creative and innovative. Is a prudent risk-taker. Always looks for new methods and better ways to run the business. Meets annual goals and objectives. Has a passion for the business. Is willing to change. Puts forth quality efforts.
INTEGRITY
Represents self honestly in all situations, even if it exposes mistakes or weakness. Gives the customer a fair deal. Always does the right thing, even when no one is watching. Walks the talk. Meets commitments. Applies rules across all levels - no exceptions.
OPEN & HONEST COMMUNICATION
Is timely in communications in both directions. Listens actively. Speaks directly, (say what you mean - mean what you say). Listens with empathy and without judgment. Gets all the facts before jumping to conclusions.
TEAM PLAYER/PARTNERSHIP
Avoids acting like a big shot. Shares success with others. Recognizes others achievements timely. Reacts constructively to mistakes. Is willing to do whatever is necessary to get job done. Puts other's success first. Values team over individual. Acknowledges others with Golden Spirit Awards. Creates win/win situations. WHY JOIN US
Requirements
Do you have experience in System troubleshooting?, Do you have a Bachelor's degree?, Education/Certification: Four year college in a quantitative field such as Computer Science / Computer Information Systems or commensurate work experience.
Experience:
- Industry experience as a Business Intelligence Data Engineer or related specialty (e.g. Software Engineer, Business Intelligence Engineer, and Data Scientist) with extensive professional experience and a proven track record in a role focused on understanding, manipulating, processing and extracting value from various systems.
- Strong proficiency in SQL
- Expert in ETL tools such Matillion, Informatica, SSIS, ODI etc. as and/or other data manipulation languages such as Python, SAS and R.
- Creative in finding new solutions and designing innovative methods, systems and processes
- Desire to create and build new predictive/optimization tools for structuring datasets
- Extensive experience Data Warehousing development: Star Schema modeling, slowly changing dimensions, row-level security, standard DW architecture/processes, troubleshooting and production support.
Preferred Qualifications
- Experience with AWS such as Redshift, EC2, S3, Pythons
- Strong analytic skills for working with structured and/or unstructured datasets
- Strong project management and organizational skills, experience working on complex initiatives with cross-functional teams in a dynamic environment
- Experience with connecting data sets to data visualization tools and creating reports using PowerBI or other visualization tools.
ESSENTIAL KNOWLEDGE, SKILLS AND ABILITIES
Business
Expert
- Business Acumen
Proficient
- Oral and Written
Position Description
- Business Alignment
- Requirements Definition
- Communication Skills
- Operational Process Flows
- Analytical skills