Senior Data engineer
Role details
Job location
Tech stack
Job description
- Strong technical skills in services like S3,Athena, Lambda, RDS, Event bridge, Lakeformation, Apache, SNS, Cloudformation, Secret manager, Glue and Glue(Pyspark), SQL, Data Warehousing, Informatica, Oracle.
- Design, develop, and implement custom solutions within the Collibra platform to support data governance initiatives.
- Create and enhance workflows, data dictionaries, connectors, and scripts to optimize data governance processes.
- Design, build, and maintain scalable and reliable data pipelines using AWS services (such as AWS Glue, Lambda, S3, and Redshift).
- Develop ETL processes for data ingestion, transformation, and loading into data lakes and warehouses.
- Collaborate with data scientists and analysts to ensure data availability for analytics and reporting.
- Integrate Collibra with AWS services to enable seamless data governance and management.
- Leverage AWS security features and best practices to ensure data privacy and compliance.
- Develop and automate data quality checks using both Collibra's data quality framework and AWS tools.
- Collaborate with business stakeholders to define data quality rules and threshold
- Stay up to date with Collibra and AWS updates, as well as industry trends, to suggest improvements and innovative solutions.
- Contribute to the development of data governance and engineering best practices.
Requirements
- Knowledge on Data Warehousing concepts is essential and prior experience in Informatica Power Centre and Oracle Exadata will prove useful.
- Excellent verbal and written communication skills required for interacting with management and peers
- Ability to clearly summarize methodology and key points of program/report in technical documentation/specifications is also required.
- Strong knowledge of outcomes research and analysis of health quality data.
- Ability to work independently without day-to-day supervision or the use of template
Benefits & conditions
Pay Range: $ 88,000 - 103,500 $ Per Year Pay range offered to a successful candidate will be based on several factors, including the candidate's education, work experience, work location, specific job duties, certifications, etc.
Benefits: Innova Solutions offers benefits( based on eligibility) that include the following: Medical & pharmacy coverage, Dental/vision insurance, 401(k), Health saving account (HSA) and Flexible spending account (FSA), Life Insurance, Pet Insurance, Short term and Long term Disability, Accident & Critical illness coverage, Pre-paid legal & ID theft protection, Sick time, and other types of paid leaves (as required by law), Employee Assistance Program (EAP).