Sr. Data Engineer
Ampcus Inc
Chicago, United States of America
18 days ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Chicago, United States of America
Tech stack
Amazon Web Services (AWS)
Amazon Web Services (AWS)
Big Data
Cloud Database
Program Optimization
Information Engineering
Data Integration
Data Integrity
Amazon DynamoDB
Python
Cloud Services
DataOps
SQL Databases
Data Processing
Electronic Medical Records
PySpark
Integration Frameworks
Functional Programming
Data Pipelines
Databricks
Job description
- AWS Management: Utilize AWS services such as EMR, DynamoDB, S3, and Lambda to manage and optimize cloud-based data infrastructure.
- Python Programming: Develop and maintain scripts and applications using Python to automate data processing tasks and improve system efficiency.
- Big Data Processing: Implement and manage data processing workflows using PySpark and Databricks to handle large-scale data sets.
- Database Management: Design, implement, and maintain SQL databases to ensure data integrity, performance, and accessibility.
- Data Integration: Integrate data from various sources, ensuring consistency and reliability for analytics and reporting.
- System Optimization: Perform regular system upgrades, troubleshooting, and compliance checks to maintain secure and reliable data operations.
- Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions that meet business needs.
- Travel: Ability to travel to local and remote sites as needed to support organizational objectives.
Requirements
We are seeking a highly skilled Sr. Data Engineer to join our team in Chicago. The ideal candidate will have extensive experience in data engineering, cloud services, and big data technologies, with a strong focus on AWS services, Python programming, and data processing frameworks., * Experience: Proven experience in data engineering, cloud services, and big data technologies.
- Technical Skills: Proficiency in AWS (EMR, DynamoDB, S3, Lambda), Python, PySpark, Databricks, and SQL.
- Problem-Solving: Strong troubleshooting skills and ability to resolve complex technical issues.
- Communication: Excellent verbal and written communication skills to interact effectively with team members and stakeholders.
About the company
Ampcus Inc. is a certified global provider of a broad range of Technology and Business consulting services. We are in search of a highly motivated candidate to join our talented Team.