Remote Sr. Data Engineer
ASGN Incorporated
Portland, United States of America
1 month ago
Role details
Contract type
Permanent contract Employment type
Full-time (> 32 hours) Working hours
Regular working hours Languages
English Experience level
SeniorJob location
Remote
Portland, United States of America
Tech stack
Amazon Web Services (AWS)
Apache HTTP Server
Big Data
Continuous Integration
Information Engineering
Data Integrity
Relational Databases
SQL Databases
Management of Software Versions
Data Ingestion
Data Lake
Information Technology
Data Analytics
Data Management
Data Pipelines
Job description
We are seeking a highly skilled Senior Data Engineer to join our team. The ideal candidate will be responsible for designing, building, and maintaining robust data pipelines and architectures that support our data-driven initiatives. This role requires a deep understanding of data engineering practices and the ability to work collaboratively with cross-functional teams to enhance our data capabilities., * Design and implement scalable data pipelines to support data ingestion and processing.
- Develop and maintain data architectures that ensure data integrity and accessibility.
- Utilize Apache Iceberg for efficient data versioning and management.
- Leverage AWS Athena for querying large datasets and optimizing performance.
- Implement CI/CD practices for data engineering workflows to enhance deployment efficiency.
- Collaborate with data scientists and analysts to understand data requirements and provide actionable insights.
- Monitor and optimize existing data pipelines and architectures for performance and reliability.
Requirements
Do you have experience in Scalability?, * Bachelor's degree in Computer Science, Engineering, or a related field.
- 6+ years of experience in data engineering or a related role.
- Strong proficiency in SQL and experience with relational databases.
- Expertise in Python for data manipulation and pipeline development.
- Familiarity with data lake architectures and best practices.
- Experience with data versioning concepts and tools, preferably Apache Iceberg.
- Knowledge of CI/CD methodologies and tools for data workflows.
- Excellent problem-solving skills and ability to work in a fast-paced environment.
Benefits & conditions
Pulled from the full job description
- Vision insurance
- Dental insurance, * Competitive salary
- Ability to work from anywhere in the U.S.
- Health/dental/vision insurance
- Flexible leave policy
- Equity options
- Clear understanding of work/life balance
- We are known for our culture!