Data Engineer & Insights Analyst - Contract - Remote
- Discuss this with your agent
- Open in Claude
- Open in ChatGPT
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Role details
Tech stack
+33 more
Job description
We are looking for an experienced Data Engineer & Insights Analyst with 10+ years of experience in designing, developing, and maintaining scalable data pipelines and cloud-based data solutions. The ideal candidate should have strong expertise in AWS services, Python, SQL, ETL processes, and Big Data technologies. The candidate will be responsible for collecting, integrating, transforming, and analyzing large and complex datasets to support business intelligence, reporting, and data-driven decision-making. The role also involves developing data architecture, improving data quality, and collaborating with data scientists, analysts, and business teams., + Design, develop, and maintain scalable data pipelines and data architecture.
- Build cloud-based data solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, Lambda, and RDS.
- Develop and optimize ETL/ELT processes using Python, SQL, Java, or Scala.
- Integrate, transform, and manage large datasets from multiple sources.
- Work with Big Data technologies such as Apache Spark, Hadoop, and Kafka.
- Build and manage data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.
- Develop and maintain relational and NoSQL databases.
- Create data models, dashboards, reports, and analytical solutions to support business decision-making.
- Implement data quality checks, monitoring, logging, and validation processes.
- Ensure data governance, security, privacy, and compliance standards.
- Support data migration, conversion, and system modernization projects.
- Collaborate with data scientists, research analysts, and business stakeholders to deliver reliable data solutions.
Requirements
- Minimum 10+ years of experience in Data Engineering, Data Integration, or related roles.
- Strong hands-on experience with AWS cloud services, including S3, Glue, Redshift, EMR, Lambda, and Athena.
- Proficiency in programming languages such as Python, Java, Scala, or R.
- Advanced knowledge of SQL and relational/NoSQL databases such as Oracle, MS SQL Server, PostgreSQL, and Cassandra.
- Experience with Big Data technologies including Apache Spark, Hadoop, and Kafka.
- Hands-on experience with ETL tools such as Informatica, MuleSoft, Talend, or TIBCO.
- Knowledge of Apache Airflow, Luigi, Azkaban, or similar workflow management tools.
- Experience with Git, CI/CD pipelines, REST APIs, and data integration.
- Strong understanding of data modeling, dimensional modeling, Star/Snowflake schemas, and Data Vault.
- Knowledge of data governance, metadata management, data lineage, and data quality frameworks.
- Strong analytical, problem-solving, project management, and communication skills.
- Preferred Experience:
- Experience working with higher education or student-level datasets.
- Knowledge of integrating education data with employment and wage records.
- Experience handling large, complex, and confidential datasets.
- Experience developing analytics solutions, dashboards, and reports for business or government organizations., A strong Data Engineer with a combination of AWS cloud expertise, Python/SQL programming, ETL development, and Big Data experience, along with the ability to transform complex datasets into meaningful insights and support data-driven decision-making.
Apply for this position
This job is hosted externally. Click below to view the full posting and apply.
Prepare application
- Draft this with your agent
- Open in Claude
- Open in ChatGPT
Good distractions
Loading talks and stories from around this roleβ¦