Senior Data Engineer

CGI Technologies and Solutions, Inc.
Fairfax, VA, United States
4 days ago
Apply on www.techcareers.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
8 years minimum
Compensation
$62,900.0 - $139,300.0
Working hours
Regular working hours

Tech stack

Batch Processing Big Data Software Bug Management Software Quality Data Validation Data Integration Extract Transform Load (ETL) Data Transformation Database Queries Apache Hadoop Hadoop Distributed File System Apache Hive
+17 more
Job Scheduling Python (Programming Language) Scrum Methodology Regression Testing Standard Sql Test Management Enterprise Data Management Freeform SQL Azure Data Factory Apache Spark Test Scripts Backend Pyspark Integration Tests Data Pipelines Databricks Control M

Job description

Design, develop, and execute test plans, test scenarios, and test cases for enterprise data platforms, ETL/ELT pipelines, and data integration solutions.

. Perform end to end ETL testing and validate data accuracy, completeness, transformation logic, reconciliation, and data quality across source and target systems.

. Develop and execute complex SQL queries for backend and data validation testing.

. Test large scale data processing solutions using Databricks, Apache Spark, PySpark, Python, Hive, Hadoop/HDFS, and Azure Data Factory (ADF).

. Perform functional, integration, regression, system, and data quality testing across data pipelines and applications.

. Validate batch processing, job scheduling, dependencies, and workflow execution using Control M and Unix/Linux environments.

. Identify, document, track, and retest defects while collaborating with developers, data engineers, business analysts, and other stakeholders through resolution.

. Develop and maintain reusable test scripts and automation solutions where applicable.

. Participate in Agile/Scrum activities including sprint planning, refinement, daily stand ups, reviews, and retrospectives.

Requirements

8+ years of experience in software quality engineering/testing, with strong experience in ETL testing, data validation, integration testing, and regression testing.

. Strong hands on SQL skills, including writing complex queries for source to target validation, reconciliation, and data quality testing.

. Experience testing large scale data platforms and ETL/ELT pipelines.

. Hands on experience with Databricks, Apache Spark, PySpark, Python, and Azure Data Factory (ADF).

. Experience with Hadoop ecosystem technologies including Hadoop/HDFS and Hive.

. Experience working with Unix/Linux environments and enterprise job scheduling tools such as Control M.

. Strong understanding of data quality concepts, data transformations, data mappings, and source to target validation.

. Experience with defect management and test management processes within Agile/Scrum delivery environments.

. Strong analytical, troubleshooting, communication, and collaboration skills.

Benefits & conditions

We’re a close knit team that has access to global resources. You’ll have the opportunity to explore a wide range of industries, technologies, and geographies, all while enjoying the personal touch that our local operating approach offers.

Growth at CGI is driven by your goals, so if you’re looking for an inclusive place where you’re empowered to chart your own path, then we’d love to meet you.

  1. Impactful Work

. You’ll be at the forefront of delivering strategic consulting solutions that shape business outcomes for leading organizations.

. Opportunity to work on diverse, high impact projects that challenge your thinking and expand your expertise.

  1. Growth & Development

. Clear career progression with access to leadership mentoring and professional development programs.

. Exposure to cutting edge technologies and methodologies that keep you ahead in the consulting space.

  1. Collaborative Team Environment

. Join a team of seasoned professionals who value knowledge sharing, innovation, and collaboration.

. A culture that encourages open communication, mutual respect, and continuous learning.

  1. Flexible & Supportive Work Environment

. Hybrid work model offering flexibility to balance professional and personal priorities.

. Strong emphasis on work life balance and employee well being.

  1. Inclusive Culture

. Diversity and inclusion are core values-your voice matters here.

. Opportunities to participate in employee resource groups and community initiatives., CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $62,900.00 - $139,300.00.

CGI’s benefits are offered to eligible professionals on their first day of employment to include:

. Competitive compensation including profit participation program

. Comprehensive medical, dental, and vision benefits

. Basic life and accidental death & dismemberment insurance

. Matching contributions through 401(k) plan, and CGI share purchase plan

. Flexibility and paid accrued vacation leave, ranging from 10 to 20 days per year, based on job level, years of relevant prior experience, and years of service

. 10 paid holidays per year

. At least 80 consecutive hours of paid sick/safe leave (except where applicable state/local law requires more)

. Paid parental leave, ranging from 20 to 70 consecutive business days based on circumstances of leave and applicable laws

. Bereavement leave, ranging from 1 to 7 days per year based on relationship.

. Paid jury duty leave, up to time summoned

. Learning opportunities and tuition assistance

. Wellness and Well being programs

About the company

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you’ll reach your full potential because…

You are invited to be an owner from day 1 as we work together to bring our Dream to life. That’s why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company’s strategy and direction.

Your work creates value. You’ll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise.

You’ll shape your career by joining a company built to grow and last. You’ll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons.

Come join our team-one of the largest IT and business consulting services firms in the world.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.techcareers.com
Prepare application

Good distractions

Loading talks and stories from around this role…