Lead Data Engineer

CGI is looking for a Lead Data Engineer. This role will require someone at our client site in Pittsburgh, PA. . Work on projects for one of the largest financial institutions in the US. . Work in a challenging technical environment and gain exposure to advanced tools and technology suites . Should be able to work independently and manage the work on their own . You will work closely with your team and Product Owner, and peer Scrum Masters to support Sprint and Release Planning, foster team self-awareness, encourage cross-training, decision-making, and continuous improvement, CGI is looking for a Lead Data Engineer to join our on-site team. This candidate should have extensive hands-on experience working with Python, Spark, SQL, Elastic Search (ELK), and Reporting (ELK) . Manage and coordinate with the offshore team to ensure deliverables are met. . Interact with project stakeholders on a day-to-day basis and report on project status to the Client Management team . Build and optimize Spark Streaming applications for real-time ingestion, transformation, and event-driven processing using Kafka or other messaging systems. . Excellent communication skills and work independently . Provide insights to the team on value adds and process efficiencies . The candidate should have hands-on experience with the Kafka streaming platform and the ELK (Elastic) stack. . Build CI/CD workflows using Git, Jenkins, and Bitbucket for automated deployments and version control. . Collaborate with cross-functional teams to troubleshoot, monitor, and improve data pipelines in production environments. . Ensure compliance with data security, governance, and access control practices. . The ideal candidate will have a can-do attitude, passion for technology, extensive analysis coding. This candidate will serve as a technical expert of a large-scale digital development project consisting of both on-shore and off-shore developers.

8+ yrs of professional experience in software development and/or data engineering. . 5+ yrs of hands-on experience working with relational databases, including Oracle, Teradata, and MySQL. . 6+ yrs of hands-on experience with Python and PySpark development. (Mandatory) . 3+ yrs Hands-on Experience with Kafka Streaming Platform (Mandatory) . 3+ yrs Hands-on Experience with Elastic Search (ELK Stack) and building reporting dashboards (ELK) (Mandatory) . Experience in Data Analysis . Experience with Hadoop ecosystem, i.e., Hadoop, Hive, Spark, Scala, Sqoop, Flume, . Knowledge on Banking Domain/Products . Experience with modern workflow/orchestration tools (e.g., Apache Airflow, Oozie, etc.) . Experience working with Data Observability within a streaming platform would be a plus. Experience with containerization and orchestration (e.g., Docker, Kubernetes) is an advantage. . Knowledge of CI/CD tools like Git, Jenkins, and Bitbucket. . Understanding of job monitoring, logging, and performance tuning for both batch and streaming workloads. . Strong analytical abilities. . Agile experience is required with Jira tool expertise . Provide hands-on technical solutions to business challenges & translate them into process/ technical solutions . Good knowledge of CI/CD and DevOps principles . Learning knowledge in GenAI, Azure OpenAI, and GPT . Deliver high-quality work and adapt to new challenges, as an individual or as part of a team . Excellent communication and thought leadership skills . Excellent interpersonal skills, including the ability to work with diverse personality types and understand technical issues. . Knowledge of Banking Domain . Knowledge of streaming platforms . Knowledge of BIAN standards, * Apache Kafka

• Business Analysis
• Data Analysis
• RESTful (Rest-APIs)

CGI is required by law in some jurisdictions to include a reasonable estimate of the compensation range for this role. The determination of this range includes various factors not limited to skill set, level, experience, relevant training, and licensure and certifications. To support the ability to reward for merit-based performance, CGI typically does not hire individuals at or near the top of the range for their role. Compensation decisions are dependent on the facts and circumstances of each case. A reasonable estimate of the current range for this role in the U.S. is $70,800.00 - $156,700.00. CGI's benefits are offered to eligible professionals on their first day of employment, including: . Competitive compensation . Comprehensive insurance options . Matching contributions through the 401(k) plan and the share purchase plan . Paid time off for vacation, holidays, and sick time . Paid parental leave .Learning opportunities and tuition assistance . Wellness and Well-being programs #LIPS1

Life at CGI is rooted in ownership, teamwork, respect and belonging. Here, you'll reach your full potential because… You are invited to be an owner from day 1 as we work together to bring our Dream to life. That's why we call ourselves CGI Partners rather than employees. We benefit from our collective success and actively shape our company's strategy and direction. Your work creates value. You'll develop innovative solutions and build relationships with teammates and clients while accessing global capabilities to scale your ideas, embrace new opportunities, and benefit from expansive industry and technology expertise. You'll shape your career by joining a company built to grow and last. You'll be supported by leaders who care about your health and well-being and provide you with opportunities to deepen your skills and broaden your horizons. Come join our team-one of the largest IT and business consulting services firms in the world.