Big Data Software Engineer
Role details
Job location
Tech stack
Job description
Engineering & Cloud Solutions - Build and maintain scalable data pipelines using Spark (Scala) - Design data models to support regulatory reporting requirements - Work with AWS services (S3, EMR/Glue, Lambda) to deliver efficient data solutions - Ensure performance, scalability, and cost-efficiency of data platforms 2. Data Processing & Quality - Transform large volumes of financial data ensuring accuracy and traceability - Validate data flows and replicate logic using advanced SQL - Maintain high standards of data quality, governance, and compliance - Optimize performance and reliability of reporting systems 3. Collaboration & Agile Delivery - Collaborate with Risk, Finance, and Compliance teams to translate requirements into technical solutions - Work within Agile environments and contribute to continuous delivery - Use CI/CD and DevOps tools (Git, Jenkins, etc.) to support deployments - Communicate effectively with both technical and non-technical stakeholders What We're
Requirements
Looking For - Strong experience with AWS and cloud-based data solutions - Solid background in Big Data technologies (Spark, Scala, Hive) - Advanced SQL skills for validation and data analysis - Experience with version control and DevOps tools (Git, Jenkins, etc.) - Around 5 years of experience in similar roles - Degree in Computer Science, Engineering, Mathematics or equivalent experience Nice to Have - Experience in financial services or banking environments - Knowledge of scheduling tools such as Control-M - Familiarity with Unix/Linux environments - Experience in data analysis and documentation - Exposure to GenAI tools applied to data or engineering workflows Location: 100% remote About Qaracter Qaracter is an international consulting firm working on digital transformation projects for clients across multiple industries. While we collaborate with organizations from different sectors, the majority of our work is focused on banking and insurance, operating in