Software Engineer

We are seeking a skilled Software Engineer to design, build, and maintain data-driven systems and applications. You will work closely with cross-functional teams to help organisations collect, manage, analyse, and leverage data to support business operations and decision-making., * Develop and maintain scalable software solutions for data processing and analysis

• Build and optimise data pipelines and workflows
• Integrate APIs and third-party systems
• Collaborate with data scientists to deploy machine learning models
• Ensure data quality, integrity, and security
• Design and manage databases and storage solutions
• Work with cloud platforms such as Amazon Web Services or Google Cloud
• Use tools like Apache Spark for large-scale data processing
• Containerise applications using Docker
• Design and implement end-to-end data pipelines
• Build reusable, testable, and efficient code for data-driven applications
• Optimise system performance for large-scale data workloads
• Monitor, debug, and troubleshoot production systems and data issues
• Implement data validation, logging, and error-handling mechanisms
• Work with real-time and batch processing systems (e.g., Apache Kafka, Apache Spark)
• Collaborate with stakeholders to understand business requirements and translate them into technical solutions
• Develop and maintain internal tools, dashboards, and APIs
• Support deployment and maintenance of ML models in production environments
• Ensure compliance with data governance, privacy, and security standards
• Participate in code reviews and contribute to engineering best practices
• Automate workflows and reduce manual data handling
• Work in Agile/Scrum teams and contribute to sprint planning

• Strong programming skills in Python, Java, or similar
• Experience with data manipulation using Pandas and NumPy
• Knowledge of SQL and database systems
• Understanding of software engineering principles (OOP, version control, testing)
• Familiarity with RESTful APIs
• Basic understanding of machine learning concepts
• Experience with ML frameworks like TensorFlow or PyTorch
• Knowledge of workflow tools like Apache Airflow
• Experience with data visualisation tools such as Tableau
• Familiarity with CI/CD pipelines and DevOps practices
• Strong Python skills (plus Java/Scala is a bonus)
• Experience with backend frameworks (e.g., Flask, FastAPI)
• Version control using Git (e.g., GitHub)
• Experience with relational (PostgreSQL, MySQL) and NoSQL databases like MongoDB
• Data warehousing concepts (e.g., Snowflake, BigQuery)
• Experience with microservices architecture
• Knowledge of distributed systems design
• Familiarity with MLOps practices
• Exposure to NLP or computer vision projects
• Experience working with big data ecosystems