Remote Senior Data Engineer

• Develop scalable systems and reusable components that serve as reference points for new team members.
• Create efficient data workflows using distributed computing tools, particularly for large-scale processing and aggregation.
• Build responsive, asynchronous APIs and backend processes capable of handling high data volumes with minimal delay.
• Utilise AI-powered development tools to enhance productivity and code quality.
• Collaborate within Agile teams to refine and monitor data collection systems using Scala and Java.
• Apply sound engineering principles such as test-driven development and modular design.

Technologies:

• AI
• Airflow
• AWS
• Backend
• Cloud
• Cassandra
• ETL
• Support
• Java
• Kafka
• NoSQL
• PostgreSQL
• Power BI
• Python
• RabbitMQ
• SQL
• Scala
• Spark

• Hands-on experience with Spark and Scala in commercial environments.
• Familiarity with Java and Python.
• Exposure to distributed data systems and cloud storage platforms.
• Experience designing data schemas and analytical databases.
• Use of AI tools to streamline development and debugging.
• Strong grasp of algorithmic thinking and performance optimisation.
• Proficiency with SQL and NoSQL databases such as PostgreSQL and Cassandra.
• Experience with systems like Kafka or RabbitMQ.
• Ability to build and manage ETL pipelines using tools like Airflow.