Data Engineer

Build scalable data pipelines for sourcing, transforming and publishing data assets for research and commercial use cases

• Work collaboratively with other engineers, data scientists and product owners to build the next generation data platform products and services.

Ability to identify, analyse, and resolve complex technical issues, ensuring optimal performance, scalability, and user experience.

• Architecting, Designing and building data platforms preferably in financial domains

• Dedication to writing clean, maintainable, and well-documented code with a focus on application quality, performance, and security.

• Infrastructure-as-Code

• Security awareness (RBAC, networking, encryption at rest etc.)

• Positive attitude towards LLM assisted development

• Preferred Toolset:

• Python (Pandas, Apache Airflow, PySpark, SQLAlchemy, Dask, Great Expectations, ScikitLearn)

• Linux

• Containers (e.g. Docker)

• Data bases (e.g. PostgreSQL)

• AWS (CDK/Python, Bedrock, Sagemaker)

• Demonstrated interpersonal skills and ability to work closely with cross-functional teams, including product managers, designers, and other engineers.

• Ability to clearly communicate complex technical concepts to both technical and non-technical stakeholders.

• Passion for learning new technologies and staying up to date with industry trends and best practices

• Proven ability to collaborate and contribute to a positive, inclusive work environment, fostering knowledge sharing and growth within the team.

• Ability to deal with ambiguity and react quickly in an evolving and fast paced environment.

• Ability to work autonomously, under pressure and with conflicting and changing priorities.

• Excellent verbal and written communication skills

• Personable approach with ability to develop positive working relationships at all levels within an organisation

• Self-motivated and proactive

Venesky-Brown's client, a public sector organisation in Edinburgh, is currently looking to recruit a Data Engineer for an initial 5 month contract on a rate of £550/day (inside IR35). This role will be hybrid with 2 days per week in the office.