Senior Data Engineer

Job Summary: We are seeking a Senior Data Engineer with 3-5 years of experience in building and maintaining robust data pipelines for our SaaS platform, ensuring high-quality data is available for analysis and decision-making. You will work closely with cross-functional teams to support data-driven initiatives and contribute to the development of innovative solutions., * Web Crawling and Data Extraction:

• Develop, deploy, and maintain web crawlers using Python to extract data from websites and social media platforms.
• Ensure the scalability, reliability, and efficiency of web scraping processes.
• Data Cleaning and Preprocessing:
• Perform data cleaning, standardization, and normalization to ensure data quality and consistency.
• Handle missing data, outliers, and inconsistencies in large datasets.
• Data Analysis and Modeling:
• Analyze extracted data using advanced statistical and machine learning models.
• Collaborate with data scientists to implement state-of-the-art models for predictive and prescriptive analytics.
• Financial Data Expertise:
• Leverage past experience in financial data analysis to provide insights and support decision-making processes.
• Work with financial datasets to identify trends, patterns, and anomalies.
• Data Pipeline Development:
• Design and maintain ETL (Extract, Transform, Load) pipelines to streamline data workflows.
• Integrate data from multiple sources and ensure seamless data flow across systems.
• Collaboration and Communication:
• Work closely with cross-functional teams, including data scientists, analysts, and business stakeholders.
• Communicate findings and insights effectively through visualizations, reports, and presentations.

Do you have experience in Python?, Do you have a Bachelor's degree?, * Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field.

• 3-5 years of experience as a Data Engineer or in a similar role

· Proficiency in Python for web crawling (e.g., using libraries like Scrapy, BeautifulSoup, or Selenium).

• Strong knowledge of data cleaning, standardization, and normalization techniques

· Experience with data analysis and modeling using libraries such as Pandas, NumPy, Scikit-learn, or TensorFlow.

· Familiarity with SQL and database management systems (e.g., PostgreSQL, MySQL).

· Experience with cloud platforms (e.g., AWS, Azure, GCP) and big data tools (e.g., Spark, Hadoop) is a plus.

· Prior experience in financial data analysis is highly preferred.

· Understanding financial datasets, metrics, and industry trends.

Preferred Qualifications:

· Experience with API integrations and working with RESTful APIs.

· Knowledge of data visualization tools (e.g., Tableau, Power BI, or Matplotlib/Seaborn).

· Familiarity with version control systems (e.g., Git).

· Experience with containerization tools (e.g., Docker, Kubernetes).

· Past experiences working in Fintech, Financial Services or related industries.

· Competitive salary and benefits package.

· Opportunities for professional growth and development.

· A collaborative and innovative work environment.

· The chance to work on cutting-edge projects with a talented team.

How to Apply: Please submit your resume, cover letter, and any relevant portfolio or GitHub links to eric@verityv.com. We are excited to hear from you!

Job Types: Full-time, Permanent

Pay: £40,000.00-£80,000.00 per year