Big Data Engineer

Smadex
yesterday

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Working hours
Regular working hours
Languages
English
Experience level
Junior

Job location

Remote

Tech stack

Java
Agile Methodologies
Airflow
Amazon Web Services (AWS)
JIRA
Bash
Big Data
Databases
Information Engineering
DevOps
Python
Machine Learning
Memcached
Microsoft OneNote
MySQL
Redis
Standard Sql
Scala
Cloud Platform System
Data Ingestion
Google Search
Spark
GIT
Information Technology
Data Pipelines
Docker
Jenkins

Requirements

Smadex is a cutting-edge ad-tech company: we process more than 4.5 million ad requests per second, replying under 100 ms (for reference, the Google search engine handles ~76,000 QPS). Every day we generate several TBs of data that need to be processed, analyzed and aggregated, so our real-time components get smarter every day. If you are ready to boost your professional career in the tech world, this is your opportunity. You will join our core engineering team, a collaborative group of experienced engineers responsible for enabling complex data to be available in the real-time bidding platform for the Machine Learning models to use. We're looking for an enthusiastic Junior Data Engineer who is passionate about data pipelines and excited by extreme performance challenges. Your success will be measured by your ability to help build robust data pipelines, deliver high-quality features, and collaborate closely with the team while eagerly learning and applying your knowledge effectively. You will dive into a dynamic environment, tackling short-cycle tasks such as implementing complex data ingestion services, following a "you build it, you run it" philosophy. Design, develop, and implement Data features for the Machine Learning models to use. Quality Assurance : Write clean, efficient, testable code and thoroughly test work locally and in a sophisticated staging environment. Operational Excellence : Monitor deployments and help ensure the stability, reliability and performance of production systems. Agile Collaboration : Collaborate with the team in an agile environment, participating in planning and reporting on progress. A Bachelor's degree in Computer Science or a related technical field. ~1-2 years of experience in Software or Data engineering. ~ SQL Knowledge. ~ Python or Java knowledge. ~ Interest in Big Data, Machine Learning and Data Engineering. ~ Excellent communication skills in English (written and spoken). Scala knowledge. Experience with Key-Value stores and in-memory databases (e.g. Redis, Memcached). Familiarity with cloud environments, particularly AWS. Experience with Airflow workflows. Experience in Big Data. Experience with Spark. Python, Scala and bash. Frameworks: Spark. Databases: MySQL, Redis. Cloud & DevOps: AWS, Jenkins, Docker, Airflow. Tools: Git, Jira, Notion. Opportunity to work in a complex environment and gain experience from it. Directly add value to the business with the projects that you are assigned. Great work-life balance: work from home (2 days per week) and flexible hours. Professional development with a LinkedIn Learning subscription and other training opportunities. Please note that we do NOT provide VISA sponsorship. Candidates without a legal permit to work in Spain won't be considered.

Apply for this position