Senior Data Engineer | Apache NiFi

As a Senior Data Engineer (Apache NiFi), you will work at the intersection of data, technology, and business, helping our clients build and optimise robust data pipelines that transform complex data landscapes into actionable insights.

You will play a key role in designing and maintaining scalable data integration solutions, with a strong focus on Apache NiFi, enabling seamless data flows across multiple systems and platforms in a distributed environment., * Design, develop, and maintain data pipelines using Apache NiFi, ensuring efficient ingestion and transformation

• Integrate structured and unstructured data from multiple sources, including Salesforce, APIs, SFTP, SAP, and CRM, into cloud-based and on-premise databases.
• Ensure data quality, security, and governance across diverse sources and destinations.
• Optimise and troubleshoot NiFi workflows to improve performance, reliability, and scalability
• Work with APIs to fetch and send real-time data for external integrations (e.g., CustomerGauge).
• Manage and operate NiFi architecture within Kubernetes environments
• Collaborate with data scientists, analysts, and engineers to ensure data availability and usability
• Improve and optimise ETL/ELT processes for large-scale data processing
• Use NiFi Registry and Toolkit to maintain version control and streamline deployments across environments.
• Develop Bash and Python scripts for automation, monitoring, and workflow execution.
• Implement CI/CD pipelines for data pipeline deployments and workflow automation.
• Analyse and resolve data pipeline issues, ensuring high availability and reliability.

Do you have experience in Usability?, * Strong expertise in Apache NiFi, including flow design, performance tuning, version control, and security configurations.

• Experience in data ingestion, transformation, and processing for both batch and real-time workflows.
• Proficiency in SQL and NoSQL databases, such as PostgreSQL, MySQL, and MongoDB.
• Experience with big data technologies, including Apache Kafka, Spark, Hadoop, and HDFS.
• Familiarity with cloud platforms (AWS, Azure, or GCP) and their data services (e.g., AWS Redshift, Azure Synapse, Google BigQuery).
• Proficiency in at least one programming language, such as Python or Java.
• Experience with CI/CD pipelines, version control tools (Git, Jenkins), and automation frameworks.
• Strong problem-solving skills and ability to work independently in a remote environment
• Excellent communication and stakeholder management skills
• Fluency in English
• Must be Europe-based (Portugal/Spain preferred for permanent option), * Experience with data warehousing solutions (Snowflake, Redshift, BigQuery)
• Understanding of containerization and orchestration tools, including Docker and Kubernetes.
• Knowledge of data security and compliance best practices (e.g., GDPR, HIPAA)
• Experience with data lakes and real-time analytics solutions
• Background in consulting or client-facing roles

At Keyrus, salary ranges reflect different levels of mastery and impact within the same role - not different job titles.

• Bottom of the range You meet the core requirements and will need ramp-up time and support.

• Middle of the range You are fully autonomous from Day 1 and deliver consistently.

• Top of the range You are a reference for the role, mentor others, and raise the bar for the team.

Final offers are based on experience, autonomy, scope, and market context, and are discussed transparently during the process.

What We Offer at Keyrus Portugal

• Competitive salary aligned with your experience and the data market
• Meal allowance: €10.20/day
• Flexible benefits plan
• Private medical insurance
• 22 days of annual leave, increasing every 3 years (up to 25 days)
• Continuous learning via KLX - Keyrus Learning Experience
• A collaborative, international, and human-centred work environment

Keyrus is a global consulting and technology company focused on making data matter - truly matter - from a human perspective. Founded in 1996, Keyrus operates in 28+ countries across 5 continents, with more than 3,300 people worldwide. Our strength comes from combining deep expertise in Data & Analytics, AI, Digital, and Management Consulting with a strong understanding of business realities. Data is never the goal in itself. We use data to shape understanding, design meaningful experiences, and enable better, real-life decisions. At Keyrus, we also believe companies have a responsibility beyond performance. Through our Foundation and ESG initiatives, we actively contribute to sustainability, inclusion, and positive societal impact., Why Keyrus? Joining Keyrus means joining: * A market leader in Data Intelligence * A company where people, trust, and diversity are core values * An environment that values ownership, flexibility, and innovation * A place where different backgrounds and perspectives are not just welcomed = they are essential We believe diversity drives better thinking, stronger teams, and better outcomes. Everyone belongs at Keyrus. At Keyrus, all stages of our recruitment process are conducted and evaluated by human recruiters and interviewers. To support accuracy and efficiency, AI may occasionally be used internally by our team exclusively for note-taking purposes during interviews. AI is never used to make hiring decisions or evaluate candidates. To ensure fairness, authenticity, and the protection of confidential and proprietary information, the use of AI tools by candidates during the recruitment process is strictly prohibited. Our commitment to responsible AI practices ensures that hiring decisions are based solely on each candidate's own skills, experience, judgment, and expertise. ️ Any use of AI assistance during the interview process may result in immediate disqualification from the recruitment process.