Senior Data Engineer - Genai & Automation (Databricks)

Lemon Io
Málaga, Spain
1 day ago
Apply on www.buscojobs.com.es
Prepare application

Role details

Contract type
Temporary to permanent
Employment type
Full-time (> 32 hours)
Experience required
6 years minimum
Working hours
Regular working hours
Languages
English

Tech stack

Artificial Intelligence Continuous Integration Information Engineering Github Python (Programming Language) Data Mesh Standard Sql SAP (Applications) SAP FI/CO SQL Databases GitHub Copilot Pyspark
+1 more
Databricks

Job description

Senior Data Engineer- GenAI & Automation (Databricks, Finance Data) -full-time, 3 months +strong potential to extendRemote:Europe or LATAMA role for a Senior, hands-on Data Engineer who uses agentic AI to transform how a mature finance data team works. The client isone of the world’s leading home appliance manufacturers.The contextThe Global Finance data platform serves thousands of users, with reports followed at CFO and CEO level. Pipelines run hourly around the clock across APAC, India, Europe and Oceania, and core models process around 3 billion records where every figure must match exactly. The team is strong but absorbed by operations, especially at month-end close. This is not a greenfield role - your job is to automate that load away and set a new standard by example. Roughly 80% hands?on, 20% strategy.Your first 3 monthsReview pipelines, monitoring and releases, and present an as?is ? to?be plan with about 5 concrete deliverablesBuild agent?based monitoring that detects failures and delays, applies rule?based fixes and escalates automaticallyCut manual support effort (today ~*** hours/day, target ~2-3 hours/day)Speed up delivery on a complex, interdependent data model with safer changes, better testing and impact analysisBring agentic and AI?assisted development (e.g. Databricks agents, GitHub Copilot) into the team’s daily work and coach by exampleImprove data quality visibility so issues are caught before business users see themBeyond 3 monthsGrow into the technical go?to person for the Finance innovation team, designing multi?agent workflows in Databricks to automate finance business processes.Must-haves6+ years of hands?on data engineering at senior or principal levelStrong Databricks experience at large scaleStrong SQL and dbt; Python / PySparkReal, production use of GenAI and agentic tools - agents for monitoring, automation or dev workflows (not just experiments)Production experience with pipeline monitoring, observability and data qualityA proven before/after track record improving an existing, mature platformExperience with large, high?precision datasetsFinance data experience (month?end close, P&L, sales and accounting data)Based in Europe or LATAM, able to work full CET hours; fluent EnglishNice?to?havesSAP as a data source (FI/CO, sales data) - strongly preferredDatabricks AI features (Mosaic AI / Agent Bricks, Unity Catalog)Medallion architecture / Data Mesh, CI/CD and GitHubPower BI / semantic models; large enterprise experienceHiring processCall with the Head of Finance Data & AnalyticsTechnical call with a senior data engineer from the teamThe selected candidate goes through an insider list and legal onboarding, as the role involves confidential financial data.#J-***-Ljbffr

Requirements

6+ years of hands?on data engineering at senior or principal level Strong Databricks experience at large scale Strong SQL and dbt; Python / PySpark Real, production use of GenAI and agentic tools - agents for monitoring, automation or dev workflows (not just experiments) Production experience with pipeline monitoring, observability and data quality A proven before/after track record improving an existing, mature platform Experience with large, high?precision datasets Finance data experience (month?end close, P&L, sales and accounting data) Based in Europe or LATAM, able to work full CET hours; fluent English Nice?to?haves SAP as a data source (FI/CO, sales data) - strongly preferred Databricks AI features (Mosaic AI / Agent Bricks, Unity Catalog) Medallion architecture / Data Mesh, CI/CD and GitHub Power BI / semantic models; large enterprise experience

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on www.buscojobs.com.es
Prepare application

Good distractions

Loading talks and stories from around this role…