> Markdown version of [/jobs/ext/66279-senior-data-engineer](https://www.wearedevelopers.com/jobs/ext/66279-senior-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer - **Company:** Bluefish AI - **Location:** Berlin, Germany - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Big Data, Cloud Computing, Data Architecture, Web Scraping, Data Infrastructure, Data Transformation, Data Systems, Data Warehousing, Distributed Systems, Python (Programming Language), Data Streaming, Unstructured Data, Data Processing, Data Storage Technologies, Data Ingestion, Large Language Models, Reliability of Systems, Data Lakes, Infrastructure Automation Frameworks, Data Pipelines - **Published:** May 14, 2026 - **Apply:** https://de.indeed.com/viewjob?jk=410e0e7b45b2c9ff ## About the Role Do you have experience in Python?, Do you have a Master's degree?, * Strong experience building and operating scalable data pipelines in production environments. * Hands-on experience working with Data Lakes or Data Warehouses (e.g., AWS Athena or similar technologies). * Experience with data transformation and modeling. * Strong experience working with AWS. * Experience using Infrastructure-as-Code tools to manage cloud infrastructure. * Proficiency in Python for data processing and automation. * Experience working with distributed systems and managing large-scale data workflows. * Experience implementing monitoring, observability, and incident response practices for data systems. Nice to have: * Experience working with large-scale web scraping or external data ingestion systems. * Experience supporting systems with rapidly increasing traffic or data volume., * Demonstrated grit and resourcefulness - you find creative solutions, adapt quickly, and aren't afraid to roll up your sleeves in a fast-paced, evolving environment. * Thoughtful and strategic thinker with the ability to anticipate needs, ask the right questions, and deliver insights that truly drive value. * Proven ability to collaborate across functions and roles, fostering open communication and shared ownership of outcomes. * Commitment to craftsmanship - you take pride in delivering high-quality work, paying attention to the small details while keeping the big picture in mind. * Self-starter with a proactive mindset and a strong sense of accountability - able to drive projects forward independently while staying aligned with team goals. * Comfortable navigating ambiguity and learning new tools, processes, or technologies to get the job done. ## Description As a Senior Data Engineer, you'll play a key role in building and scaling the data infrastructure that powers our AI-driven platform. You'll be responsible for designing, implementing, and optimizing reliable and scalable data pipelines that process large volumes of structured and unstructured data, from synthetic LLM prompts to large-scale web-scraped datasets, across a growing AWS-based data ecosystem. This role is focused on enabling rapid scale. Our data volume and traffic are increasing quickly as we expand to new AI channels and data sources, and we need robust, production-grade data systems that can keep pace with that growth. You'll work closely with engineering, product, and go-to-market teams to ensure data is reliable, observable, and reusable across the organization. A core part of the role will be shaping the evolution of our data platform, including contributing to the design and implementation of our Data Lake architecture. You'll help ensure our pipelines can handle increasing load, maintain high data quality, and support new product capabilities as we scale. You'll also act as a trusted technical partner across teams, helping establish data best practices, improving operational reliability, and enabling teams to use data effectively in both product and business contexts. This role is remote in Germany. What You'll Be Doing * Design, build, and maintain scalable data pipelines that ingest, transform, and validate large volumes of data across multiple sources and channels. * Improve the scalability, reliability, and performance of our data pipelines to support rapidly growing workloads and new data streams. * Contribute to the design and implementation of our Data Lake architecture, enabling reliable data storage and reuse across teams. * Manage and optimize data ingestion workflows, including data collected from web scrapers, third-party vendors, and internal systems. * Monitor pipeline health, investigate incidents, and implement improvements to increase system reliability and observability. * Support the onboarding and integration of new AI channels and data sources into the platform. * Collaborate with teams across the organization to ensure data generated by different systems can be reused effectively for analytics and business intelligence. * Identify and resolve performance bottlenecks in distributed systems, including rate limiting, concurrency, and throughput constraints. * Advise engineering and product teams on data architecture, data quality, and best practices for managing scalable data workflows. * Continuously evaluate and improve our data platform to support the company's rapid growth and evolving product needs. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [WeAreDevelopers LIVE – Web Scraping, Agents, Actors and more](https://www.wearedevelopers.com/videos/1764-wearedevelopers-live-web-scraping-agents-actors-and-more) - [Data Governance in the Era of AI](https://www.wearedevelopers.com/videos/1622-data-governance-in-the-era-of-ai) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) ## Related Articles - [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market) - [Data Analyst Salary Germany](https://www.wearedevelopers.com/magazine/277-data-analyst-salary-germany) - [The Biggest German Tech Companies](https://www.wearedevelopers.com/magazine/424-the-biggest-german-tech-companies) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)