> Markdown version of [/jobs/ext/1889252-sr-data-engineer](https://www.wearedevelopers.com/jobs/ext/1889252-sr-data-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Sr. Data Engineer - **Company:** BambooHR LLC - **Location:** United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Artificial Intelligence, Amazon Web Services, Software Applications, Big Data, Business Systems, Cloud Database, Information Systems, Information Engineering, Data Governance, Data Mart, Data Systems, Data Warehousing, Cursor (Graphical User Interface Elements), Software Design Documents, Document-Oriented Databases, Python (Programming Language), Machine Learning, Netsuite, Query Optimization, Salesforce.Com, SQL Databases, Data Streaming, Unstructured Data, Management of Software Versions, Feature Engineering, Data Ingestion, Retrieval-Augmented Generation, Large Language Models, Multi-Agent Systems, Generative AI, Change Data Capture, Git, Data Lakes, AI Platforms, Pyspark, Core Data, Information Technology, Marketo, Data Management, Machine Learning Operations, Data Pipelines, Databricks, Zuora - **Published:** August 2, 2026 - **Apply:** https://www.dice.com/job-detail/ef14e785-f6e2-47d6-9f82-2546ecef7c4b ## About the Role * Ability to gather requirements and translate business processes into data, ML, and AI solutions * Comfortable working cross-functionally with both technical and non-technical stakeholders * Ability to quickly learn new domains and technologies Core Technical Skills * Strong Python development experience * Advanced SQL development and query optimization skills * Understanding of Databricks and large-scale data processing * Experience building and scaling data pipelines using Databricks and PySpark * Deep understanding of data lake, lakehouse, data warehouse, and data mart architectures * Experience with data modeling across a variety of business domains * Experience with modern data tooling (e.g., dbt or similar transformation frameworks) * Knowledge of data formats, data patterns, and modeling best practices * Experience with cloud platforms (AWS preferred) * Experience with CI/CD pipelines in a data engineering environment * Git-based development workflows AI, ML & MLOps Skills * Hands-on experience with AI prompt and agent frameworks (e.g., Claude Code, Cursor, Windsurfer, or similar) * Experience building AI agents and agentic workflows * Exposure to LLMs, embeddings, vector databases, or generative AI systems * Familiarity with handling structured and unstructured data (e.g., text, logs, embeddings) * Experience building or supporting machine learning pipelines in production * Familiarity with AI and MLOps in Databricks * Experience with ML feature engineering and feature stores * Understanding of ML model lifecycle management, monitoring, and evaluation Beyond technical skills, we're looking for someone who is: * A clear and effective communicator * Analytical and pattern-oriented * Creative in both engineering and AI/data modeling approaches * Detail-oriented and persistent in solving problems * Comfortable working in a fast-paced, dynamic environment * Passionate about learning and continuously improving-especially in the evolving AI/ML landscape * Bachelor's degree in computer science, information systems, a quantitative field, or equivalent practical experience What Will Make Us REALLY Love You * Familiarity with common business metrics across multiple domains * Exposure to business systems like Netsuite, Salesforce, Marketo, Zuora, Gainsight, or Pendo * Experience building KPI frameworks or domain-specific models (e.g., attribution, funnel, retention, financial metrics) * Experience with streaming data and change data capture (CDC) * Experience with real-time ML inference systems ## Description As a Senior Data Engineer, you will play a key role in designing, building, and operating scalable data platforms, analytics systems, and AI/ML infrastructure. We'll rely on your expertise across data, analytics, ML, and AI engineering to develop, automate, and maintain pipelines and intelligent systems. Your ability to use AI in building reliable, performant, and scalable data, ML, and AI systems-effectively building and leveraging AI agents and agentic workflows-will be critical to your success. You will: * Collaborate with data analysts, data scientists, ML engineers, software engineers, and business stakeholders to enable effective use of core data assets * Design, develop, and maintain scalable data ingestion and transformation pipelines using Python, SQL, and modern data tooling * Build and optimize data lake, lakehouse, warehouse, and data mart architectures * Develop and maintain data models including facts, dimensions, feature datasets, and domain-specific data products * Translate business requirements into design documents (e.g., ERDs, data flow diagrams) data models and ML feature pipelines * Design and manage cloud-based data and ML infrastructure (Databricks preferred), including development, staging, and production environments * Design, build, and operationalize machine learning pipelines for training, validation, deployment, and observability (e.g., performance, drift, reliability) * Support ML model lifecycle management, including versioning, reproducibility, and lineage * Develop and maintain ML feature stores and reusable feature pipelines for ML models * Build and integrate AI-powered applications and agentic workflows (e.g., LLM-based agents, retrieval-augmented generation systems, workflow automation agents) * Design and implement data pipelines for AI systems, including unstructured data (text, logs, embeddings, vector stores) * Develop and maintain unit, integration, and data quality tests * Participate in peer code reviews, pull requests, and team coding standards * Document data pipelines, ML pipelines, models, infrastructure, and standard operating procedures * Define infrastructure as code and support CI/CD pipelines for data and ML systems * Ensure data privacy, security, and access control best practices (including AI data governance considerations) * Identify and implement improvements in efficiency, scalability, resilience, and performance * Contribute to evolving data, ML, and AI platform architecture, tools, and best practices You'll help power analytics, machine learning, and intelligent decision-making across domains such as finance, marketing, sales, product, and customer experience., Our process utilizes AI as an assistant to efficiently process and analyze candidate data. Recruiters and hiring managers maintain full oversight and accountability, ensuring that all final selection and rejection decisions are human-made and based solely on objective job qualifications. Please see our General Privacy Notice and California Privacy Notice for more details. ## Related Videos - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [How a Small Team Shrank a Microsoft Monorepo by 94%](https://www.wearedevelopers.com/videos/1236-how-a-small-team-shrank-a-microsoft-monorepo-by-94) - [Empowering Retail Through Applied Machine Learning](https://www.wearedevelopers.com/videos/976-empowering-retail-through-applied-machine-learning) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Git for Code Reviews](https://www.wearedevelopers.com/videos/429-git-for-code-reviews) ## Related Articles - [Coffee with Developers - Maria Apazoglou - Making AI understandable for all in production](https://www.wearedevelopers.com/magazine/475-coffee-with-developers-maria-apazoglou-making-ai-understandable-for-all-in-production) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [MLOps – What’s the deal behind it?](https://www.wearedevelopers.com/magazine/125-mlops-what-s-the-deal-behind-it) - [How to Become an AI Engineer](https://www.wearedevelopers.com/magazine/331-how-to-become-an-ai-engineer) - [Navigating the AI Shift](https://www.wearedevelopers.com/magazine/629-navigating-the-ai-shift) - [MLOps And AI Driven Development](https://www.wearedevelopers.com/magazine/82-mlops-and-ai-driven-development)