> Markdown version of [/jobs/ext/1248888-senior-data-engineer-databricks](https://www.wearedevelopers.com/jobs/ext/1248888-senior-data-engineer-databricks). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Data Engineer-Databricks - **Company:** ExlService Holdings, Inc. - **Location:** United States (Remote available) - **Experience:** Expert - **Salary:** $110,000.0 - $150,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Agile Methodology, Amazon Web Services, Bash Shell, Big Data, Cloud Database, Information Engineering, Extract Transform Load (ETL), Data Warehousing, Database Design, Dimensional Modeling, Apache Hadoop, Apache Hive, Python (Programming Language), Linked Data, Unix Shell, Microsoft SQL Server, Oracle Databases, Oracle (Applications), Cloud Services, Azure Data Lake, Shell Script, Software Engineering, SQL Databases, Talend, Unstructured Data, Cloud Platform System, Data Ingestion, Informatica Powercenter, System Availability, Apache Spark, Data Strategy, Vba Programming Language, Data Management, Dynamic Data, Restful APIs, Looker Analytics, Data Pipelines, Databricks - **Published:** July 12, 2026 - **Apply:** https://www.indeed.com/viewjob?jk=5d62bcdf946e0e2c ## About the Role * Proven experience in software development with a strong background in data engineering within big data environments. * Extensive hands-on expertise with Databricks platform, Spark (including Apache Hive), Hadoop ecosystems, and cloud services such as Azure Data Lake or AWS Public Cloud. * Proficiency in programming languages including Python, Java, Bash (Unix shell), Shell Scripting, and VBA for automation and analysis tasks. * Deep understanding of ETL pipeline development, SQL query management, database design (including dimensional modeling), and data warehousing concepts. * Familiarity with business intelligence tools like Looker or similar platforms for visualization and reporting purposes. * Knowledge of data modeling techniques for linked data, Oracle databases, SQL databases, cloud databases, and enterprise data warehouse architecture. * Experience working with Big Data systems such as Hadoop or Spark for large-scale processing projects. * Strong analytical skills combined with excellent communication abilities to translate complex technical concepts into clear insights. * Ability to work effectively within an Agile environment while managing multiple priorities simultaneously. ## Description We are seeking a highly skilled and motivated Senior Data Engineer specializing in Databricks to join our dynamic data team. In this role, you will lead the design, development, and optimization of large-scale data systems, enabling advanced analytics and business intelligence solutions. Your expertise will drive innovative data management strategies across cloud platforms, ensuring seamless integration and high-performance processing of complex datasets. This position offers an exciting opportunity to work with cutting-edge big data technologies and contribute to impactful data-driven decision-making., * Design, develop, and maintain scalable ETL pipelines using Databricks, Spark, Python, and SQL to process vast amounts of structured and unstructured data. * Collaborate with cross-functional teams to translate business requirements into robust data models and architectures aligned with best practices in dimensional modeling and data warehousing design. * Optimize big data systems leveraging Hadoop, Azure Data Lake, AWS, and other cloud-based platforms to ensure high availability and performance. * Implement data management integration strategies utilizing Informatica, Talend, RESTful APIs, and other tools to streamline data ingestion and transformation processes. * Develop comprehensive documentation for data workflows, models, and pipelines while ensuring adherence to security standards and compliance regulations. * Support model training, analysis activities, and business intelligence reporting using Looker, SQL databases such as Oracle or Microsoft SQL Server, and cloud databases. * Participate in Agile development cycles to continuously improve data engineering solutions while maintaining flexibility for evolving project needs. ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [Cutting LLM Costs Without Cutting Quality: How to Beat Proprietary LLMs with Fine-Tuned Open Source](https://www.wearedevelopers.com/videos/100151-cutting-llm-costs-without-cutting-quality-how-to-beat-proprietary-llms-with-fine-tuned-open-source) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [Parquet, Delta, Iceberg & Ducklake - An introduction for developers](https://www.wearedevelopers.com/videos/100075-parquet-delta-iceberg-ducklake-an-introduction-for-developers) - [From A2A to MCP: How AI’s “Brains” are Connecting to “Arms and Legs”](https://www.wearedevelopers.com/videos/1631-from-a2a-to-mcp-how-ai-s-brains-are-connecting-to-arms-and-legs) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Fully Remote Software Engineer Jobs](https://www.wearedevelopers.com/magazine/447-fully-remote-software-engineer-jobs) - [Data Analyst Salary in the UK](https://www.wearedevelopers.com/magazine/278-data-analyst-salary-in-the-uk)