> Markdown version of [/jobs/ext/1505750-big-data-lead](https://www.wearedevelopers.com/jobs/ext/1505750-big-data-lead). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Big Data Lead - **Company:** Hexaware Technologies - **Location:** Newtown Square, PA, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Amazon Web Services, Microsoft Azure, Big Data, Cloud Computing, Data as a Services, Data Architecture, Data Integration, Extract Transform Load (ETL), Data Mining, Apache HBase, Python (Programming Language), Enterprise Messaging Systems, MongoDB, NoSQL, Open Source Technology, Performance Tuning, RabbitMQ, Scala (Programming Language), SQL Databases, Web Services, Extensible Markup Language (XML), Data Processing, Google Cloud, Cloud Platform System, Data Ingestion, Apache Spark, Data Lakes, Pyspark, Apache Flume, Information Technology, Cassandra, Data Analytics, Apache Kafka, Spark Streaming, Stream Processing, Data Pipelines, Databricks, Programming Languages - **Published:** July 30, 2026 - **Apply:** https://www.dice.com/job-detail/304c661f-975d-4960-aa7a-356fb1bd944b ## About the Role * 6+ Years hands on knowledge on SQL as well as SQL/NoSQL databases. * Proficient in programming languages such as Python, PySpark, Scala and Java * Experience with Spark , Databricks. * Working knowledge of XML, ETL, API and Web Services. * Experience with integration of data from multiple data sources. * Experience with NoSQL databases, such as HBase, Cassandra, MongoDB. * Knowledge of various ETL techniques and frameworks, such as Flume. * Experience with various messaging systems, such as Kafka or RabbitMQ. * Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming. * Working knowledge and experience in Big data services in one of the Cloud Provider will be good (AWS or Azure or Google Cloud Platform). * Experience in leading offshore teams. Essential Qualification * BE/Btech in Computer Science, Engineering or relevant field. ## Description * Design & Implement Data ingestion and Data lakes-based solutions using Big Data Technologies. * The Tech Lead should be highly proficient in the use of Big Data / Open-Source Technologies and standard techniques of Data Integration, Data Manipulation. * Should be able to design and develop cost efficient and performant data pipelines in the cloud platform. * Create data environment to support our data analytics, reporting and data science teams. * Experience with integration of data from multiple data sources. * Knowledge of various Data Pipeline techniques and frameworks. * Performance optimization - need to monitor the complete process and apply necessary infrastructure changes to speed up the query execution. * Efficient data ingestion - Discovering patterns in data sets with data mining techniques and using different data ingestion APIs and inject data into the data lake as per need. The Role offers * Great opportunities to learn various tools and technologies used in sophisticated data architecture within the Business Intelligence and Analytics Data Services. * Gives an opportunity to showcase candidates strong analytical skills and problem-solving ability. * An outstanding opportunity to re-imagine, redesign, and apply technology to add value to the business and operations. * Grow into a Technical architect role over a period. ## Related Videos - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) - [40 Minutes to Build a Serverless COVID-19 REST and GraphQL APIs](https://www.wearedevelopers.com/videos/208-40-minutes-to-build-a-serverless-covid-19-rest-and-graphql-apis) - [Leveraging Real time data in FSIs](https://www.wearedevelopers.com/videos/806-leveraging-real-time-data-in-fsis) - [From Messy Queries to Scalable Systems - How Data Engineering actually works](https://www.wearedevelopers.com/videos/100203-from-messy-queries-to-scalable-systems-how-data-engineering-actually-works) - [NoSQL Data Modeling for Front-end Developers](https://www.wearedevelopers.com/videos/297-nosql-data-modeling-for-front-end-developers) - [Data Science in Retail](https://www.wearedevelopers.com/videos/586-data-science-in-retail) ## Related Articles - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [What Are The Top Skills Required For Azure Developers?](https://www.wearedevelopers.com/magazine/77-what-are-the-top-skills-required-for-azure-developers) - [Top-Paying Tech Jobs (with Salaries)](https://www.wearedevelopers.com/magazine/372-top-paying-tech-jobs-with-salaries)