> Markdown version of [/jobs/ext/3544123-senior-software-engineer-big-data](https://www.wearedevelopers.com/jobs/ext/3544123-senior-software-engineer-big-data). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Senior Software Engineer (Big Data) - **Company:** BitSight Technologies - **Location:** Boston, MA, United States (Remote available) - **Experience:** Expert - **Salary:** $135,000.0 - $150,000.0 - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Adobe InDesign, Data Analysis, Apache HTTP Server, Big Data, Cyber Security, Computer Programming, Continuous Integration, Data Structures, Cursor, Programming Tools, Elasticsearch, Apache Hadoop, Iterative and Incremental Development, Python (Programming Language), GitHub Copilot, Large Language Models, Apache Spark, Kubernetes, Data Lakehouse, Data Pipelines, OpenSearch - **Published:** October 2, 2026 - **Apply:** https://diversityjobs.com/main/sendform/8/8/28176/1/18508537?backUrl=%2Fcareer%2F18508537%2FSenior-Software-Engineer-Big-Data ## About the Role We are looking for developers with a passion for building software to collect, aggregate, and analyze data at scale using continuous, incremental development methodologies. Working with a close-knit team across multiple locations, you will help us architect and evolve the pipeline to support even larger volumes via cloud data warehouses. You will bring actionable security insights to the customer through integrating new data sources, surfacing new features from existing data, and refining the rating algorithm. Collaborating with data science and research teams, you will build trust with Bitsight customers in the quality and integrity of our data. Apart from domain skills, what we truly value are strong generalists: those with the critical thinking skills to use a variety of technologies and languages and pick up new concepts when needed. Strong collaboration skills are a must. We offer an opportunity to make a unique impact, not just as an individual but on the entire engineering team. What We're Looking For: * Prior experience building and operating large-scale data pipelines * Strong proficiency in modern Java language programming * Strong computer science fundamentals in design, data structures, and algorithms * Experience working with a team of engineers, designers, and product owners in delivering a product to end-users * Excellent (English) written and verbal communication skills Preferred Skills: * Experience with Python * Experience with Hadoop, Spark ecosystems * Experience with Data Lakehouse tech stack (e.g., Apache Iceberg) * Experience with Elasticsearch or OpenSearch * Experience with CI/CD and Kubernetes * Experience with modern AI development tools (e.g., GitHub Copilot, Cursor, or LLMs) * Experience working in the IT security domain ## Related Videos - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Inside Bitpanda's Tech Stack: Scaling a European Fintech Leader - Markus Dorner](https://www.wearedevelopers.com/videos/1979-inside-bitpanda-s-tech-stack-scaling-a-european-fintech-leader-markus-dorner) - [Search and aggregations made easy with OpenSearch and NodeJS](https://www.wearedevelopers.com/videos/490-search-and-aggregations-made-easy-with-opensearch-and-nodejs) - [".Net is too slow" was not an option](https://www.wearedevelopers.com/videos/100176-net-is-too-slow-was-not-an-option) - [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering) - [Boosting OpenSearch Performance: gRPC Search in Action](https://www.wearedevelopers.com/videos/1935-boosting-opensearch-performance-grpc-search-in-action) ## Related Articles - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know) - [Data Engineer Salary UK](https://www.wearedevelopers.com/magazine/253-data-engineer-salary-uk) - [Dev Digest 121 - AI goes offline](https://www.wearedevelopers.com/magazine/456-dev-digest-121-ai-goes-offline) - [Dev Digest 120 - Apple and peers](https://www.wearedevelopers.com/magazine/455-dev-digest-120-apple-and-peers)