> Markdown version of [/jobs/ext/2872337-big-data-developer-black-lotus-labs](https://www.wearedevelopers.com/jobs/ext/2872337-big-data-developer-black-lotus-labs). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md).

---

# Big Data Developer (Black Lotus Labs)

- **Company:** Lumen Inc
- **Location:** Atlanta, GA, United States (Remote available)
- **Salary:** $132,232.0 - $176,310.0
- **Contract:** Permanent contract
- **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Big Data, Extract Transform Load (ETL), Relational Databases, DevOps, Apache Hadoop, Apache Hive, IBM Notes, JSON, Python (Programming Language), Standard Sql, Scala (Programming Language), Extensible Markup Language (XML), Data Processing, Data Ingestion, Apache Spark, Information Technology, Apache Kafka, Data Pipelines, Programming Languages
- **Published:** September 13, 2026
- **Apply:** https://dejobs.org/x/x/045EC63C9AE94DBA98DA07D6C518A7B1/job/

## About the Role

* Master's or Bachelor's degree in Computer Science, Engineering, Mathematics, or related field, or equivalent work experience
 * Prior experience in developing data ingestion, data processing and analytical pipelines with big datatechnologies, such as Spark, Kafka, Hadoop, Hive, etc.
 * Proficient in programming languages, such as Python, Java, Scala, or SQL
 * Experience with DevOps practices and tools
 * Strong analytical and problem-solving skills, and attention to detail
 * Strong communication, leadership, and teamwork skills
 * Eager to learn new skills and technologies, and willing to take on challenges

## Description

We are seeking a Big Data Developer to build and optimize large-scale data solutions that help identify and disrupt malicious threats across the Internet. In this role, you'll leverage cutting-edge technologies, work alongside talented engineers and security professionals, and play a key role in protecting critical digital infrastructure.

As part of a collaborative, mission-driven team, you'll have the opportunity to lead innovative projects, influence technical direction, and grow your expertise while solving complex cybersecurity challenges at scale., * Lead the design, development, and implementation of big data solutions that allow the organization to identify and disrupt malicious threats on the Internet.

 * Architect and build scalable and reliable data pipelines using technologies like Spark, Kafka, Hadoop, and other big data technologies
 * Collaborate with cross functional teams to understand data requirements and provide solutions to achieve business objectives
 * Extract, transform, and load data from various sources and formats, such as relational databases, APIs, JSON, XML, CSV, etc.
 * Ensure data quality, integrity, and security across all data processes
 * Develop scalable systems that enable real-time validation of identified resources
 * Mentor and guide junior developers fostering a culture of continuous learning and improvement
 * Explore, evaluate, and conduct PoC to determine new technology solutions that would improve our ability to detect newer threats or add efficiency to current data processing pipelines


## Related Videos

- [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology)
- [Tips and Tricks for Working with JSON](https://www.wearedevelopers.com/videos/1229-tips-and-tricks-for-working-with-json)
- [From DevOps to Scaled DevOps: How We’re Rebuilding Continuous Delivery as a Platform](https://www.wearedevelopers.com/videos/100018-from-devops-to-scaled-devops-how-we-re-rebuilding-continuous-delivery-as-a-platform)
- [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data)
- [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions)
- [Modern Data Architectures need Software Engineering](https://www.wearedevelopers.com/videos/1030-modern-data-architectures-need-software-engineering)

## Related Articles

- [Top Big Data Technologies That You Need to Know](https://www.wearedevelopers.com/magazine/108-top-big-data-technologies-that-you-need-to-know)
- [Making Data Warehouses Fast: A Developer’s Story](https://www.wearedevelopers.com/magazine/107-making-data-warehouses-fast-a-developer-s-story)
- [What Are Large Language Models?](https://www.wearedevelopers.com/magazine/304-what-are-large-language-models)
- [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers)
- [7 Most Popular Web Developer Jobs in Europe](https://www.wearedevelopers.com/magazine/163-7-most-popular-web-developer-jobs-in-europe)
- [The Most Popular IT Jobs on the Market](https://www.wearedevelopers.com/magazine/376-the-most-popular-it-jobs-on-the-market)