> Markdown version of [/jobs/ext/2693009-lead-software-engineer](https://www.wearedevelopers.com/jobs/ext/2693009-lead-software-engineer). Every page supports `.md` or `Accept: text/markdown`. Links point to the HTML versions so they work for humans too. Agent guide: [/agents.md](https://www.wearedevelopers.com/agents.md). --- # Lead Software Engineer - **Company:** THERON & COMPANY LLC - **Location:** Columbus, OH, United States - **Experience:** Expert - **Contract:** Permanent contract - **Skills:** Java (Programming Language), Application Programming Interfaces (APIs), Agile Methodology, Bash Shell, Batch Processing, Big Data, Code Generation, Profiling, Data Governance, Cursor (Graphical User Interface Elements), Data Flow Control, Apache Hadoop, Job Scheduling, Python (Programming Language), Software Engineering, Software Systems, Data Streaming, GitHub Copilot, Database Optimization, Apache Spark, Information Technology, Cassandra - **Published:** September 3, 2026 - **Apply:** https://www.dice.com/job-detail/4d893fba-1607-4edb-8e9e-af4568d9b1dc ## About the Role Candidates must have technical lead experience, strong batch processing experience with Java, and big data experience with Spark, Hadoop, or Cassandra. Any expertise with Python, Claude, or Cursor is a plus., * Bachelor's degree in computer science or related discipline, or equivalent work experience. * 7+ years of software development experience. * Demonstrated professional strength in Java: shipping, maintaining, and evolving production services not occasional or peripheral use. * Strong bash scripting at scale in production dataflow and batch environments; comfort maintaining and extending large script-based systems. * Hands-on experience with Apache Spark (or Hadoop or Cassanda): developing batch workloads and troubleshooting/tuning performance and reliability (depth in patterns matters; specific cluster or vendor context can be learned on the job). * Proven experience owning large-scale batch processing and data flows: design, operation, troubleshooting, and evolution including publishing datasets or indexes at scale. * Experience with batch orchestration and job scheduling in production (enterprise schedulers, dependency chains, failure recovery, and operational runbooks). * Ability to work with messy, evolving data: inconsistent schemas, multiple sources, and changing requirements; design for robustness and incremental improvement. ## Description As a Lead Software Engineer, you will be responsible for leading software development initiatives. You will independently design, develop, and test complex software programs and systems. You will also collaborate with team members, mentor junior engineers, and provide technical guidance to ensure the delivery of high-quality software solutions. You will also collaborate with product managers, designers, and other engineers to define, refine, and implement features and enhancements., * Own and evolve large-scale data flows end-to-end batch processing, transformation, clustering, and publication of datasets and indexes ensuring they are reliable, documented, and ready for modernization. * Drive modernization of data-flow architecture: evaluate and introduce new techniques, patterns, and tooling; make build-vs-buy and technology choices; set direction others can implement against. * Lead solution design for batch and distributed processing: data quality checks, indexing strategies, replay/idempotency patterns, and integration with existing Java/Spring services and APIs. * Develop and tune Apache Spark workloads: implement batch jobs, diagnose failures, and improve performance through profiling, troubleshooting, and optimization. * Build and maintain scripting and orchestration at scale using bash (required) and related automation; coordinate long-running jobs through enterprise scheduling and operational runbooks. * Establish technical standards for batch and data-flow engineering scripting patterns, monitoring, failure handling, and operational handoff and influence practices beyond your immediate team. * Collaborate with product managers, leadership, and engineering teams to align roadmaps with product needs and translate organizational goals into executable technical strategy. * Troubleshoot and resolve complex production issues in data flows and batch systems; implement preventive, systemic improvements not one-off fixes. * Leverage and explore AI-assisted development tools (e.g., GitHub Copilot, Cursor, code generation, smart testing) where appropriate; help assess effectiveness and support adoption. * Champion agile methodologies, lead technical and design reviews, and foster cross-team collaboration. * Maintain awareness of security, data governance, and quality standards in an enterprise context. ## Related Videos - [Maximising Cassandra's Potential: Tips on Schema, Queries, Parallel Access, and Reactive Programming](https://www.wearedevelopers.com/videos/1167-maximising-cassandra-s-potential-tips-on-schema-queries-parallel-access-and-reactive-programming) - [Alibaba Big Data and Machine Learning Technology](https://www.wearedevelopers.com/videos/37-alibaba-big-data-and-machine-learning-technology) - [Remote Driving on Plant Grounds with State-of-the-Art Cloud Technologies](https://www.wearedevelopers.com/videos/251-remote-driving-on-plant-grounds-with-state-of-the-art-cloud-technologies) - [Profiling Symfony & PHP apps with Blackfire](https://www.wearedevelopers.com/videos/265-profiling-symfony-php-apps-with-blackfire) - [Why and when should we consider Stream Processing frameworks in our solutions](https://www.wearedevelopers.com/videos/1085-why-and-when-should-we-consider-stream-processing-frameworks-in-our-solutions) - [PySpark - Combining Machine Learning & Big Data](https://www.wearedevelopers.com/videos/44-pyspark-combining-machine-learning-big-data) ## Related Articles - [How We Built a Worry-Free System That Runs for 10+ Years – And What We’d Do Again](https://www.wearedevelopers.com/magazine/751-how-we-built-a-worry-free-system-that-runs-for-10-years-and-what-we-d-do-again) - [Résumé-Driven Development: How IT trends affect the job market for software developers](https://www.wearedevelopers.com/magazine/59-resume-driven-development-how-it-trends-affect-the-job-market-for-software-developers) - [Highest Paying Tech Companies for Developers](https://www.wearedevelopers.com/magazine/220-highest-paying-tech-companies-for-developers) - [Is Software Engineering Over-Saturated?](https://www.wearedevelopers.com/magazine/418-is-software-engineering-over-saturated) - [What’s the Difference between a Junior, Mid, and Senior Developer?](https://www.wearedevelopers.com/magazine/238-what-s-the-difference-between-a-junior-mid-and-senior-developer) - [Where To Find Software Engineering Jobs](https://www.wearedevelopers.com/magazine/396-where-to-find-software-engineering-jobs)