Spark / Scala Senior Engineer

Design, develop, and optimize large-scale batch and streaming data pipelines using Scala and Apache Spark. Build robust data processing solutions using Spark SQL, DataFrames, and Datasets. Develop and maintain Spark Structured Streaming applications for real-time data ingestion and processing. Integrate data pipelines with enterprise data platforms such as Snowflake. Implement scalable data ingestion frameworks utilizing Apache Kafka and/or Apache NiFi. Perform Spark performance tuning, including: Partition optimization Caching strategies Shuffle optimization Broadcast joins Resource allocation tuning Develop clean, maintainable, and testable Scala code following functional programming principles. Participate in code reviews and establish coding standards and best practices. Create automated tests and support CI/CD pipeline improvements. Monitor production data pipelines and troubleshoot performance or data quality issues. Conduct root cause analysis and implement preventive measures. Lead technical and architectural discussions across teams. Mentor junior engineers and provide technical guidance. Collaborate with cross-functional stakeholders to deliver scalable data solutions. Required Technical Skills Scala

• Strong hands-on experience with Scala development.

• Deep understanding of:

• Case Classes
• Traits

We are looking for a highly skilled Spark/Scala Senior Engineer with 8 to 10 years of experience in designing, developing, and optimizing large-scale batch and real-time data processing solutions. The ideal candidate will possess strong expertise in Scala, Apache Spark, Snowflake, Kafka/NiFi, and modern Data Engineering frameworks. This role requires hands-on technical leadership, performance optimization expertise, and the ability to mentor junior team members while driving engineering best practices, * Collections Framework

• Implicits

• Strong knowledge of Functional Programming concepts:

• Immutability
• Higher-Order Functions (HOFs)
• Monads
• Experience developing and maintaining production-grade Scala applications.

Apache Spark

• Strong expertise with:

• Spark SQL
• DataFrames
• Datasets
• Extensive experience with Spark Structured Streaming.

• Deep understanding of Spark internals:

• DAG Execution
• Lazy Evaluation
• Shuffle Operations
• Stage Execution
• Experience optimizing large-scale Spark workloads.

• Hands-on experience with:

• Parquet
• Avro
• ORC
• Delta Lake
• Apache Kafka
• Apache NiFi

Snowflake

• Experience designing and querying Snowflake data warehouse schemas.

• Familiarity with:

• Snowflake Stages
• File Formats
• Streams
• Tasks
• Knowledge of Snowpark for Scala is preferred.

Data Engineering & Development

• Strong SQL and query optimization skills.
• Experience with Git-based version control workflows.
• Familiarity with Docker and containerized application development.
• Experience working within Agile development environments., Engineering Degree BE/ME/BTech/MTech/BSc/MSc. Technical certification in multiple technologies is desirable. Good to have skills: - Pharmacy Domain

We focus on building highly motivated engineering teams and thought leaders with an entrepreneurial mindset, centered on our core values of Passion, Respect, Openness, Unity, and Depth (PROUD) of knowledge. Our success lies in creating a fun, transparent, non-hierarchical, diverse work culture that focuses on continuous learning and work-life balance. Rated by our employees as the ‘Great Place to Work for’ according to the Great Place to Work survey. We offer you a comprehensive set of benefits to ensure that you have a long and rewarding career with us. Our EVP Be You Be Awesome is our EVP and it reflects our continuing efforts to create CitiusTech as a great place to work where our employees can thrive, both personally and professionally. It encompasses the unique benefits and opportunities we offer to support your growth, well-being, and success throughout your journey with us and beyond. Together with our clients, we are solving some of the greatest healthcare challenges and positively impacting human lives. Welcome to the world of Faster Growth, Higher Learning, and Stronger Impact. Join CitiusTech. Be You. Be Awesome. To learn more about CitiusTech, visit follow us