Sr. Software & LLM Integration Developer [D.24.0083]

Description: We are looking for an experienced Senior Software Engineer to join our team and drive the integration of Large Language Models (LLMs) into our large-scale systems. The ideal candidate will have a strong background in software engineering, system architecture, and experience working with LLMs. You will play a crucial role in designing, developing, and maintaining scalable and efficient systems that leverage the power of LLMs to enhance our products and services., * Architect and implement robust, scalable, and fault-tolerant systems that integrate LLMs seamlessly.

• Collaborate with cross-functional teams, including data scientists, ML engineers, and product managers, to identify and prioritize integration opportunities.
• Design and develop APIs, microservices, and data pipelines to facilitate LLM integration.
• Optimize system performance, ensuring high throughput and low latency for real-time LLM-powered features.
• Establish best practices for monitoring, logging, and troubleshooting LLM-integrated systems.
• Continuously evaluate and adopt new LLM technologies and techniques to improve system capabilities and performance.
• Mentor junior engineers and promote a culture of technical excellence and innovation.

• Strong proficiency in one or more programming languages such as Java, Python, or C++.
• Extensive experience designing and developing large-scale, distributed systems.
• In-depth knowledge of system architecture patterns, RESTful APIs, and microservices.
• Familiarity with containerization technologies (e.g., Docker, Kubernetes) and orchestration platforms.
• Experience with data storage and retrieval systems (e.g., SQL, NoSQL, Elasticsearch).
• Understanding of security best practices and experience implementing secure systems.
• Excellent problem-solving, debugging, and performance optimization skills.
• Strong communication and collaboration abilities.

Nice to Haves:

• Experience with cloud platforms (e.g., AWS, GCP, Azure) and their associated services.
• Knowledge of DevOps practices and tools (e.g., CI/CD, Infrastructure as Code).
• Familiarity with big data processing frameworks (e.g., Hadoop, Spark).
• Experience with streaming data technologies (e.g., Kafka, Flink).
• Contributions to open-source projects or publications in the field of software engineering or system design.
• Experience with agile development methodologies and project management tools (e.g., JIRA, Confluence).

YOE Requirement: 12 yrs., B.S. in a technical discipline or 4 additional yrs. in place of B.S.