Manager, AI Deployment and Runtime

Lenovo
Morrisville, NC, United States
2 days ago
Apply on jobs.lenovo.com
Prepare application

Role details

Contract type
Permanent contract
Employment type
Full-time (> 32 hours)
Experience level
Expert
Experience required
4 years minimum
Working hours
Regular working hours

Tech stack

Microsoft Windows Artificial Intelligence Application Integration Architecture C++ (Programming Language) Software Code Optimization Code Review Computer Engineering Device Drivers Microprocessors Python (Programming Language) Machine Learning Language Modeling
+12 more
Tensorflow Smart Devices System Software Graphics Processing Unit (GPU) Tablet Computers Discretization Information Technology Low Latency ONNX (Open Neural Network Exchange) Format Hardware Acceleration TensorRT llama.cpp

Job description

In this role, you will define the technical strategy, architecture, and operational workflows for deploying, optimizing, and scaling AI models across client hardware, including Lenovo laptops, tablets, and mobile devices.

You will bridge deep hands-on technical architecture in edge runtime optimization with strategic engineering leadership-empowering your team, delegating key architecture work through Staff and Lead Engineers, and collaborating closely with cross-functional product, platform, and silicon partner teams., Engineering Leadership & Team Growth

  • Direct, mentor, and grow a team of 10+ machine learning, systems, and software engineers specializing in AI integration.
  • Establish team KPIs, engineering standards, code review processes, and Agile delivery cadences to support sustainable growth and direct execution.
  • Partner with few Tech Leads / Staff Engineers within the team to structure direct reporting lines, establish tech leads per project track, and balance workload distribution.

Technical Strategy & On-Device Optimization

  • Spearhead the deployment and runtime optimization of generative AI, vision, and language models on different devices (laptops, tablets, smartphones).
  • Drive memory reduction, low-latency inferencing, post-training optimization, and model pruning strategies tailored for resource-constrained client hardware
  • Optimize execution runtime for heterogeneous compute targets, including NPUs, GPUs, and CPUs (e.g., ONNX Runtime, LiteRT/TensorFlow Lite, llama.cpp) as well as frameworks for different silicon such as OpenVino, NeuroPilot and TensorRT

Cross-Functional Collaboration & Ecosystem Engagement

  • Collaborate with system software, OS kernel, and device driver engineering teams to maximize hardware acceleration on next-generation silicon platforms.
  • Work closely with product management to translate AI user experiences into concrete model footprint, latency, and throughput specifications.
  • Engage with external silicon vendors and 3rd party companies to evaluate emerging edge-AI toolchains and hardware capabilities.

Requirements

  • Education: Master’s degree in Electrical & Computer Engineering (ECE), Computer Science, or a related technical field.
  • Leadership Experience: 4+ years of direct people management experience leading software, machine learning, or embedded engineering teams.
  • Domain Expertise: Proven track record in deploying and optimizing AI/ML models on client hardware or edge devices (mobile, laptop, embedded systems).
  • Technical Proficiency: Deep understanding of model optimization frameworks (quantization, distillation, pruning) and edge runtimes (ONNX Runtime, LiteRT, llama.cpp, or platform-specific NPU toolkits).
  • Strong experience in C++, Python, and cross-platform software design (Windows / Android environments)., * Ph.D. in Electrical & Computer Engineering, Computer Science, or AI/ML domain.
  • Prior experience managing a team of 10+ engineers using lead/staff delegation models.
  • Direct experience with NPU acceleration architectures and heterogeneous compute execution on client devices.
  • Familiarity with privacy-preserving AI frameworks and on-device contextual personalization models.

About the company

Why Work at Lenovo

We are Lenovo. We do what we say. We own what we do. We WOW our customers. Lenovo is a US$83 billion revenue global technology powerhouse, ranked #153 in the Fortune Global 500, and serving millions of customers every day in 180 markets. Focused on a bold vision to deliver Smarter Technology for All, Lenovo has built on its success as the world’s largest PC company with a full-stack portfolio of AI-enabled, AI-ready, and AI-optimized devices (PCs, workstations, smartphones, tablets), infrastructure (server, storage, edge, high performance computing and software defined infrastructure), software, solutions, and services. Lenovo’s continued investment in world-changing innovation is building a more equitable, trustworthy, and smarter future for everyone, everywhere. Lenovo is listed on the Hong Kong stock exchange under Lenovo Group Limited (HKSE: 992) (ADR: LNVGY). This transformation together with Lenovo’s world-changing innovation is building a more inclusive, trustworthy, and smarter future for everyone, everywhere. To find out more visit www.lenovo.com, and read about the latest news via our StoryHub., The Lenovo AI Technology Center (LATC)-Lenovo’s global AI Center of Excellence-is driving our transformation into an AI-first organization. We are assembling a world-class team of researchers, engineers, and innovators to position Lenovo and its customers at the forefront of the generational shift toward AI. Lenovo is one of the world’s leading computing companies, delivering products across the entire technology spectrum, spanning wearables, smartphones (Motorola), laptops (ThinkPad, Yoga), PCs, workstations, servers, and services/solutions. This unmatched breadth gives us a unique canvas for AI innovation, including the ability to rapidly deploy cutting-edge foundation models and to enable flexible, hybrid-cloud, and agentic computing across our full product portfolio. To this end, we are building the next wave of AI core technologies and platforms that leverage and evolve with the fast-moving AI ecosystem, including novel model and agentic orchestration & collaboration across mobile, edge, and cloud resources. This space is evolving fast and so are we. If you’re ready to shape AI at a truly global scale, with products that touch every corner of life and work, there’s no better time to join us.

Apply for this position

This job is hosted externally. Click below to view the full posting and apply.

Apply on jobs.lenovo.com
Prepare application

Good distractions

Loading talks and stories from around this role…