Llumlet

Llumlet is the engine-side agent that bridges the local engine and the global scheduler.

Contents

• Llumlet and Llumlet Proxy
  • Architecture Diagram
  • Component Responsibilities
  • Lifecycle
• Real-time Instance Status Tracking
  • Architecture
  • Data Sources and Collection Architecture
  • Tracked status
  • How to Use
• Request Migration
  • Workflow
  • Request selection for migration
  • KV transfer
  • Token forwarding