All pull requests

Pull requests

• Fix: load the selected V4.1 LM-head weight layout

  #315·lwDavid opened Nov 10, 2026Contributor·

  ·
  2

• Fix: align GLM serving with the current forward ABI

  #314·Inspiron-st opened Nov 9, 2026·

  ·
  1

• fix(v41): support multi-request batches and independent prefill capacity

  #313·high-cloud opened Nov 9, 2026Contributor·

  ·
  4

• Fix: replay emitted tokens after KV cache preemption

  #312·ChaoWao opened Nov 9, 2026·

  ·
  2

• fix(v41): support multiple requests per DP partition

  #310·high-cloud opened Nov 9, 2026Contributor·

  ·
  4

• Fix: update serving to current Lib and PyPTO

  #309·Inspiron-st opened Nov 9, 2026·

  ·
  1

• Fix: compile Program calls with the selected chip runtime

  #308·ChaoWao opened Nov 7, 2026·

  ·
  5

• Fix: align serving with current Lib and PyPTO

  #305·Inspiron-st opened Nov 3, 2026·

  ·
  3

• Fix: account for in-flight output tokens during async scheduling

  #304·Inspiron-st opened Nov 2, 2026·

  ·
  1

• Perf: streamline PD handoff and reuse grouped prefixes

  #303·sjduan opened Oct 31, 2026·

  ·
  3

• feat(v41): integrate resident K5 DSpark serving

  #302·hashiqiqixian opened Oct 30, 2026·

  ·
  3

• feat(v41): integrate DSpark serving lifecycle

  #301·hashiqiqixian opened Oct 30, 2026·

  ·
  18

• CI: retry checkout and fetch the pinned ISA revision

  #299·Inspiron-st opened Oct 30, 2026·

  ·
  1

• feat(v41): establish serving integration foundation

  #296·hashiqiqixian opened Oct 28, 2026·

  ·
  1

• chore(v41): retain opt-in diagnostic entry points

  #288·hashiqiqixian opened Oct 23, 2026·

  ·
  1

• Add: serve GLM with complete prefill and decode programs

  #286·Inspiron-st opened Oct 22, 2026·

  ·
  16

• refactor(serving): separate CLI launch and model integrations

  #282·tongdiaoZS opened Oct 19, 2026Contributor·

  ·
  24

• Add Qwen3.8-27B single-NPU text serving

  #281·ndleslx opened Oct 19, 2026Collaborator·

  ·
  1

• Support chip swimlane profiling

  #280·superxf opened Oct 19, 2026Collaborator·

  ·
  1

• feat(serving): add core single-replica AgentInfer admission

  #279·zmnobug opened Oct 16, 2026Contributor·

  ·
  3

• feat(examples): add mini-swe-agent HTTP frontend

  #277·zmnobug opened Oct 16, 2026Contributor·

  ·
  5

• refactor(runtime): select explicit backend and execution mode

  #274·lyfne123 opened Oct 13, 2026Contributor·

  ·
  5

• fix(test): Size DeepSeek prefix continuation heap for live tensors

  #268·Little-oil opened Sep 29, 2026·

  ·
  1

• perf(serving): reclaim expired DSpark sliding-window KV pages

  #264·superxf opened Sep 23, 2026Collaborator·

  ·
  1

• [draft] feat(engram): host-side engram lookup with TP-sharded partial gather

  #259·supurs opened Sep 22, 2026·

  ·
  7