Skip to content

Pull requests: hw-native-sys/pypto-serving

New pull request New
28 Open 44 Closed
28 Open 44 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

perf(qwen): stream stacked decode-weight staging to halve peak host memory
#100 opened Jul 20, 2026 by lterrac Collaborator Loading…
1
feat: add stage-one radix prefix cache
#99 opened Jul 20, 2026 by zmnobug Loading…
1
1
perf(serving): IPC deltas, incremental detok + FINAL_ONLY, GC heap freeze
#98 opened Jul 19, 2026 by ndleslx Collaborator Loading…
7
fix offline batch chunked prefill
#96 opened Jul 16, 2026 by vegetabledoww Loading…
20
Add device-side LM head to DeepSeek V4 serving
#93 opened Jul 16, 2026 by sjduan Loading…
5
Add skills for performance benchmarking and precision evaluation
#87 opened Jul 14, 2026 by sunghajung6688 Contributor Loading…
1
12
ci: prevent orphaned DeepSeek V4 engines on test interruption
#86 opened Jul 14, 2026 by luohuan19 Loading…
14
decouple qwen3 serving from lib contract
#85 opened Jul 14, 2026 by bumble0918 Collaborator Loading…
9
feat(platform): add heartbeat module for replica health monitoring
#78 opened Jul 13, 2026 by lterrac Collaborator • Draft
3 tasks
6
Qwen3-14B serving: add device top-k sampling
#77 opened Jul 13, 2026 by zmnobug Loading…
1
8
feat(platform): execution modules and co-located coordinator/replica
#76 opened Jul 13, 2026 by lterrac Collaborator • Draft
4 tasks
11
support deepseekv4 kvcache
#75 opened Jul 13, 2026 by superxf Contributor Loading…
21
perf(qwen3): compile prefill/decode/greedy straight from the signature
#73 opened Jul 13, 2026 by lyfne123 Contributor Loading…
3
perf(qwen3): skip redundant decode d2h/host copies in greedy path
#71 opened Jul 13, 2026 by lyfne123 Contributor Loading…
4
perf(deepseek): reduce weight loading overhead
#70 opened Jul 13, 2026 by puddingfjz Loading…
7
Integrate Qwen3 CANN FAI decode
#69 opened Jul 13, 2026 by ChaoWao • Draft
4
Add serving progress and adjust deepseek weight load
#63 opened Jul 9, 2026 by superxf Contributor Loading…
19
Add Qwen3 A8W8 L2 runner foundation
#61 opened Jul 9, 2026 by vegetabledoww Loading…
2
Optimize Qwen3 device sampling outputs
#57 opened Jul 6, 2026 by zmnobug Loading…
10
feat(platform): add configuration types, module layer, and host control plane
#53 opened Jul 2, 2026 by lterrac Collaborator Loading…
60
Add native Qwen3 14B A8W8 serving path
#48 opened Jun 29, 2026 by vegetabledoww Loading…
23
feat: Add DeepSeek V4 cache support
#42 opened Jun 25, 2026 by superxf Contributor • Draft
6
Add DeepSeek V4 serving integration
#40 opened Jun 23, 2026 by ndleslx Collaborator • Draft
11
Add radix prefix cache backend
#39 opened Jun 18, 2026 by zmnobug Loading…
18
Add KV cache CPU offload support
#35 opened Jun 15, 2026 by superxf Contributor Loading…
8
ProTip! no:milestone will show everything without a milestone.