merge main - #22

Closed

zchuango wants to merge 366 commits into

LinQuickDev:mainfrom

kvcache-ai:main

This pull request is big! We're only showing the most recent 250 commits

Commits on Jul 7, 2026

[TENT] Opt-in earliest-deadline-first dispatch in admission queue (RFC #2519 step 2) (#2763)

authored
84b2d91

Commits on Jul 8, 2026

[Bench] Enable replay speedup and multi-threading in SSD Benchmarking (#2780)

alogfans
and
gemini-code-assist[bot]
authored
0d7f0a0
[TENT] Deadline-infeasible drop + degradation hook (RFC #2519 step 3) (#2764)

authored
09c32f9
[Store] Fix S3 list objects pagination (#2778)
feichai0017
authored
454c349
[Store] feat: add optional RFC #1527 KV events publisher on master (#2214)

authored
83ff47f
[TENT] RailMonitor: prefer same-name device for cross-NUMA rail mapping (#2758/#2467) (#2790)

authored
713edc5
[Build] Bump golang.org/x/net in /mooncake-p2p-store/src/p2pstore (#2708)
dependabot[bot]
authored
e07774f
[Store] fix: reject empty keys in HTTP metadata server (#2770)

VectorPeak
and
chatgpt-codex-connector[bot]
authored
f1c762a
[wip] docs: add vLLM V1 MooncakeStore KV cache sharing benchmark (#2773)

LujhCoconut
and
gemini-code-assist[bot]
authored
df84a55
[Build] Bump golang.org/x/crypto (#2789)
dependabot[bot]
authored
c989668

Commits on Jul 9, 2026

[Store] Fix --host parameter to support ip:port format for TransferEngine data plane port (#2784)
NUABO
authored
866ed32

Commits on Jul 10, 2026

[TENT] Opt-in per-entry priority promotion (#2528) (#2788)

authored
da11646
[TENT] Expose Request.deadline_ns and policy_name to Python bindings (#2808)

authored
6273d18
[Bugfix][TENT] Fix silent TPU data corruption for transfers larger than one staging chunk (#2815)

Liwink
and
claude
authored
130b959
[Doc] Reorganize performance docs (#2824)

ykwd
and
Ke Yang
authored
3d0748c
[Bugfix] Skip os.chmod when binary is already readable and executable (#2803)
Csrayz
authored
0b4a12c
[CI/Build] Fix compile warnings (#2825)
Aionw
authored
8dee809
[Store] Refactor: Extract snapshot orchestration into MasterSnapshotManager (#2805)

xiangui33423
and
claude
authored
98ff4e4
[TENT] Add IntentType enum to Request for Transfer Intent API (#2810)

authored
d409ed8
[TENT] admission queue: deadline proximity promotion for dispatch (#2814)

authored
4188e3a

Commits on Jul 11, 2026

[TransferEngine] Add show-link diagnostic tool for NIC topology (#2820)

authored
6894c2d

Commits on Jul 12, 2026

Commits on Jul 13, 2026

[EP] Cap active RoCE QPs for IBGDA kernels (#2544)

authored
5507b5c
[EP] add DeepEP V2 elastic buffer (#2503)
UNIDY2002
authored
4293dce
[TE] Add host control fallback for IBGDA QP setup (#2867)

UNIDY2002
and
gemini-code-assist[bot]
authored
7192ff4
[CI] Migrate tone_tests to CUDA 13: pull cu130 wheel, adapt sglang/vllm paths, add NCCL env & offline model cache (#2811)
luketong777
authored
eb417ef
[TransferEngine] Acknowledged TCP framing: COMPLETED means applied at destination (#2850)
n-WN
authored
de58b58
[TransferEngine] Reserve in-flight memory registrations (#2870)
feichai0017
authored
76ee599
[TransferEngine] Optimize MACA P2P copy path (#2774)
Dayuxiaoshui
authored
f8c9667
[Store] Speed up HugeTLB population before RDMA registration (#2838)

zhangzuo21
and
yuechen-sys
authored
4ff713c
[TE] Fix RDMA transport rail-failure handling and CQ timeout diagnostic (#2872)
alogfans
authored
822afa3
[TENT] Add best-effort RDMA task cancellation (#2851)

catyans
and
彦纾
authored
0cc5012
[Bugfix] Gate RDMA sends until active side confirms QP readiness (#2625)

LCAIZJ
and
leichao.lc
authored
1fde7b6
[Store] feat: expose client metrics HTTP config to Python (#2822)
Lin-z-w
authored
159df02
[TENT] Add causal chain stage decomposition for transfer latency (#2821)

authored
a2966b6
[TE] Add metadata refresh polling for segment cache (#2795)

greatwhole
and
xianghang7
authored
9eeac58
[TENT] Bind transport policies to intent type (#2847)

catyans
and
彦纾
authored
1ac6f3a

Commits on Jul 14, 2026

Commits on Jul 15, 2026

[TE] Use std::atomic to support ARM64 relaxed ordering (#2897)
alogfans
authored
5ade6dd
[TE] Reject unsupported NVMe-oF task batches and correlate cuFile completions (#2893)
morluto
authored
6e3a11b
[Store] Make batch_evict_bench scale and eviction ratios configurable (#2855)
jacklin78911-collab
authored
3bbd9b2
[TENT] Add receiver-credit ledger model and protocol invariants

catyans
and
彦纾
authored
3a38cb8
[TENT] Add QoS metrics baseline to tebench (#2845)

catyans
and
彦纾
authored
9c6fc51
[TENT] Fix mismatched cuFileBatchIOGetStatus semantics in gds transport (#2921)

authored
402673e
[Store] fix GPU-addressed local copy crashes (#2926)
zxpdemonio
authored
dfa8f28
[Doc] Update README news (#2940)

Copilot
and
stmatengss
authored
f3f6f6c

Commits on Jul 16, 2026

Commits on Jul 17, 2026

Commits on Jul 18, 2026

Commits on Jul 19, 2026

[Doc] Add llm-d Integration page to the Kubernetes deployment guide (#2983)
tpiperatgod
authored
f7330a6

Commits on Jul 20, 2026

[CI/Build] Disable unit tests in release wheel builds (#2995)
Aionw
authored
fc04cb1
[Store] L2→L1 promotion background retry for hot LOCAL_DISK-only keys (V1.1) (#2690)

Srinivasoo7
and
srinivas_oo7
authored
3853f43
[PG][1/N] Decouple communication failures from membership changes (#2338)

caozhanhao
and
yuechen-sys
authored
ff800ad
[CI/Build] Stabilize release wheel builds (#3002)
Aionw
authored
51abd27
[TENT] Expose RDMA NIC load stats via Transport interface (#2996)
HeinUmin
authored
ac01083

Commits on Jul 21, 2026

Commits on Jul 22, 2026

[CI] Update pull request permissions in workflow (#3037)
stmatengss
authored
3ae1799
[wheel] add pool-backed structured object reads (#3023)
zxpdemonio
authored
5605ca8
[CI/Build] Limit EFA release build parallelism (#3045)
Aionw
authored
f9fa802
[wheel] add unified structured-object put/get API (#3013)
zxpdemonio
authored
c114e81
[TENT] Add transport labels to metrics for per-transport observability (#3029)
staryxchen
authored
d6e166f
[CI] disable qoder auto approve (#3046)

stmatengss
and
cursoragent
authored
900443d
[CI] Run tests on release branches (#3049)
Aionw
authored
724506e
[wheel] add multi-buffer structured object puts (#3024)
zxpdemonio
authored
4dbe5a4
[Store] pin host segments with quota (#2945)
zxpdemonio
authored
12df58c

Commits on Jul 23, 2026

Commits on Jul 24, 2026

[TENT] Add mixed traffic workloads to tebench (#3074)

catyans
and
彦纾
authored
a6dcdcd
[Store] Arm the etcd view-change watch once per wait instead of per iteration (#3062)
he-yufeng
authored
a9da850
[Store] Extract tenant quota table from MasterService (#3071)
Aionw
authored
7f99580
[Docs] Correct stale KV lease TTL and eviction high-watermark defaults (#3022)
g122622
authored
aa9ec91
[CI/Build] Fix Go setup in MUSA release workflow (#3086)
Aionw
authored
61d4199
[Docs] Document multi-model KV cache isolation (#3082)
Lin-z-w
authored
3e2ccbc
[CI/Build] Add MUSA release backfill workflow (#3092)
Aionw
authored
d34c911
[Docs] Add pypi badges (#3103)

ykwd
and
Ke Yang
authored
7c413ff
[Store] Fix RemoveAll not cleaning SSD offload files on any node via PollRemoveAll RPC (#2676)

Colors-111
and
ruanzhao
authored
f1aacd3
[wheel] improve structured non-tensor codecs (#3055)
zxpdemonio
authored
10a1044
[wheel] restore zero-copy puts for multi-buffer payloads (#3054)
he-yufeng
authored
ed60363
[CI] Add torch 2.13.0 to EP build matrix; drop deprecated env_var `BUILD_WITH_EP` (#3095)
UNIDY2002
authored
b29e9f7
[CI/Build] Fix release wheel ELF layout (#3105)
Aionw
authored
a2ad280
Bump version to 0.3.12.post1 in pyproject.toml (#3107)
ShangmingCai
authored
b97f13c

Commits on Jul 25, 2026

Commits on Jul 26, 2026

ci: add manual "Cancel Queued and Running CI" workflow (#3117)

ShangmingCai
and
claude
authored
b2e5842
[CI] fix cancel-ci listing that matched no runs (#3123)

ShangmingCai
and
claude
authored
e13780d

Commits on Jul 27, 2026

Commits on Jul 28, 2026

Commits on Jul 29, 2026

[TENT] Harden ShmTransport backing-file and mapping lifecycle (#3145)
alexps9
authored
f8bca20
[Bugfix] Fix double free of UB/Barex slices on device-selection failure (#3146)
he-yufeng
authored
080844c
[Store] Surface partial replica allocation in PutStart and document allocation semantics (#3156)
liangxu2000
authored
ee6e28d
[Store] Fix SSD total capacity showing incorrectly after master restart (#3069)
NUABO
authored
4831931
[Store] Fix null-ptr crash in PrepareStorageBackend (#3138)
LujhCoconut
authored
93515f1
[Store] Add dlopen Rust backend and WITH_STORE_C_SHARED shared library (#3078)

donghun-furiosa
and
claude
authored
8dd6306
[Bugfix] Avoid etcd keepalive pings without active streams (#3144)

Icedcoco
and
Yuchen Kou
authored
6c721ee
[TransferEngine] Add NCCL host and device transport backend (#2852)

akhillanger
and
Akhil Langer
authored
07fad16
[Store] Make RPC client I/O threads configurable via MC_RPC_CLIENT_IO_THREADS (#3004)
Aionw
authored
1d689d0
[Chore] Update codeowners (#3175)

ykwd
and
Ke Yang
authored
3d43c36
[CI/Build] Align Asio with yalantinglibs target (#3170)

CanYangGetYang
and
Runpeng Chen
authored
ed93a04
[tent] Support mixed DRAM+VRAM segments and multi-transport allocation in tebench (#3127)
staryxchen
authored
ac5ec1d
[CI] Fix nightly workflow: drop removed build-with-ep input (#3172)

stmatengss
and
cursoragent
authored
015a897

Commits on Jul 30, 2026

[TE] fix(efa): bind a CUDA context before registering GPU memory (#3177)

whn09
and
claude
authored
a741372
[Bugfix][TE] Respect remote_accessible in RDMA verbs MR registration (#3151)
RuiqingFeng
authored
bac7b62
[Store] Scope capacity metric release to the serving MasterService (#3168)
liuzijing2014
authored
be95961
[Store] Fix NoF heartbeat config silently ignored in HA mode (#3149)
NUABO
authored
6901b5c
[Doc] Document master KV event publisher flags (#3150)
Aionw
authored
04791cd
[Dep] bind wildcard listen address (0.0.0.0/::) without going through getaddrinfo (#2919)
pjdurden
authored
ed01cb1
[TENT] Fix failover attempt metrics attribution (#3109)

anranxia
and
jipengtian
authored
3f48eb2
[CI/Build] Deduplicate EFA and store CI workflows (#3163)
Aionw
authored
9281980
[CI/Build] Format only changed C++ lines (#3027)
Aionw
authored
de85d36
fix: jsoncpp/json/json.h not found (#3193)

Icedcoco
and
Yuchen Kou
authored
f19faae
[Store] support tensor APIs with dummy client (#2998)
zxpdemonio
authored
f5f6a94

Commits on Jul 31, 2026

Commits on Aug 1, 2026

[Doc] Update RBG integration example to workloads.x-k8s.io/v1alpha2 (#3224)
tpiperatgod
authored
f161118

Commits on Aug 2, 2026

[Chore] Bump google.golang.org/grpc in /mooncake-common/etcd (#3235)
dependabot[bot]
authored
131d6ad

Commits on Aug 3, 2026

[Store] Add exponential backoff for ordered oplog writer retries (#3166)

Icedcoco
and
Yuchen Kou
authored
7da06d9
[ROCm] Add ROCm/HIP wheel build, CI, and release parity with CUDA (#3171) (#3184)
andyluo7
authored
df50864
[TE/Build] Replace hardcoded CUDA paths with CUDAToolkit discovery (#3215)
caozhanhao
authored
3dabe12
[TENT] Reject malformed numeric metrics overrides (#3228)
Hubert-Zhu
authored
4a413a8
[TE] perf(efa): allow bounding the batch MR registration fan-out (#3210)

whn09
and
claude
authored
4634ead
[Store] Consolidate string parsing primitives (#3179)
Aionw
authored
a5a7f24
[Bug]: [SSD] DSV4 enable SSD offload，stress testing, repeat offloading the same batch key, lead to OBJECT_ALREADY_EXISTS/persist failed/INVALID_KEY (#2967)
pjdurden
authored
a4e6759
[Bugfix] Clear RDMA context health counter only on successful completions (#3230)

SongOf
and
maxlisongsong
authored
10a71a1
[Bugfix] Drain RDMA async event queue on each epoll wakeup (#3236)

SongOf
and
maxlisongsong
authored
012af11
ci: fix nightly Go path and publish gating (#3211)
Aionw
authored
eaa6c79
[Store] Fix silent data corruption in io_uring read path (#3066) (#3073)

LujhCoconut
and
claude
authored
a16e042
[Bugfix] Detect AMD amdgpu for TENT GPUDirect RDMA capability (#3242)
staryxchen
authored
7b82c03
[Store] Selectively materialize BatchEvict candidates after timestamp filtering (#3118)
jacklin78911-collab
authored
129a9db
[Bugfix] Use GPU_PREFIX for HCA peer affinity under USE_HIP (#3248)
staryxchen
authored
e822ace
[CI/Build] Add CUDA 13 EFA wheel (#3247)
Aionw
authored
14d39ff

Commits on Aug 4, 2026

[Bugfix][Store] Fix No rkey for MR access on SSD offload read (#3246)
NUABO
authored
45f805a
[CI/Build] Fix nightly workflow and offload platform checks (#3148)
Aionw
authored
40116f3
[Store] Validate durable oplog prefix at startup (#3165)

Icedcoco
and
Yuchen Kou
authored
6e4a9bd
[Bugfix][TE] Fix dma-buf offsets for chunked GPU MRs (#3243)
RuiqingFeng
authored
919c989
[Store]Support VRAM Segment and NVLink transport within a single node (#3196)

zhaoyongke
and
沈冲
authored
0a85771
[CI/Build] Restrict nightly workflow to upstream repository (#3268)
Aionw
authored
3e58696
add SUPA (Biren GPU) support to transfer engine (#3102)

cyqmonkey
and
e00977
authored
819202f
[Bugfix][TE] Keep context_list_ index-aligned when an RNIC fails to init (#3263)

SongOf
and
maxlisongsong
authored
dcd67dd
[TE] perf(efa): optionally register device memory only on topology-local NICs (#3219)

whn09
and
claude
authored
3c63169
[Store] Fix EFA transport auto-discovery (#3207)

yyun-cpu
and
cursoragent
authored
6e4b956
[Bugfix][TENT] Bound peer key lookups by the published vector length (#3265)

SongOf
and
maxlisongsong
authored
faae8dd
[Store] support CUDA IPC for dummy client buffers (#3234)
zxpdemonio
authored
22c8fa8

Commits on Aug 5, 2026

Commits on Aug 6, 2026

[EP] Add EP dispatch/combine benchmark with incast routing patterns (#3213)
PACTHEMAN123
authored
ee0febd
[Doc] docs: add Biren logo to supported hardware (#3298)
Aionw
authored
275cf35
[TENT] cuda_probe: zero-init cudaPointerAttributes and warn on libcud… (#3261)

KubrickLiu
and
jiayuzailiu
authored
76bf48a
fix(musa): add missing CUDA compatibility macros (#3295)
UNIDY2002
authored
8b1453d
[TENT] RDMA: skip NICs that cannot GPUDirect-DMA to a GPU, and fix fallback device rotation (#3281)

anranxia
and
jipengtian
authored
43cbd9f
[TE] EFA: derive WR/CQ pacing depths from the libfabric provider (#3296)

whn09
and
claude
authored
06f2c6d
[Bugfix][TENT] Keep context_set_ and buffer keys NicID-indexed (#3264)

SongOf
and
maxlisongsong
authored
aeeab07
[Store] Add minimal MasterService scenario DSL (#3256)
Aionw
authored
54f02e1
[TENT] Fix double-free in HttpMetaStore under concurrent workers: a s… (#3259)

KubrickLiu
and
jiayuzailiu
authored
e500afa
[CI/Build] Simplify wheel workflows (#3283)
Aionw
authored
88ecb5d
[PG] Build the device worker with C++17 for CMake 3.22 compatibility (#3308)

caozhanhao
and
UNIDY2002
authored
74e6474
[TransferEngine] Make single unregisterLocalMemory best-effort (#2962)
he-yufeng
authored
fd6c4d9
[TransferEngine] Skip the CUDA pointer probe on GPU-less hosts (#2955)
he-yufeng
authored
bf475a3
fix: resolve nightly CI failures (#3309)
UNIDY2002
authored
c4dd06a
[TE] Support DMA-BUF in IBGDA Device API (#3272)
UNIDY2002
authored
0d5729a
[TENT] Add native UB foundation and URMA resource management (#3282)

zchuango
and
Le1zyCatt
authored
35f03c9
[CI] Disable Qoder auto code review workflow (#3306)

Copilot
and
stmatengss
authored
bdacc80

Commits on Aug 7, 2026

[Bugfix][TE] Serialize libnuma's lazy cpumask cache fill in bindToSocket (#3289)

SongOf
and
maxlisongsong
authored
d9d99b3
[Store] Harden Put/Upsert completion against promotion lifecycle (#3244)
Lin-z-w
authored
64fee38
[CI] synchronize metadata server handoff (#3212)
zhangzuo21
authored
660f9c7
[Docs][Store] document task manager replica task behavior (#3300)

Copilot
and
stmatengss
authored
1808542
[Store] Fix stale per-segment metric labels after segment unmount (#3301)
leonzzhu
authored
a95f4bd