Local Python env Cluster (rebased) - #9332

Open

dometto wants to merge 28 commits into

dometto:venv_cluster

Commits on Jul 20, 2026

Add local env cluster

DPeterK
authored and
dometto
committed
ac297f5
Different approach for getting scheduler/worker addresses

DPeterK
authored and
dometto
committed
a12dfa2
Update cluster docstring

DPeterK
authored and
dometto
committed
c7a3ded
Utility libraries checks

DPeterK
authored and
dometto
committed
ab2f360
Update docstring usage example

DPeterK
authored and
dometto
committed
b11e915
Change name of python_executable variable

DPeterK
authored and
dometto
committed
08d1dc2
Refactor common code into Process superclass

DPeterK
authored and
dometto
committed
b36e0ab
Add n_workers option to local env cluster

DPeterK
authored and
dometto
committed
114038f
Correct docstring for connect_options

DPeterK
authored and
dometto
committed
b44ae0a
Add tests

DPeterK
authored and
dometto
committed
e82e5eb
Add asynchronous flag to tests

DPeterK
authored and
dometto
committed
08adbee
Add discrete scheduler port for each test

DPeterK
authored and
dometto
committed
4b045fe
WIP: try using exec and not shell subprocesses

DPeterK
authored and
dometto
committed
5aeb048
Tests pass

DPeterK
authored and
dometto
committed
e4c6a8f
Replace outdated asyncio mark with gen_test()
dometto
committed
4c1ce6d
Use random scheduler and dashboard ports
dometto
committed
56acdb1
Lint
dometto
committed
211d694
Fix test expectation
dometto
committed
62f301f
More linting
dometto
committed
7946d76
Attempt to fix LocalEnvCluster kwargs
dometto
committed
c9af892

Commits on Jul 21, 2026

Ignore asyncio warnings about unclosed transports
dometto
committed
f381dba
ruff
dometto
committed
22b2c99
Add type annotations
dometto
committed
a470731
Refactor None handling for kwargs and connect_options
dometto
committed
3865fc8
Try ignoring PytestUnraisableExceptionWarning on Windows
dometto
committed
fa0e193
No support for Windows
dometto
committed
caa9705

Commits on Jul 22, 2026

No need for Windows workaround, change exception to RuntimeError
dometto
committed
85897cd
Actually skip all localenv tests on windows
dometto
committed
53dc38b