set-of-mark

Here are 4 public repositories matching this topic...

reidbarber / webmarker

Mark web pages for use with vision-language models

som prompt gemini operator cua claude playwright prompt-engineering llms vision-language-model gpt4v qwen-vl gpt4o set-of-mark computer-use computer-using-agent

Updated Mar 8, 2026
TypeScript

laywens / uitag

Star

Set-of-Mark detection pipeline for macOS — Apple Vision, YOLO11, and VLM on MLX. Transforms screenshots into numbered element maps and structured JSON manifests.

macos computer-vision yolo mlx screenshot-analysis apple-silicon ui-detection set-of-mark yolov11 vllm-mlx

Updated Apr 9, 2026
Python

OpenAdaptAI / openadapt-grounding

Sponsor

Star

Temporal smoothing for UI element detection with OmniParser integration

python computer-vision ui-detection set-of-mark openadapt

Updated Feb 18, 2026
Python

RonanDavalan / diwall

Star

Execution API that gives language models (Claude Code, Gemini…) the ability to see web interfaces — Playwright · Set-of-Mark · ReAct

computer-vision accessibility web-automation rpa playwright llm set-of-mark claude-code

Updated Jun 18, 2026
Python

Improve this page

Add a description, image, and links to the set-of-mark topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the set-of-mark topic, visit your repo's landing page and select "manage topics."

Learn more

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

set-of-mark

Here are 4 public repositories matching this topic...

reidbarber / webmarker

laywens / uitag

OpenAdaptAI / openadapt-grounding

RonanDavalan / diwall

Improve this page

Add this topic to your repo