Skip to content

Add endpoint to get counts of running crawls (per-org, or across all orgs) - #3549

Merged
tw4l merged 9 commits into
mainfrom
issue-3541-running-crawl-counts
Aug 5, 2026
Merged

Add endpoint to get counts of running crawls (per-org, or across all orgs)#3549
tw4l merged 9 commits into
mainfrom
issue-3541-running-crawl-counts

Conversation

@tw4l

@tw4l tw4l commented Jul 29, 2026

Copy link
Copy Markdown
Member

Part of #3541

This PR adds:

  • New /orgs/all/crawlconfigs/running (superadmin) and /orgs/{oid}/crawlconfigs/running endpoints that provide counts of the number of workflows in all running, paused, and waiting states, as well as totals.
  • A new index to the crawls mongo collection to help facilitate the query
  • Some basic tests

@tw4l
tw4l requested review from SuaYoo and ikreymer July 29, 2026 15:02
@tw4l
tw4l marked this pull request as draft August 3, 2026 16:47
@tw4l

tw4l commented Aug 3, 2026

Copy link
Copy Markdown
Member Author

Moving back to draft while I convert to use single Mongo aggregation

@tw4l
tw4l marked this pull request as ready for review August 3, 2026 17:44
@tw4l
tw4l force-pushed the issue-3541-running-crawl-counts branch from 2fd012d to e34de27 Compare August 3, 2026 17:44
@tw4l
tw4l requested a review from emma-sg August 3, 2026 17:45
@tw4l

tw4l commented Aug 3, 2026

Copy link
Copy Markdown
Member Author

Ready for review again

Comment thread backend/btrixcloud/crawlconfigs.py Outdated
Comment thread backend/btrixcloud/crawlconfigs.py Outdated
Comment thread backend/btrixcloud/crawlconfigs.py Outdated
@tw4l
tw4l requested a review from emma-sg August 3, 2026 20:41

@emma-sg emma-sg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looking good to me!

@SuaYoo
SuaYoo force-pushed the issue-3541-running-crawl-counts branch from d41672c to 8e65c38 Compare August 5, 2026 18:31
@tw4l
tw4l merged commit 61b9650 into main Aug 5, 2026
25 checks passed
@tw4l
tw4l deleted the issue-3541-running-crawl-counts branch August 5, 2026 22:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants