Training CLIP models on Data from Scientific Papers
-
Updated
Nov 9, 2023 - TeX
#
img2dataset
Here are 3 public repositories matching this topic...
Bulk-download image-text datasets into Backblaze B2 as reproducible WebDataset tar shards with img2dataset — no local staging disk. Sample app (FastAPI + Next.js) that streams shards to S3-compatible object storage, validates download yield, and streams them back for PyTorch/JAX training.
machine-learning nextjs s3 pytorch sample-app dataset object-storage backblaze-b2 cloudstorage training-data fastapi webdataset img2dataset b2-labs
-
Updated
Aug 7, 2026 - TypeScript
A simple toolkit to transform datasource generate by img2dataset from parquet file to Huggingface dataset.
arrow image-processing dataset image-captioning parquet datasets image-downloader image-caption pyarrow hf-datasets img2dataset
-
Updated
Mar 21, 2023 - Python
Improve this page
Add a description, image, and links to the img2dataset topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the img2dataset topic, visit your repo's landing page and select "manage topics."