Data · dataset · 2022
laion/CLIP-ViT-H-14-laion2B-s32B-b79K-all-checkpoints
Listed in Hugging Face Datasets
Description
This repository contains the intermediate checkpoints for the model huggingface.co/laion/CLIP-ViT-H-14-laion2B-s32B-b79K. Each "epoch" corresponds to an additional (32B / 256) samples seen, consituting total of 256 "epochs" The purpose of releasing these checkpoints and optimizer states is to enable analysis. For the first 121 "epochs", training was done with float16 mixed precision before switching to bfloat16 after a loss blow up.
Links
Where it is published
- Hugging Face dataset page huggingface.co/datasets/laion/CLIP-ViT-H-14-laion2B-s32B-b79K-all-checkpoints ↗
landing page · from Hugging Face
Catalogue records · 1
- Hub API huggingface.co/api/datasets/laion/CLIP-ViT-H-14-laion2B-s32B-b79K-all-checkpo… ↗
metadata API · from Hugging Face
Topics
- From keywords
- Computer Science & AI
Provenance · 1 source records, 8 field assertions
| Source | Key | Last seen | Raw |
|---|---|---|---|
| Hugging Face Datasets | laion/CLIP-ViT-H-14-laion2B-s32B-b79K-all-checkpoints | 15 d ago | JSON v1 |
| Field | Assertion | Extractor | Evidence |
|---|---|---|---|
| access_level | source · Hugging Face | connector:huggingface@1.0.0 | /gated |
| concepts[field].local:field:computer-science-ai | mapping · Hugging Face | connector:huggingface@1.0.0 | |
| created_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| description | source · Hugging Face | connector:huggingface@1.0.0 | /description |
| license | source · Hugging Face | connector:huggingface@1.0.0 | /tags[license:*] |
| publication_date | source · Hugging Face | connector:huggingface@1.0.0 | |
| title | source · Hugging Face | connector:huggingface@1.0.0 | /id |
| updated_date | source · Hugging Face | connector:huggingface@1.0.0 |