Skip to content
This repository has been archived by the owner on Aug 1, 2024. It is now read-only.

I Just download the image1k dataset from huggingface, what should i do next to process the tar.gz file and train this model #44

Open
james2v opened this issue Aug 14, 2023 · 3 comments

Comments

@james2v
Copy link

james2v commented Aug 14, 2023

No description provided.

@xiangtaowong
Copy link

i have the same question, too. Looking forwarf to your follow-up progress.

@james2v
Copy link
Author

james2v commented Aug 16, 2023

xiangtaowong

l load dataset with this and unzip the datafile into this data structure

1692173103636

from datasets import load_dataset

ds=load_dataset('/imagenet-1k',streaming=True)

and then use the command code it provided from the hub. It works finally.

But i cannot processs the training because of the limit computing source.

@xiangtaowong
Copy link

Thanks a lot!

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants