feat: add cli to push to hf

jina-ai · Aug 10, 2023 · d061439 · d061439
1 parent 5d1eed9
commit d061439
Show file tree

Hide file tree

Showing 3 changed files with 11,469 additions and 0 deletions.
diff --git a/README.md b/README.md
@@ -88,3 +88,8 @@ Once the file are generated you can postprocess the files and save it into a jso
 python dataset_gen_cli.py filter ./exercises dataset.jsonl
 ```
 
+push to hf dataset
+
+```shell
+python dataset_gen.py push "jinaai/code_exercises_40k" dataset.jsonl
+```