Skip to content

Commit

Permalink
Dont split into 1000 chunks
Browse files Browse the repository at this point in the history
  • Loading branch information
Stringy committed Mar 1, 2024
1 parent 93a1e4e commit ce9ef42
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -53,7 +53,7 @@ for mod_ver_dir in "${MD_DIR}/module-versions"/*; do

rm -f file-chunk* file-list.txt
gsutil ls "${COLLECTOR_MODULES_BUCKET}/${mod_ver}/*.gz" > file-list.txt
split --number=1000 -e --numeric-suffixes -a3 file-list.txt file-chunk
split --lines=1000 -e --numeric-suffixes -a3 file-list.txt file-chunk

ls -alh
cat file-chunk*
Expand Down

0 comments on commit ce9ef42

Please sign in to comment.