Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Run fails if the built app contains more than 65535 files or is over 2GB #224

Open
pombredanne opened this issue Aug 16, 2022 · 1 comment

Comments

@pombredanne
Copy link

pombredanne commented Aug 16, 2022

I am trying to build an app for scancode-toolkit and while the build works fine, the built app is failing to run with this error:

$ python3 scancode
....python3: can't find '__main__' module in 'scancode'

I scratched my head and I think this may be subject to these issues python/cpython#77140 and python/cpython#89739

scancode-toolkit happens to contain a good number of data files (~ 68K)

What I did as a proof was to:

  1. unzip the built app
  2. remove enough files to go below the 65K limit
  3. rezip and run the app... and things work fine

Since shiv depends on the boostrapping mechanisms of Python zip importer, this is dependent on @thatch Zip64 support in import being merged in python/cpython#94146 ... therefore I am not sure that there is anything to do here beyond some documentation.

@pombredanne
Copy link
Author

FWIW, there is a similar problem with the same root cause when using large zips (over 2GB) .... this is reported elsewhere in pex-tool/pex#958

@pombredanne pombredanne changed the title Run fails if the built app contains more than 65535 files Run fails if the built app contains more than 65535 files or is over 2GB Aug 16, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant