Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

fast-multilingual-e5-large.tar.gz Access denied #18

Open
sorokinvj opened this issue Jun 9, 2024 · 3 comments · May be fixed by #20
Open

fast-multilingual-e5-large.tar.gz Access denied #18

sorokinvj opened this issue Jun 9, 2024 · 3 comments · May be fixed by #20

Comments

@sorokinvj
Copy link

sorokinvj commented Jun 9, 2024 •
edited
Loading

Hello,
I want to use fast-multilingual-e5-large, but when the lib is trying to download it I get:

An error occurred: Error: TAR_BAD_ARCHIVE: Unrecognized archive format
    at Unpack.warn (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/warn-mixin.js:21:40)
    at Unpack.warn (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/unpack.js:236:18)
    at Unpack.<anonymous> (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:83:14)
    at Unpack.emit (node:events:526:35)
    at [emit] (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:313:12)
    at [maybeEnd] (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:468:17)
    at [consumeChunk] (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:500:21)
    at Unpack.write (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:427:25)
    at Unpack.end (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/tar/lib/parse.js:548:14)
    at Pipe.end (/Users/vladislavsorokin/Projects/tax-chatbot/node_modules/minipass/index.js:75:17) {
  recoverable: false,
  file: 'local_cache/fast-multilingual-e5-large.tar.gz',
  code: 'TAR_BAD_ARCHIVE',
  tarCode: 'TAR_BAD_ARCHIVE'
}

then when I click on fast-multilingual-e5-large.tar.gz I see the file with content:

<?xml version='1.0' encoding='UTF-8'?><Error><Code>AccessDenied</Code><Message>Access denied.</Message><Details>Anonymous caller does not have storage.objects.get access to the Google Cloud Storage object. Permission 'storage.objects.get' denied on resource (or it may not exist).</Details></Error>
@sorokinvj
Copy link
Author

I downloaded the model from Hugging Face but I am missing model_optimized.onnx

@Anush008
Copy link
Owner

Anush008 commented Jun 9, 2024

I think this model has a bad Google Cloud Storage source.

We definitely would need to move to HF. Like FastEmbed-py and FastEmbed-rs.

@j-o-r
Copy link

j-o-r commented Aug 14, 2024

source: https://github.com/Anush008/fastembed-js/blob/main/src/fastembed.ts#L214
The model is getting a different link. https://storage.googleapis.com/qdrant-fastembed/intfloat-multilingual-e5-large.tar.gz
The model link should be: https://storage.googleapis.com/qdrant-fastembed/fast-multilingual-e5-large.tar.gz
You can download the link and put it in "local_cache" manualy

j-o-r added a commit to j-o-r/fastembed-js that referenced this issue Aug 14, 2024
@j-o-r
Update fastembed.ts
5e19b4b 
Fixes: Anush008#18
Anush008#18
Url to fast-multilingual-e5-large.tar.gz
@j-o-r j-o-r linked a pull request Aug 14, 2024 that will close this issue
Open
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

fix: fast-multilingual-e5-large fastembed.ts j-o-r/fastembed-js
3 participants
@sorokinvj @Anush008 @j-o-r