feat(integrations): Add llama_parse integration for document parsing.

[Vedantsahai18]

Important

Add Llama document parsing integration with new classes, configuration updates, and tests.

• Integration:
  • Add LlamaParseIntegrationDef and LlamaParseIntegrationDefUpdate classes in Tools.py for Llama document parsing.
  • Add LlamaParseFetchArguments, LlamaParseFetchArgumentsUpdate, LlamaParseSetup, and LlamaParseSetupUpdate classes for handling setup and arguments.
  • Implement parse() function in llama_parse.py for parsing documents using LlamaParse.
• Configuration:
  • Add llama-index and llama-parse dependencies to pyproject.toml.
• Testing:
  • Add MockLlamaParseClient in mocks/llama_parse.py for testing.
  • Add test_llama_parse_provider() in test_providers.py to test LlamaParse provider configuration.
  • Update conftest.py to include LlamaParse in mocked services.

^{This description was created by for 239e6c7. It will automatically update as commits are pushed.}

[creatorrr]

lgtm

[ellipsis-dev]

❌ Changes requested. Reviewed everything up to a0781c8 in 1 minute and 0 seconds

More details

• Looked at 1110 lines of code in 15 files
• Skipped 1 files when reviewing.
• Skipped posting 2 drafted comments based on config settings.

1. agents-api/agents_api/autogen/Tools.py:1020

• Draft comment:
  The file field is required in LlamaParseFetchArguments but optional in LlamaParseFetchArgumentsUpdate. Ensure this is intentional to avoid unexpected behavior.
• Reason this comment was not posted:
  Comment did not seem useful.

2. integrations-service/integrations/autogen/Tools.py:1021

• Draft comment:
  The file field is required in LlamaParseFetchArguments but optional in LlamaParseFetchArgumentsUpdate. Ensure this is intentional to avoid unexpected behavior.
• Reason this comment was not posted:
  Marked as duplicate.

Workflow ID: wflow_NYxAFUDKgAtV27FC

---

Want Ellipsis to fix these issues? Tag @ellipsis-dev in a comment. You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[ellipsis-dev]

👍 Looks good to me! Incremental review on 239e6c7 in 29 seconds

More details

• Looked at 145 lines of code in 5 files
• Skipped 0 files when reviewing.
• Skipped posting 3 drafted comments based on config settings.

1. agents-api/agents_api/common/protocol/remote.py:96

• Draft comment:
  Use BaseRemoteModel instead of a string for the return type hint in unload_all for clarity and consistency.
• Reason this comment was not posted:
  Confidence changes required: 50%
  The unload_all method in BaseRemoteModel and RemoteList returns self, which is a good practice for method chaining. However, the return type hint in BaseRemoteModel is a string, which is unnecessary since the class is already defined. It should be updated to use the class itself for clarity and consistency.

2. agents-api/agents_api/common/storage_handler.py:83

• Draft comment:
  Consider refactoring the handling of BaseModel and BaseRemoteModel instances in load_args to reduce code repetition and improve maintainability. This applies to similar code blocks in the function.
• Reason this comment was not posted:
  Confidence changes required: 50%
  In agents-api/agents_api/common/storage_handler.py, the load_args function has repetitive code for handling BaseModel and BaseRemoteModel instances. This can be refactored to improve readability and maintainability.

3. cookbooks/01-Website_Crawler_using_Spider.py:40

• Draft comment:
  Avoid directly embedding sensitive information like spider_api_key in strings. Consider using environment variables or a secure vault to manage sensitive data.
• Reason this comment was not posted:
  Confidence changes required: 50%
  In cookbooks/01-Website_Crawler_using_Spider.py, the spider_api_key is directly inserted into the YAML string using an f-string. This can lead to security issues if the key is logged or exposed. It's better to use a more secure method to handle sensitive information.

Workflow ID: wflow_RDzLiSz7qZkHlBIH

---

You can customize Ellipsis with 👍 / 👎 feedback, review rules, user-specific overrides, quiet mode, and more.

[ellipsis-dev]

Skipped PR review on 6724b7f because no changed files had a supported extension. If you think this was in error, please contact us and we'll fix it right away.