Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Plugin Framework to execute a command in SQL IGNORE ME WORK IN PROCESS #19710

Open
wants to merge 51 commits into
base: main
Choose a base branch
from

Conversation

cpegeric
Copy link
Contributor

What type of PR is this?

  • API-change
  • BUG
  • Improvement
  • Documentation
  • Feature
  • Test and CI
  • Code Refactoring

Which issue(s) this PR fixes:

issue #19709

What this PR does / why we need it:

We need a plugin framework in SQL that allows to execute a custom plugin executable that can manipulate the data from (datalink or string) in database. The result generated by the plugin can then be shown as a result in SQL.

For application,

  1. generate embedding from LLM vector with source data (datalink or string) stored in database and then insert embedding into the table in database.
  2. perform RAG application ask() function to LLM in SQL. You can create a plugin executable to implement the ask function. The plugin will do the following:
    a. Read the question from stdin
    b. generate the embedding of the question from LLM
    c. perform SQL with the LLM index from our database to get the N-best results
    d. send N-best results and question to LLM to get the RAG answer
    e. send the RAG answer to database
    f. show the answer as result

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
kind/feature size/L Denotes a PR that changes [500,999] lines
Projects
None yet
Development

Successfully merging this pull request may close these issues.

8 participants