Skip to content

v0.97.0

Compare
Choose a tag to compare
@lgrammel lgrammel released this 14 Dec 18:40

Added

  • breaking change: Ollama image (vision) support. This changes the Ollama prompt format. You can add .withTextPrompt() to existing Ollama text generators to get a text prompt like before.

    Vision example:

    import { ollama, streamText } from "modelfusion";
    
    const textStream = await streamText(
      ollama.TextGenerator({
        model: "bakllava",
        maxCompletionTokens: 1024,
        temperature: 0,
      }),
      {
        prompt: "Describe the image in detail",
        images: [image], // base-64 encoded png or jpeg
      }
    );

Changed

  • breaking change: Switch Ollama settings to camelCase to align with the rest of the library.