Repositories list

• parea-sdk-ts

  Public
  TypeScript SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

  llmprompt-engineeringllms+ 6llm-evalllm-toolsllm-evaluationllm-evaluation-toolkitllms-benchmarkingllm-evaluation-framework

  TypeScript

  •

  Apache License 2.0

  •1•4•0•1•Updated Oct 31, 2024Oct 31, 2024

• parea-sdk-py

  Public
  Python SDK for experimenting, testing, evaluating & monitoring LLM-powered applications - Parea AI (YC S23)

  metricsgood-first-issuellm+ 9prompt-engineeringgenerative-aillmopsllm-evalllm-toolsllm-evaluationllm-evaluation-toolkit+ 2

  Python

  •

  Apache License 2.0

  •6•74•0•56•Updated Sep 12, 2024Sep 12, 2024

• parea-deployment

  Public
  MIT License

  •0•1•0•0•Updated Sep 3, 2024Sep 3, 2024

• zenbase-core

  Public
  Prompt engineering, automated.

  Jupyter Notebook

  •

  MIT License

  •21•0•0•0•Updated Jul 26, 2024Jul 26, 2024

• instructor

  Public
  structured outputs for llms

  Python

  •

  MIT License

  •643•0•0•0•Updated Jul 17, 2024Jul 17, 2024

• JUDGE-BENCH

  Public
  Jupyter Notebook

  •5•0•0•0•Updated Jul 11, 2024Jul 11, 2024

• swarms

  Public
  The Enterprise-Grade Production-Ready Multi-Agent Orchestration Framework Join our Community: https://discord.com/servers/agora-999382051935506503

  Python

  •

  Other

  •227•0•0•0•Updated Jul 8, 2024Jul 8, 2024

• crewAI

  Public
  Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

  Python

  •

  MIT License

  •2.9k•0•0•0•Updated Jul 7, 2024Jul 7, 2024

• litellm

  Public
  Call all LLM APIs using the OpenAI format. Use Bedrock, Azure, OpenAI, Cohere, Anthropic, Ollama, Sagemaker, HuggingFace, Replicate (100+ LLMs)

  Python

  •

  Other

  •1.6k•0•0•0•Updated Jun 12, 2024Jun 12, 2024

• ml_vs_llm_experiment_demo

  Public
  Python

  •0•1•0•0•Updated May 24, 2024May 24, 2024

• dspy

  Public
  DSPy: The framework for programming—not prompting—foundation models

  Python

  •

  MIT License

  •1.4k•0•0•0•Updated Apr 29, 2024Apr 29, 2024

• sglang

  Public
  SGLang is a structured generation language designed for large language models (LLMs). It makes your interaction with models faster and more controllable.

  Python

  •

  Apache License 2.0

  •484•0•0•0•Updated Apr 29, 2024Apr 29, 2024

• tool-use-benchmark

  Public
  Jupyter Notebook

  •

  Apache License 2.0

  •2•6•0•0•Updated Apr 13, 2024Apr 13, 2024

• parea-langchain-rag-redis-tutorial

  Public
  Tutorial showing how to do RAG evals with Parea AI and LangChain

  pythonevalrag+ 3llmlangchainparea

  Python

  •1•4•1•1•Updated Mar 27, 2024Mar 27, 2024

• guidance

  Public
  A guidance language for controlling large language models.

  Jupyter Notebook

  •

  MIT License

  •1k•0•0•0•Updated Mar 27, 2024Mar 27, 2024

• superagent

  Public
  🥷 Run AI-agents with an API

  TypeScript

  •

  Other

  •835•0•0•0•Updated Mar 27, 2024Mar 27, 2024

• chatbot-evaluation-first-principles

  Public
  Evaluating a chatbot from first principles

  Python

  •

  Apache License 2.0

  •0•0•0•0•Updated Mar 25, 2024Mar 25, 2024

• parea-vite-evals

  Public
  TypeScript

  •0•0•0•0•Updated Mar 19, 2024Mar 19, 2024

• openai-cookbook

  Public
  Examples and guides for using the OpenAI API

  MDX

  •

  MIT License

  •9.5k•0•0•0•Updated Mar 13, 2024Mar 13, 2024

• parea-country-compass-ai

  Public
  Python

  •0•0•0•0•Updated Mar 7, 2024Mar 7, 2024

• Asclepius-synthetic-clincal-notes-retrieval-benchmark

  Public
  Jupyter Notebook

  •

  MIT License

  •0•1•0•0•Updated Mar 4, 2024Mar 4, 2024

• R2R

  Public
  A framework for rapid development and deployment of production-ready RAG systems

  Python

  •

  MIT License

  •265•0•0•0•Updated Feb 28, 2024Feb 28, 2024

• CICD-LLM-pipeline

  Public
  Python

  •0•0•0•0•Updated Feb 6, 2024Feb 6, 2024

• wikichat-parea

  Public
  https://www.datastax.com/blog/wikipedia-chatbot-using-astradb-langchain-and-vercel

  Roff

  •19•0•0•0•Updated Feb 2, 2024Feb 2, 2024

• paper-qa

  Public
  LLM Chain for answering questions from documents with citations

  Python

  •

  Apache License 2.0

  •600•0•0•0•Updated Jan 30, 2024Jan 30, 2024

• awesome-openai-vision-api-experiments

  Public
  Must-have resource for anyone who wants to experiment with and build on the OpenAI Vision API 🔥

  Python

  •128•0•0•0•Updated Nov 14, 2023Nov 14, 2023

• mentat

  Public
  Mentat - The AI Coding Assistant

  Python

  •

  Apache License 2.0

  •242•0•0•0•Updated Nov 10, 2023Nov 10, 2023

• scanline-parea

  Public
  Python

  •0•0•0•0•Updated Oct 12, 2023Oct 12, 2023

• MetaGPT

  Public
  🌟 The Multi-Agent Framework: Given one line Requirement, return PRD, Design, Tasks, Repo

  Python

  •

  MIT License

  •5.4k•0•0•0•Updated Oct 11, 2023Oct 11, 2023

• agentgpt-with-sid-and-parea

  Public
  TypeScript

  •

  GNU General Public License v3.0

  •0•0•0•0•Updated Aug 30, 2023Aug 30, 2023