Skip to content

Issues: JohnSnowLabs/langtest

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

73 Open 379 Closed
73 Open 379 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

Add New Unit Tests to Enhance Test Coverage and Reliability 💡Enhancements Something can be improved
#1139 opened Nov 12, 2024 by chakravarthik27
@chakravarthik27
Random Masking on Images Tests
#1137 opened Nov 5, 2024 by chakravarthik27
@chakravarthik27
Revise and Improve Website Content
#1136 opened Nov 5, 2024 by chakravarthik27
@chakravarthik27
Enhance VQA Task Support for Huggingface Models ⭐ Feature Indicates new feature requests
#1130 opened Oct 14, 2024 by chakravarthik27
@chakravarthik27
Explore the DSPy and make integrations ⭐ Feature Indicates new feature requests
#1074 opened Jul 18, 2024 by chakravarthik27
Enhance Harness Report to Include Detailed Score Counts and Grouped Results ⭐ Feature Indicates new feature requests
#1073 opened Jul 18, 2024 by chakravarthik27
@chakravarthik27
Automatic Tests Info Registry with LangTest Versions ⭐ Feature Indicates new feature requests
#1072 opened Jul 18, 2024 by chakravarthik27
@chakravarthik27
Enhance Safety Tests and Develop Comprehensive Safety Test Dataset with Lamaguard 💡Enhancements Something can be improved
#1071 opened Jul 18, 2024 by chakravarthik27
@chakravarthik27
Interactive UI for LLM evaluation
#1069 opened Jul 16, 2024 by dcecchini
Explore Jailbreak resource (text + visual)
#1068 opened Jul 16, 2024 by dcecchini
2
Templates for Chat Models for HuggingFace
#1034 opened May 17, 2024 by chakravarthik27
@chakravarthik27
Exploring LLM2LLM for Data Augmentation
#1002 opened Apr 1, 2024 by chakravarthik27
Rate Limit feature for Azure/OpenAI results generation 💡Enhancements Something can be improved
#988 opened Feb 27, 2024 by Jeff-ZYX
1
implementation of a leaderboard for different quantizations (gguf 4 vs 6 vs etc bits)
#987 opened Feb 26, 2024 by chakravarthik27
Enhancing Data Quality Testing for Langtest ⭐ Feature Indicates new feature requests
#982 opened Feb 19, 2024 by RakshitKhajuria
Explore litellm
#978 opened Feb 6, 2024 by ArshaanNazir
Do Embedding Benchamark for different datasets
#973 opened Feb 2, 2024 by ArshaanNazir
Explore AI-Secure ⏭️ Next Release Issues or Request for the next release
#971 opened Jan 31, 2024 by ArshaanNazir
Explore Together AI embedding models ⏭️ Next Release Issues or Request for the next release
#968 opened Jan 30, 2024 by dcecchini
Try different Prompting Techniques like few shot, ER , COT etc
#959 opened Jan 15, 2024 by ArshaanNazir
1
Explore Galileo's hallucination index ⏭️ Next Release Issues or Request for the next release
#957 opened Jan 11, 2024 by dcecchini
Add tests for De-Identification ⏭️ Next Release Issues or Request for the next release
#954 opened Jan 4, 2024 by dcecchini
@chakravarthik27 @ArshaanNazir
1
Add Word Embedding (with Pooling) to benchmark ⏭️ Next Release Issues or Request for the next release
#950 opened Jan 2, 2024 by dcecchini
Preparing Embeddings Benchmarks (LangTest)
#947 opened Dec 27, 2023 by ArshaanNazir
@chakravarthik27 @ArshaanNazir
9
Preparing LLM Benchmark Table ( LangTest)
#946 opened Dec 27, 2023 by ArshaanNazir
@ArshaanNazir
9
ProTip! Type g i on any issue or pull request to go back to the issue listing page.