v0.3
UpTrain v0.3 Release Notes
📢 We are thrilled to announce the release of UpTrain v0.3, our revamped LLM evaluation, prompt experimentation, and monitoring toolkit.
🎉 This version introduces exciting new capabilities and improvements to enhance all your LLM needs. Here's an overview of the key features and updates:
Expanded Support for LLM Use Cases:
UpTrain now provides extensive support for various LLM use cases, enabling you to:
🔍 Perform evaluations to check your LLM responses on aspects such as correctness, structural integrity, bias, hallucination, etc.
🔬 Validate language models to safeguard users against inappropriate responses and toxic content
🧪 Conduct A/B testing to compare and find the best prompts quantitatively
New Checks Added:
We have added several new checks to UpTrain, further expanding its capabilities. The following Checks are now available for utilization:
🚀 We integrate with OpenAI Evals and allow you to run any of them reliably using UpTrain
📝 Create and run your own Custom Model Grading check suited to your needs
📊 Generate embeddings and run similarity and distribution checks
🔍 Perform both syntax and execution checks for LLM-generated SQL queries
Improved Configuration Interface:
UpTrain Checks now offer a neater interface for configuring checks to make it convenient to set up and manage. We made the following enhancements:
✨ All checks are now Pydantic models
🧩 Configure all your operators and plots in one place
Refactored Library with Performant Technologies:
To improve performance and provide a smoother experience, we have refined the UpTrain library by leveraging cutting-edge technologies:
🚀 Speedy data processing with Polars and Delta Tables
🐞 Easy debugging with Loguru logger
📊 Simplified plotting with Plotly charts
Enhanced Dashboard Experience:
With UpTrain v1.0, we have introduced a range of new functionalities to our dashboard interface, empowering you to gain valuable insights and visualize data effectively.
🧮 Sort and filter your tables
⚖️ Aggregate and compare using pivot tables
Upgrade to UpTrain v0.3 now to experience these exciting new features and improvements. We are confident they will enhance your LLM monitoring process and streamline your language model management. For more details, please look at the updated documentation and user guide. 🙌
Thank you for your continued support and feedback. We look forward to your valuable insights as we evolve and improve UpTrain.
Happy evaluation! 🚀🔍
The UpTrain Team