"If a worker wants to do his job well, he must first sharpen his tools." - Confucius, "The Analects of Confucius. Lu Linggong"
Front page > Programming > Semantic Router - Steer LLMs

Semantic Router - Steer LLMs

Published on 2024-08-27
Browse:478

Semantic Router - Steer LLMs

I wanted to share a project I've been working on called SemRoute, and I would love to get your feedback. SemRoute is a semantic router that uses vector embeddings to route queries based on their semantic meaning. It's designed to be flexible and easy to use, without the need for training classifiers or using large language models.

Here's a brief overview:

  • Supports multiple embedding models (OpenAI, MistralAI)
  • Support custom embedding models
  • Offers dynamic and static thresholding
  • Allows different scoring methods (individual averaging, centroid)

You can check it out on GitHub: https://github.com/HansalShah007/semroute. I'd really appreciate any feedback or suggestions from this community on how to improve it or use cases you think it might be suited for.
Thanks!

Release Statement This article is reproduced at: https://dev.to/hansalshah/semantic-router-steer-llms-1l23?1 If there is any infringement, please contact [email protected] to delete it
Latest tutorial More>

Disclaimer: All resources provided are partly from the Internet. If there is any infringement of your copyright or other rights and interests, please explain the detailed reasons and provide proof of copyright or rights and interests and then send it to the email: [email protected] We will handle it for you as soon as possible.

Copyright© 2022 湘ICP备2022001581号-3