Inspiration
Companies are reluctant in using internet-enabled llms as they are concerned with data leaks
What it does
This uses rag for an llm to consult a vector db of the company's confidential information (stored internally) and screen a user's prompts for any privacy leaks or concerns and redacts them before forwarding them to any other service
Built With
- chromadb
- fastapi
- lmstudio
- python
Log in or sign up for Devpost to join the conversation.