An AI API Integration Prototype
To help me learn how to build and host apps that leverage LLMs I came up with the idea to use OpenAI's Response API to create human-friendly summaries of legalese documents such as Terms of Service, Privacy Policies, etc.
- ✅ Learn how to use OpenAI’s Response API
- ✅ Learn about prompt engineering
- ✅ Proxy functionality via backend service using Back4App to manage auth, tokens, and keys.
- ✅ Improve UX by leveraging OpenAI API streaming
- ✅ Turn app into Google Chrome extension
- ☑️
Learn how to set up Back4App local dev - ✅ Port backend to Google Cloud
- ✅ Better formatting of response so it isn't just a blob of copy.
- ✅ Progressive rendering of results grouped into related sections.
- Add "Expound Upon" option to explain specific sentences or phrases.
- Add monitoring of token consumption
- Add "bring your own key" option?
