Notemind is a multimodal note-taking application that leverages Azure services for enhanced functionality. It integrates audio transcription, document intelligence, image processing, and advanced search capabilities, making it a great tool for managing and enhancing your notes.
- Audio Transcription: Convert audio files to text using Azure OpenAI's Whisper model.
- Document Intelligence: Extract markdown content from documents using Azure Document Intelligence.
- Image OCR and Description: Unlock the value of images by extracting text and generating detailed descriptions using Azure Vision services.
- Note Management: Create, update, and delete notes using markdown syntax including text, files, and metadata.
- Audio Recording: Record and save notes directly within the application for quick and efficient documentation.
- Search: Utilize Azure AI Search or CosmosDB with vector embeddings for powerful, context-aware searches. Leverage hybrid search to discover entities, tags, and related content effortlessly.
- Media Storage: Store and manage media files using Azure Blob Storage.
- AI-Powered Metadata Generation: Automatically generate insightful metadata like titles and tags for your notes using LLMs, ensuring your content is always categorized and easy to retrieve.
- Interactive Chatbot: Engage with an AI chatbot powered by Azure, with access to your note data. Ask questions, retrieve specific information, or gain insights from your notes in a conversational and user-friendly manner.
- Node.js
- Python 3.10+
- Docker (optional, for containerized deployment)
- Azure account with necessary services provisioned
- Navigate to the
backenddirectory:
cd backend- Install dependencies
pip install -r requirements.txt-
Set up environment variables. Create a
.envfile in thebackenddirectory and add the necessary configuration values. -
Run the backend server
uvicorn main:app --reload- Navigate to the
frontenddirectory:
cd frontend- Install dependencies
npm install-
Set up environment variables. Create a
.envfile in thefrontenddirectory and add the necessary configuration values. -
Run the frontend development server
npm startTo deploy the necessary Azure resources using the provided Bicep file, follow these steps:
az login- Navigate to the
infrastructuredirectory:
cd infrastructure- Deploy the Bicep file:
az deployment group create --resource-group <your-resource-group> --template-file main.bicepCreate a .env file in both the backend and frontend directories and add the necessary configuration values. Below are the required environment variables:
Copy .env.sample and configure
VITE_API_URL: The URL of your backend API