#1451·DocsGPT

Feature Extract and process images from source uploads

Author: fadingNACreated Nov 23, 2024Updated Jun 27, 2026
Labelsenhancementhelp wantedpythonhacktoberfestapplicationbackend

Feature description

@dartpain Basically allow our AI's to eat images. good place to start is just open ai llms, even docsgpt free service should work

Why is this feature needed ?

Accept image and encoded base64

  • Maybe user wants to send a message with an image when chatting with AI

✌️ How do you aim to achieve this?

  • When a source has an image, for example there is a link (publicly accessible) in markdown file that was ingested, we can pass it to llm inside classic rag retriever when its generating an answer.

️ Additional Information

No response

Have you spent some time to check if this feature request has been raised before?

  • I checked and didn't find similar issue

Are you willing to submit PR?

Yes I am willing to submit a PR!