I made a web app for chatting with all the content related to Confluence Space using Langchain.

[Pooja Soni]

Title: How to Automatically Generate Embedding for Updated Documents in a Confluence Space and Enable Real-Time Question Answering on the Updated Data?

Body: I'm currently working on accessing a Confluence space using Lang chain and performing question answering on its data. The embedding of this data are stored in a Chromadb vector database once I provide user name,API key and Space key.
However, I'm looking for a way to automatically generate embedding for any documents that change in real-time within the Confluence space and enable real-time question answering on the updated data. Any suggestions or solutions on how to achieve this would be greatly appreciated!

[Nic Brough -Adaptavist- · Accepted solution]

Welcome to the Atlassian Community!

Why are you doing this?  Confluence is already a wiki that provides you with real-time access to all of its updated data, and if used as a knowledge base, suggests pages that answers questions to your users.

Could you explain what problem you are trying to solve here?

[Patrick Heaney]

This is exciting!  Can you just add an new or updated Confluence pages to your chroma DB again?    If so, could you set an automation to detect any additions or updates to trigger adding said page to the Chromadb?

[naresh v]

Pooja, were you able to figure it out on getting updated pages? I am looking for something similar!

[Rafal Wasowski]

Hi Pooja,

I just came across this thread whilst searching the web to find out if anyone has successfully attempted this. Have you made any progress since you posted this?

I don't have admin privileges so I don't think I can create webhooks, but that sounds like a good way to trigger a (re-)creation of a vector embedding when either new content is posted or old one is updated.

In the absence of webhooks, I'm toying with the idea of utilising the RSS feed as a compromise. It does have all the relevant data (URL link, creation time etc.).

It would be interesting to learn where you got to with your project if you were happy to share.

[Patrick Heaney]

If I had asked the original question, my point would be to create an AI chatbot to answer questions in lieu of the Confluence's existing search feature.  This AI Chatbot would be much faster and save a enormous amount of time.  (Did I get this right, Pooja?)