The AI now does not go to the webpages in the docs, It should atleast go one level deep and find relevent info related to question.
Approch
- Use langchain to find if any link is there , you will also get source along with it
- Use regex to add the links in a list
- Use the already written web crawling function to do webcrawling
The AI now does not go to the webpages in the docs, It should atleast go one level deep and find relevent info related to question.
Approch