[Framework Proposal] LlamaIndex

[dnielsen]

Framework Proposal

Description

AllyCat demo for users of LlamaIndex

Use Cases

Those using LlamaIndex want to use tools too. For example, using LlamaIndex, which AllyCat already uses, it could use the Google Search API and Wikipedia API tools to add functionality to the AllyCat Q&A capability.

Proposed Integration

Outline the proposed integration approach, including:

• Similar to issue [Framework Proposal] The non-framework integration #300 - 'The non-framework integration'
• When a user asks a question of thealliance.ai website using AllyCat, it could use LlamaIndex to use the LLM to identify the primary subject and then use the Gofannon Wikipedia tool to search for it on Wikipedia and then display the response next to the primary RAG answer.
• Also, it could use that key subject as an input for Google search, and use the Gofannon Google Search tool to find a list of related links.
• This could be a great way to educate new AI developers how to add tools to their LlamaIndex-based app

Documentation

Where should the documentation for this framework be placed? (e.g., docs/new_framework/)

• https://github.com/The-AI-Alliance/gofannon/tree/main/gofannon/base/llamaindex.py
• Or as a Quickstart demo for both the Wikipedia and Google tools?

Additional Context

Here is AllyCat running in a Google Cloud Run container (give it a minute to load) https://allycat-293510350011.us-central1.run.app/

• As you can see the UI is pretty simple. We plan to improve it, and then add the output from Gofannon to the side or bottom of the current response area.
• Could use the same UI as issue [Framework Proposal] The non-framework integration #300

---

Contribution Checklist

• I have read the CONTRIBUTING.md guide
• I have checked that this framework doesn't already exist in the repository
• I have followed the single responsibility principle
• [] I have designed a simple and intuitive integration interface
• I have considered error handling and logging
• I have outlined clear use cases
• I have considered documentation requirements

---

Development Plan

Outline your plan for implementing this framework integration, including:

• Estimated timeline - Two days in addition to work required for issue [Framework Proposal] The non-framework integration #300
• [] Required resources -
• Testing strategy
• Documentation plan