chatflock.web_research.page_analyzer

Module Contents

chatflock.web_research.page_analyzer.clean_html(content)
class chatflock.web_research.page_analyzer.PageQueryAnalysisResult

Bases: pydantic.BaseModel

answer: str
class chatflock.web_research.page_analyzer.PageQueryAnalyzer

Bases: abc.ABC

Helper class that provides a standard way to create an ABC using inheritance.

abstract analyze(url, title, query, spinner=None)
Parameters:
  • url (str)

  • title (str)

  • query (str)

  • spinner (Optional[halo.Halo])

Return type:

PageQueryAnalysisResult

class chatflock.web_research.page_analyzer.OpenAIChatPageQueryAnalyzer(chat_model, page_retriever, text_splitter, use_first_split_only=True)

Bases: PageQueryAnalyzer

Helper class that provides a standard way to create an ABC using inheritance.

Parameters:
  • chat_model (langchain.chat_models.base.BaseChatModel)

  • page_retriever (chatflock.web_research.page_retrievers.PageRetriever)

  • text_splitter (langchain.text_splitter.TextSplitter)

  • use_first_split_only (bool)

chat_model
page_retriever
text_splitter
use_first_split_only
analyze(url, title, query, spinner=None)
Parameters:
  • url (str)

  • title (str)

  • query (str)

  • spinner (Optional[halo.Halo])

Return type:

PageQueryAnalysisResult