Sentence Reranking Using LLM Attention Maps
Leveraging what the LLM already knows. An experiment extracting document relevance signals from Attention Maps to rerank sentences, along with a survey of related papers.
Leveraging what the LLM already knows. An experiment extracting document relevance signals from Attention Maps to rerank sentences, along with a survey of related papers.