Fine-tuning a small model to analyze search questions
A uses a cheap, to analyze a user’s question. This step pulls out useful keywords and filters before search happens.
a model for this narrow job is being considered. The main questions are how much would be needed, which models would fit the task, and whether others have tested for this kind of query analysis.
Key points
- A has a step that analyzes the question before search.
- The current step uses a cheap, .
- The goal is to extract keywords and filters from the question.
- is being considered for this narrow task.
- Open questions include size, model choice, and prior experiments.