FireCrawl may miss key policy details during website scraping
is being used to scrape policy s from websites for one country. Even with a clear bullet list of what to look for, important information is still being missed.
The core issue is that a website tool plus AI instructions may not reliably capture every required detail. When the needed data is specific, the process may need tighter instructions and a separate check for missing items.
Key points
- is being used to collect national policy data.
- Important information is missing even after a bullet list of required items is provided.
- Website with AI instructions does not guarantee complete results.
- High-risk like s need a checking step for missing data.