Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models.
Abstract: Generating headlines for articles requires a deep understanding of the article's content and context. Automating the process of generating titles for articles from their summaries can save ...