Using an AI coding assistant to migrate an application from one programming language to another wasn’t as easy as it looked. Here are three takeaways.
Use the vitals package with ellmer to evaluate and compare the accuracy of LLMs, including writing evals to test local models ...
Abstract: Unit testing is fundamental for software reliability, yet manual test construction is inefficient and often results in limited coverage. Existing automated tools struggle with complex ...
When you buy new cropland, you’re not just buying the soil, you’re also investing in the years of fertilizer, inputs, and stewardship the previous owner put into it. However, are you paying for those ...
In this tutorial, we show how we treat prompts as first-class, versioned artifacts and apply rigorous regression testing to large language model behavior using MLflow. We design an evaluation pipeline ...