Arthur, a machine learning monitoring startup, has benefited from the interest in generative AI this year, and it has been developing tools to help companies work with LLMs more effectively. Today it is releasing Arthur Bench, an open source tool to help users find the best LLM for a particular set of data.
Adam Wenchel, CEO and co-founder at Arthur says that the company has seen a lot of interest in generative AI and LLMs, and so they have been putting a lot of effort into creating products.
He says that today, and granted we are less than a year since the release of ChatGPT, that companies don’t have an organized way to measure the effectiveness of one tool against another, and that’s why they created Arthur Bench.
“Arthur Bench solves one of the critical problems that we just hear with every customer which is [with all of the model choices], which one is best fo...
