"I think if your product doesn’t work with an off-the-shelf model, it’s unlikely to magically start working with a custom, in-house model."
In my experience a lott of LLM usage in B2B is fairly basic (translation, summerization, data extraction, categorization) and fairly well handled by current SOTA foundation models. Could this be improved by custom/finetuned models? Sure, but in nearly all cases I have seen the ROI of improving other parts of the application is way higher than the investment in developing and maintaining custom models.
In my experience a lott of LLM usage in B2B is fairly basic (translation, summerization, data extraction, categorization) and fairly well handled by current SOTA foundation models. Could this be improved by custom/finetuned models? Sure, but in nearly all cases I have seen the ROI of improving other parts of the application is way higher than the investment in developing and maintaining custom models.