I’m always game for an LLM observability platform that is potentially affordable, at least during the early phases of development.
I was using DD at work and found it to be incredibly helpful but now that I am on my own, I am much more price sensitive.
Still, having a low friction way to see how things are running, check inputs/outputs is a game changer.
One challenge I have run into is a lack of support for Anthropic models. The platforms that do have support are missing key pieces of info like the system prompt. (Prob a skill issue on my end).
Also they seem to all be tightly coupled to langchain, etc which is a no-go.
Will check this out over the next week or two. Very exciting!
Totally agree, observability is a must for LLM apps. We wanted to build something of extremely high quality but to be affordable for solo devs, that's why open-source and why very generous free tier on our managed version.
Regarding Anthropic instrumentation, we support it out of the box! You don't even need to wrap anything, just do laminar initialize and you should see detailed traces. We also support images! Hit me up at robert@lmnr.ai if you need help onboarding or setting up local version
I was using DD at work and found it to be incredibly helpful but now that I am on my own, I am much more price sensitive.
Still, having a low friction way to see how things are running, check inputs/outputs is a game changer.
One challenge I have run into is a lack of support for Anthropic models. The platforms that do have support are missing key pieces of info like the system prompt. (Prob a skill issue on my end).
Also they seem to all be tightly coupled to langchain, etc which is a no-go.
Will check this out over the next week or two. Very exciting!