GoModel

Hey, this looks super nice. I do like the 'compact' feel of this. Reminds me of Traefik. It seems very promising indeed! One problem I have is that yes, LiteLLM key creation is…

Given this app seems to expose itself via REST calls, why would anyone care that it’s written in Go? I guess it matters to potential contributors but the majority of interest…

I wrote a similar golang gateway, with the understanding that having solid API gateway features is important. https://sbproxy.dev - engine is fully open source. Another reason…

Expectable, given that LiteLLM seems to be implemented in Python. However kudos for the project, we need more alternatives in compiled languages.

It’s a heavily vibe coded project with only proxy with terrible benchmarks design. Basically vibe coded benchmarks that lie through ignorance of mocked super fast endpoint…

I don't see any significant advantage over mature routers like Bifrost. Are there even any benchmarks?

GoModel. I see some red flags in the docs/benchmarks, but I could be wrong in my judgement here. What I noticed: the website shows a diagram of the litellm SDK communicating with…

Does this have a unified API? In playing around with some of these, including unified libraries to work with various providers, I've found you are, at some point, still forced to…

That would be valuable if there's a commitment to never have a non-opensource offering under GoModel? If so, you can document it in the repo.

Looks nice, thanks for open sourcing and sharing. I'm all in on Go and integrating AI up and down our systems for https://housecat.com/ and am currently familiar and happy with:…

Any plans for AI provider subscription compatibility? Eg ChatGPT, GH Copilot etc ? (Ala opencode)

Nice one! Let's say I'm serving local models via vllm (because ollama comes with huge performance hits), how would I implement that in gomodel?

This is way more interesting to me as well. I have projects that use small limited-purpose language models that run on local network servers and something like this project would…

Hey, this looks super nice. I do like the 'compact' feel of this. Reminds me of Traefik. It seems very promising indeed! One problem I have is that yes, LiteLLM key creation is…

Curious how the semantic caching layer works.. are you embedding requests on the gateway side and doing a vector similarity lookup before proxying? And if so, how do you handle…

+1 on the semantic caching thread. related q: how do you handle false positives? two prompts that embed close but should not share a response (eg "summarize this doc" with…

This is awesome work, thanks for sharing! How do you plan on keeping up with upstream changes from the API providers? I have implemented something similar, and the biggest issue…

Really slick and lightweight! My biggest question is about the upstream API evolution. Keeping up with every provider's updates feels like a full-time job—how do you automate or…

how does this compare to bifrost - another golang router?

i use this for my personal projects. some features are gated behind a license but the basics like provider proxy, logs, metrics are covered in the free version.…

Expectable, given that LiteLLM seems to be implemented in Python. However kudos for the project, we need more alternatives in compiled languages.

Does this have a unified API? In playing around with some of these, including unified libraries to work with various providers, I've found you are, at some point, still forced to…

Looks nice, thanks for open sourcing and sharing. I'm all in on Go and integrating AI up and down our systems for https://housecat.com/ and am currently familiar and happy with:…

Hi, I'm the author of GAI. I'm glad that you are happy with it! I'm using it a lot myself, both for own and client projects, but I wasn't sure if anyone else was. :D I'm actually…