+1 on this. I upvoted the original comment but I don't see any official way to upvote the idea or vote for it.
I can/will say that I think the AI sidebar should be able to be configured to connect to any LLMGAI that exposes an API supporting a standard interface.