investigate e.g. coderabbitai

[cgwalters]

There's tools like https://github.com/apps/coderabbitai that may make sense for us to investigate. Let's do this after the CNCF repository transfer which hopefully we can do this week.

[cgwalters]

We ended up using Gemini for now.

[romfreiman]

@cgwalters how?

[cgwalters]

See e.g. #1393 (review) - I just added it to the repo config.

(That said, I'm considering a model where people run models to initiate a review, and then the people can tweak the review and own it, but that's a distinct issue)

[romfreiman]

Is gemini free?

[cgwalters]

It's currently $0 yes; who knows if it will stay that way of course. I assume the way we're effectively paying them is making it more obvious that they can use all this data for training (same as all the others really).

As far as the actual "what it does" vs coderabbit - my PoV is things like this comment are too noisy - I'm sure whoever made that "Sequence Diagram(s)" was proud of their work but it just seems like noise to me by default. (Though Gemini does also include a summary by default, it can be turned off and I have done so. The Gemini review is IME quite good at catching real problems, but as I didn't try coderabbit personally I can't compare the two at that level.