Skip to content

Commit c43f53f

Browse files
TomasTomeceklbarcziovanforromajamassarinimfocko
committed
code review post: incorporate review feedback
Co-authored-by: Laura Barcziová <49026743+lbarcziova@users.noreply.github.com> Co-authored-by: Nikola Forró <nforro@redhat.com> Co-authored-by: Maja Massarini <mmassari@redhat.com> Co-authored-by: Matej Focko <mfocko@users.noreply.github.com> Signed-off-by: Tomas Tomecek <ttomecek@redhat.com> Assisted-by: Claude
1 parent 10d0ed7 commit c43f53f

1 file changed

Lines changed: 10 additions & 11 deletions

File tree

posts/code-review/index.md

Lines changed: 10 additions & 11 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,5 @@
11
---
22
title: Our experience with AI-based code review
3-
date: 2026-02-19T08:00:00+01:00
43
authors: ttomecek
54
tags:
65
- AI
@@ -11,23 +10,23 @@ tags:
1110

1211
# Our experience with AI-based code review
1312

14-
One amazing benefit that modern LLMs come with is using them as a linter, or a pair programmer. You can easily get feedback on your code with such an approach. If the feedback is solid, your code is improved. If the review is poor, you can just disregard it. But overall with very little effort you can gain a lot.
13+
One amazing benefit that modern LLMs come with is using them as a linter, or a pair programmer. You can easily get feedback on your code: just share it with the AI tool and ask a question. If the feedback is solid, your code is improved. If the feedback is poor, you can just disregard it. But overall with very little effort you can gain a lot.
1514

16-
In this article we are going to explore a few tools available as of February 2026 and how they compare. This is not a thorough analysis nor are we doing any evals.
15+
In this article we are going to focus on code review done with AI tools. We are going to explore a few solutions available as of February 2026 and how they compare based on our experience. This is not a thorough analysis nor are we doing any evals.
1716

1817
<!-- truncate -->
1918

2019
## [Gemini-code-assist](https://github.com/marketplace/gemini-code-assist)
2120

22-
Our AI tool of choice for our upstream reviews is Gemini-code-assist. It's free, easy to set up, and you get to see the comments inside the GitHub interface. Since it's powered by the Gemini models, it can provide solid feedback. If your PR contains clear mistakes, this tool can easily find them.
21+
Our AI tool of choice for our upstream reviews is Gemini-code-assist. It's free, easy to set up, and you get to see the comments inside the GitHub interface. Since it's powered by the Gemini models, it can provide solid feedback. If your PR contains clear mistakes, this tool can easily find them. On top of that, we had multiple instances when Gemini discovered subtle issues that were not obvious to the author or a reviewer which turned out to be real problems. Therefore it prevented real bugs from happening in our production environment.
2322

24-
On the other hand, it can be quite opinionated with suggestions that are either irrelevant or don't match your project.
23+
On the other hand, it can be quite opinionated with suggestions that are either irrelevant or don't match your project. That's not strictly a bad thing. Gemini often brings up technical debt and comments on complexity of pull requests. These comments can start a very productive discussion and help the team battle technical debt and invent solutions that can be easily maintained long term.
2524

2625
[Jiri Podivin](https://github.com/jpodivin) recently [contributed a style guide](https://github.com/packit/packit-service/commit/80470bd6c41f49b8fff9950af3e758c64c9df77c) to help Gemini with the reviews. Over the few weeks we only saw a handful of occasions when Gemini would take it into account:
2726

2827
![Gemini referencing the style guide](img/gemini_ref.png)
2928

30-
I'd say the biggest downside of this tool is that you need to open a PR to see the feedback, you cannot run it locally.
29+
It's possible to run this tool locally in your IDE, but if that's not your local development workflow, it's easier to just open a PR.
3130

3231
But overall, Gemini-code-assist is an amazing tool that is easy to set up, easy to use, it's free and provides real benefit.
3332

@@ -61,11 +60,11 @@ Claude will inspect the commit and will create a plan for itself with tasks to a
6160
...
6261
```
6362

64-
The biggest advantage here is that if you are already using this tool (or something similar), it's just a natural part of your development workflow. Claude Code not only reviews your change, but can also propose changes and even implement them.
63+
The biggest advantage here is that if you are already using this tool (or something similar), it's just a natural part of your development workflow. Claude Code not only reviews your work, but it can also propose changes and even implement them.
6564

6665
This tool can be infinitely helpful, especially if your codebase is easy to navigate, is not colossal, and has solid documentation which Claude can follow.
6766

68-
Several people on the team use Claude Code daily and it is part of our daily job. We've gotten used to it so much that we couldn't live without it, honestly. It's so convenient and helpful.
67+
Several people on the team use Claude Code daily and it is part of our daily job. We've gotten used to it so much that we couldn't live without it, honestly. It's so convenient and helpful. But not everyone is using it, with so many AI tools available, our personal journeys with AI tools adoption are different.
6968

7069
Though not everything it does is perfect and we always need to review its work and update it.
7170

@@ -75,7 +74,7 @@ We have already started a repository where we gather our Claude Code slash comma
7574

7675
## [`ai-code-review`](https://gitlab.com/redhat/edge/ci-cd/ai-code-review)
7776

78-
This is a tool built by the Redhatter [Juanje Ojeda](https://gitlab.com/juanjeojeda). It's a command-line tool that works with multiple AI providers (Gemini, Vertex AI, Anthropic, Ollama) and can perform code review locally or on existing pull requests in GitHub and GitLab.
77+
This is a tool built by a Redhatter [Juanje Ojeda](https://gitlab.com/juanjeojeda). It's a command-line tool that works with multiple AI providers (Gemini, Vertex AI, Anthropic, Ollama) and can perform code review locally or on existing pull requests on GitHub or GitLab.
7978

8079
I love the simplicity: you set it up once and then with a simple command you can have local code review and also set it up in your CI system. If you are a fan of the UNIX philosophy of having a single tool that does its job well, then this is the one.
8180

@@ -119,7 +118,7 @@ I've omitted the detailed code analysis section here for brevity, but the summar
119118

120119
The tool is particularly valuable if you're cautious about sharing data with Cloud providers. You can run a model of your choice locally via Ollama and be completely self-sufficient.
121120

122-
While the summary output is well-structured as shown above, the full detailed review can be quite verbose. Some additional formatting options (especially syntax highlighting and usage of colors) or the ability to adjust verbosity levels would be helpful for quickly scanning larger changes.
121+
While the summary output is well-structured, as shown above, the full detailed review can be quite verbose. Some additional formatting options (especially syntax highlighting and usage of colors), or the ability to adjust verbosity levels would be helpful for quickly scanning larger changes.
123122

124123
With that said, ai-code-review is a powerful tool that serves its purpose very well. Since it's an open-source project, you're welcome to open issues or contribute improvements.
125124

@@ -139,4 +138,4 @@ We've explored three distinct approaches to AI-based code review: Gemini-code-as
139138

140139
Each tool excels in its domain, and the "best" choice depends on your workflow, privacy requirements, and how you want AI to fit into your development process. The important thing is to start incorporating AI code review into your workflow. Every review comment that AI catches is time and energy your team can redirect toward more valuable work, such as having a cup of coffee.
141140

142-
Even though this article was written by me, Tomas Tomecek, I tried to capture the feedback of all the team members I received over the past several weeks.
141+
Even though this article was written by me, Tomas Tomecek, I captured the feedback of all the team members I received over the past several weeks.

0 commit comments

Comments
 (0)