GitHub Search App with Parallel and LanceDB#19
Open
elviskahoro wants to merge 2 commits into
Open
Conversation
…rate descriptions with Parallel and load them into LanceDB for Vector Search
elviskahoro
changed the title
This change adds a LIMIT 1 clause to the BigQuery query in the repos_with_stars resource. This optimization ensures that only the repository with the highest star count is retrieved for each month, rather than processing all repositories above the minimum star threshold. Benefits: - Reduces BigQuery costs by limiting data transferred and processed - Improves pipeline performance by fetching fewer rows per month - Simplifies downstream processing to focus on top-performing repositories - Maintains accurate star count metrics for the most-starred repo per month The query now returns a single row per month sorted by star count in descending order, providing a cleaner signal for tracking repository popularity trends.
elviskahoro
force-pushed
the
elvis/github-search
branch
from
92136d8 to
594bcda
Compare
martinibach
approved these changes
Apr 27, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
tldr; githubsearch.app