Proxy the referrer API to upstream registry with paging and local merge

[stonezdj]

Thank you for contributing to Harbor!

Comprehensive Summary of your change

Issue being fixed

Fixes #(issue)

Please indicate you've done the following:

• Well Written Title and Summary of the PR
• Label the PR as needed. "release-note/ignore-for-release, release-note/new-feature, release-note/update, release-note/enhancement, release-note/community, release-note/breaking-change, release-note/docs, release-note/infra, release-note/deprecation"
• Accepted the DCO. Commits without the DCO will delay acceptance.
• Made sure tests are passing and test coverage is added if needed.
• Considered the docs impact and opened a new docs issue or PR with docs changes if needed in website repository.

[codecov]

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 46.75%. Comparing base (1019610) to head (81b0772).
⚠️ Report is 3 commits behind head on main.

❗ There is a different number of reports uploaded between BASE (1019610) and HEAD (81b0772). Click for more details.

HEAD has 1 upload less than BASE

Flag	BASE (1019610)	HEAD (81b0772)
unittests	2	1

Additional details and impacted files

@@             Coverage Diff             @@
##             main   #23237       +/-   ##
===========================================
- Coverage   66.04%   46.75%   -19.30%     
===========================================
  Files        1074      253      -821     
  Lines      116854    14353   -102501     
  Branches     2955     2955               
===========================================
- Hits        77180     6711    -70469     
+ Misses      35388     7281    -28107     
+ Partials     4286      361     -3925     

Flag	Coverage Δ
unittests	46.75% <ø> (-19.30%)	⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.
see 827 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
• 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.