fix: GBFS duplicated versions

[cka-y]

Summary:
This PR introduces enhancements to the GBFS data processor to improve the handling of duplicate GBFS endpoint URLs across different versions. The most important changes include adding a new validation method and updating the endpoint extraction logic to handle duplicates more effectively.

Expected behavior:

• Duplicate endpoint handling: Updated extract_endpoints_for_all_versions to:
  • Check for duplicate GBFS endpoint URLs during extraction.
  • Log warnings when duplicates are detected.
  • Remove versions with duplicate endpoints from gbfs_versions.

Testing tips:
Result for citiz_developpement

Please make sure these boxes are checked before submitting your pull request - thanks!

• Run the unit tests with ./scripts/api-tests.sh to make sure you didn't break anything
• Add or update any needed documentation to the repo
• Format the title like "feat: [new feature short description]". Title must follow the Conventional Commit Specification(https://www.conventionalcommits.org/en/v1.0.0/).
• Linked all relevant issues
• Include screenshot(s) showing how this pull request works and fixes the issue(s)

[Copilot]

Pull Request Overview

This PR adds logic to detect and remove GBFS feed versions that duplicate the same gbfs endpoint URL across versions.

• Introduces validate_gbfs_endpoint_url() to check for existing endpoint URLs.
• Enhances extract_endpoints_for_all_versions() to warn about and discard duplicate versions.
• Cleans up self.gbfs_versions by removing detected duplicates.

Comments suppressed due to low confidence (3)

functions-python/gbfs_validator/src/gbfs_data_processor.py:408

• [nitpick] The method name validate_gbfs_endpoint_url implies an assertion or error; consider renaming to something like endpoint_exists_across_versions or is_duplicate_gbfs_endpoint to clarify that it returns a boolean check.

    def validate_gbfs_endpoint_url(self, endpoint_url: str) -> bool:

functions-python/gbfs_validator/src/gbfs_data_processor.py:449

• The comment is misleading—these versions are being removed due to duplicated gbfs endpoints, not because of missing endpoints. Please update the comment to reflect the actual reason.

        # Remove versions that had no endpoints extracted

functions-python/gbfs_validator/src/gbfs_data_processor.py:408

• New logic for duplicate detection and removal should be covered by unit tests—add tests for validate_gbfs_endpoint_url and scenarios in extract_endpoints_for_all_versions where duplicates are logged and removed.

    def validate_gbfs_endpoint_url(self, endpoint_url: str) -> bool:

[qcdyx]

LGTM

[richfab]

@cka-y I still see 2 results for citiz_developpement on prod. Is this expected? Thanks!
https://mobilitydatabase.org/feeds/gbfs/gbfs-citiz_developpement

cc @emmambd

[cka-y]

@richfab we haven't release the changes yet so this is expected until we release