feat(scraping): add 8 new profile sections for comprehensive reading

[Gabrcodes]

Summary

Adds 8 new entries to PERSON_SECTIONS so that get_person_profile can scrape every profile section LinkedIn offers. No new extractor methods needed — they follow the existing /details/{section}/ URL pattern.

New Section	URL Suffix
skills	/details/skills/
certifications	/details/certifications/
volunteer	/details/volunteering-experiences/
projects	/details/projects/
publications	/details/publications/
courses	/details/courses/
recommendations	/details/recommendations/
organizations	/details/organizations/

Also exports ALL_PERSON_SECTION_NAMES from scraping/__init__.py for convenience.

Changes

• scraping/fields.py — 8 new section entries + ALL_PERSON_SECTION_NAMES list
• scraping/__init__.py — export the new constant
• tools/person.py — updated docstring listing available sections
• tests/test_fields.py — updated expected keys and all-sections test

Test plan

• 24/24 field tests pass
• ruff check and ruff format pass

[greptile-apps]

Greptile Summary

This PR adds 8 new entries to PERSON_SECTIONS in scraping/fields.py (skills, certifications, volunteer, projects, publications, courses, recommendations, organizations), each following the established /details/{section}/ URL navigation pattern. It also introduces an ALL_PERSON_SECTION_NAMES convenience constant that contains every requestable section name (all keys except main_profile), which is exported from scraping/__init__.py. The docstring in tools/person.py is updated to advertise the new sections, and both test files are updated to cover the expanded dict and the new constant.

Key points:

• All 8 new sections follow the exact same (url_suffix, is_overlay=False) shape as the existing non-overlay sections — no new scraping logic is needed.
• ALL_PERSON_SECTION_NAMES correctly excludes main_profile (which is always implicitly included by parse_person_sections), and its semantics are verified by the new test_all_person_section_names_excludes_main_profile test.
• test_all_sections in test_fields.py now derives the join string from the constant itself, preventing future drift.
• test_all_sections_visit_all_urls in test_scraping.py now drives the section set directly from PERSON_SECTIONS, so the count assertion (15 page + 1 overlay) stays in sync automatically.

Confidence Score: 5/5

This PR is safe to merge — it is a purely additive, low-risk change with no logic modifications and comprehensive test coverage.

All changes follow the existing PERSON_SECTIONS pattern exactly. No new scraper logic is introduced, and the only runtime effect is additional page navigations when callers explicitly request the new section names. Tests are thorough: the hard-coded section lists are replaced with data-driven derivations, a new structural invariant test is added, and URL assertions cover every new suffix.

No files require special attention.

Important Files Changed

Filename	Overview
linkedin_mcp_server/scraping/fields.py	Added 8 new section entries following the existing pattern and introduced ALL_PERSON_SECTION_NAMES; logic is correct and consistent.
linkedin_mcp_server/scraping/init.py	Exports the new ALL_PERSON_SECTION_NAMES constant; straightforward and correct.
linkedin_mcp_server/tools/person.py	Docstring updated to list all new sections; example string updated to show skills; no logic changes.
tests/test_fields.py	Expected-keys test updated, test_all_sections now uses the constant, and a new structural invariant test for ALL_PERSON_SECTION_NAMES is added.
tests/test_scraping.py	Hard-coded section set replaced with set(PERSON_SECTIONS), URL assertions added for each new section, and the page-count assertion updated to 15; all changes are consistent with the implementation.

Flowchart

%%{init: {'theme': 'neutral'}}%%
flowchart TD
    A[get_person_profile\ncalled with sections string] --> B[parse_person_sections]
    B --> C{section name\nin PERSON_SECTIONS?}
    C -- yes --> D[add to requested set]
    C -- no --> E[add to unknown list\nlog warning]
    D --> F{is_overlay?}
    F -- False --> G[extract_page\n/in/username/suffix/]
    F -- True --> H[_extract_overlay\n/in/username/overlay/contact-info/]
    G --> I[sections result dict]
    H --> I

    subgraph PERSON_SECTIONS [PERSON_SECTIONS - 16 entries]
        P0[main_profile]
        P1[experience]
        P2[education]
        P3[skills NEW]
        P4[certifications NEW]
        P5[volunteer NEW]
        P6[projects NEW]
        P7[publications NEW]
        P8[courses NEW]
        P9[recommendations NEW]
        P10[organizations NEW]
        P11[interests]
        P12[honors]
        P13[languages]
        P14[contact_info overlay=True]
        P15[posts]
    end

Loading

_{Reviews (5): Last reviewed commit: "style: move PERSON_SECTIONS import to mo..." | Re-trigger Greptile}