refactor: adopt AutoSDK-generated helpers (issues #332-#337 closed)

All six AutoSDK generator improvements filed yesterday shipped in
autosdk.cli 0.30.2-dev.59. Switching to the generated runtime lets us
delete five hand-written shim files (~250 LOC) while gaining additional
typed exception variants, idempotency-key on every mutating op, and
RFC-5988 Link-header pagination — none of which we had hand-rolled.

generate.sh — added flags:
  --generate-http-exception-hierarchy    (issue #332)
  --generate-idempotency-helpers
    --idempotency-header-name x-idempotency-key  (issue #333)
  --generate-retry-handler               (issue #335)
  --generate-pageable-helpers            (issue #334 — AutoSDKPager.NextUrlAsync + EnsureSameOrigin)
  --generate-multipart-upload-helpers    (issue #336 — AutoSDKUploadFile)

Deleted (now redundant with generated equivalents):
  FirecrawlExceptions.cs        → AuthenticationException / PaymentRequiredException
                                  / RateLimitException (with RetryAfter) /
                                  ServerException now generated, plus more
                                  (AuthorizationException 403, NotFoundException 404,
                                  RequestTimeoutException 408, ConflictException 409,
                                  ValidationException 422).
  FirecrawlClient.Exceptions.cs → ApiException.Create() routes every error
                                  response to the typed subclass automatically;
                                  no ProcessResponse partial wiring needed.
  FirecrawlExceptionMapper.cs   → ApiException.TryParseRetryAfter is now a
                                  public static helper inside the generated
                                  ApiException type.
  IdempotencyKeyExtensions.cs   → every POST/PATCH/DELETE op now takes a
                                  string? idempotencyKey parameter directly.
  PaginationHelper.cs           → AutoSDKPager.EnsureSameOrigin replaces it;
                                  pagination helpers now delegate to it.

Refactored:
  V2/ParseFile.cs               → thin compatibility shim around
                                  AutoSDKUploadFile.From{Bytes,Path,Stream}.
                                  Drops the duplicated MIME-type table — now
                                  uses AutoSDKMimeTypeGuesser which covers
                                  more types (audio/video/archives).
  V2/V2Client.cs                → ParseAsync accepts AutoSDKUploadFile +
                                  uses ToHttpContent("file"); error path uses
                                  ApiException.Create for typed exceptions;
                                  monitor PaginateAsync uses
                                  AutoSDKPager.EnsureSameOrigin.
  CrawlClient.Paginate.cs       → uses AutoSDKPager.EnsureSameOrigin + raises
                                  typed exceptions via ApiException.Create.
  ScrapingClient.PaginateBatch.cs → same.

Filed AutoSDK #349 for a generator XML-doc bug in
AutoSDKUploadFile.g.cs (cref uses C# keyword 'byte' instead of 'Byte',
causing CS1584/CS1658/CS0419 under GenerateDocumentationFile=true).
Worked around with CS1584/CS1658/CS0419 in <NoWarn>.

Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>

Author: HavenDV

src/libs/Firecrawl/CrawlClient.Paginate.cs

@@ -1,3 +1,5 @@
+using System.Net.Http;
+
 namespace Firecrawl;
 
 public partial class CrawlingClient
@@ -7,12 +9,14 @@ public partial class CrawlingClient
     /// every page of <see cref="CrawlStatusResponseObj.Data"/> into the first
     /// response and clearing <see cref="CrawlStatusResponseObj.Next"/> when
     /// done. The supplied <paramref name="response"/> is mutated and returned.
+    ///
+    /// <para>
+    /// Same-origin validation against <see cref="HttpClient.BaseAddress"/> is
+    /// enforced via <see cref="AutoSDKPager.EnsureSameOrigin"/> — Firecrawl's
+    /// <c>next</c> pointers are absolute URLs and a hostile server returning a
+    /// foreign URL would otherwise harvest the <c>Authorization</c> header.
+    /// </para>
     /// </summary>
-    /// <remarks>
-    /// Firecrawl's <c>next</c> pointers are absolute URLs; we refuse to
-    /// forward the <c>Authorization</c> header across origins to avoid leaking
-    /// the API key.
-    /// </remarks>
     public async Task<CrawlStatusResponseObj> PaginateAsync(
         CrawlStatusResponseObj response,
         CancellationToken cancellationToken = default)
@@ -25,10 +29,25 @@ public async Task<CrawlStatusResponseObj> PaginateAsync(
         while (!string.IsNullOrEmpty(next))
         {
             cancellationToken.ThrowIfCancellationRequested();
+            AutoSDKPager.EnsureSameOrigin(next, HttpClient.BaseAddress);
+
+            using var request = new HttpRequestMessage(HttpMethod.Get, next);
+            if (HttpClient.DefaultRequestHeaders.Authorization is { } auth)
+            {
+                request.Headers.Authorization = auth;
+            }
+
+            using var http = await HttpClient.SendAsync(request, cancellationToken).ConfigureAwait(false);
+            if (!http.IsSuccessStatusCode)
+            {
+                throw ApiException.Create(http.StatusCode, http.ReasonPhrase ?? http.StatusCode.ToString());
+            }
 
-            var content = await PaginationHelper
-                .FetchNextPageJsonAsync(HttpClient, next, cancellationToken)
-                .ConfigureAwait(false);
+            var content = await http.Content.ReadAsStringAsync(
+#if NET5_0_OR_GREATER
+                cancellationToken
+#endif
+                ).ConfigureAwait(false);
 
             var page = CrawlStatusResponseObj.FromJson(content, JsonSerializerContext)
                 ?? throw new InvalidOperationException("Pagination response deserialization returned null.");

src/libs/Firecrawl/Firecrawl.csproj

@@ -22,7 +22,7 @@
         CA2000 — StringContent/ByteArrayContent ownership transferred to MultipartFormDataContent.
         CA2227 — DTO collection setters required for System.Text.Json source-gen round-trip.
     -->
-    <NoWarn>$(NoWarn);CS1591;CA1032;CA1056;CA1308;CA1819;CA1822;CA2000;CA2227</NoWarn>
+    <NoWarn>$(NoWarn);CS1591;CS1584;CS1658;CS0419;CA1032;CA1056;CA1308;CA1819;CA1822;CA2000;CA2227</NoWarn>
   </PropertyGroup>
 
 </Project>