-
Notifications
You must be signed in to change notification settings - Fork 5.5k
Expand file tree
/
Copy pathNOTICE
More file actions
45 lines (35 loc) · 1.93 KB
/
NOTICE
File metadata and controls
45 lines (35 loc) · 1.93 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
Berkeley Function-Calling Leaderboard — Vendored Sources
========================================================
The contents of this directory contain code and data adapted (and in some
cases copied verbatim) from the upstream Berkeley Function-Calling
Leaderboard (BFCL) project:
https://github.com/ShishirPatil/gorilla
Path: berkeley-function-call-leaderboard/bfcl_eval/
Upstream is licensed under the Apache License, Version 2.0.
See https://www.apache.org/licenses/LICENSE-2.0 for the full text.
Vendored modules and their upstream sources:
* func_source_code/*.py
<- bfcl_eval/eval_checker/multi_turn_eval/func_source_code/*.py
Tool implementations (GorillaFileSystem, MathAPI, MessageAPI,
TwitterAPI, TicketAPI, TradingBot, TravelAPI, VehicleControlAPI,
WebSearchAPI, MemoryAPI_*).
* memory_prereq_conversation/*.json
<- bfcl_eval/data/memory_prereq_conversation/*.json
Pre-baked conversation states used by the memory category prerequisite
write-phase. Copied byte-for-byte.
* memory_utils.py
<- bfcl_eval/utils.py (memory-related helpers only) and
bfcl_eval/eval_checker/agentic_eval/agentic_checker.py
The subset of utils we need to drive the memory snapshot dance and
score agentic responses (substring match w/ punctuation normalization).
* _upstream_multi_turn_utils.py / _upstream_multi_turn_checker.py
<- bfcl_eval/eval_checker/multi_turn_eval/multi_turn_*.py
Kept as reference for the runtime/scoring logic we reimplemented in
runtime.py (per-test instance scope instead of module globals).
Modifications from upstream:
* Package-relative imports
(``benchmarks.bfcl.executable_runtime.func_source_code...``).
* Network-gated classes raise ``RuntimeNetworkRequired`` instead of
failing opaquely when run without credentials.
* Per-test ``ExecutableRuntime`` ownership of tool instances.
Apache-2.0 attribution is preserved on each vendored file.