Skip to content

Commit a20b92c

Browse files
adrian-gavrilaAdrian Gavrilaromanlutz
authored
MAINT Refactor question answer orchestrator as prompt orchestrator (#894)
Co-authored-by: Adrian Gavrila <agavrila@microsoft.com> Co-authored-by: Roman Lutz <romanlutz13@gmail.com>
1 parent 70de3f3 commit a20b92c

15 files changed

Lines changed: 2074 additions & 1648 deletions

doc/_toc.yml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -39,14 +39,14 @@ chapters:
3939
- file: code/orchestrators/5_crescendo_orchestrator
4040
- file: code/orchestrators/6_skeleton_key_attack
4141
- file: code/orchestrators/advbench_prompt_sending_orchestrator
42-
- file: code/orchestrators/benchmark_orchestrator
4342
- file: code/orchestrators/context_compliance_orchestrator
4443
- file: code/orchestrators/flip_orchestrator
4544
- file: code/orchestrators/fuzzing_jailbreak_templates
4645
- file: code/orchestrators/HITL_Scoring_Orchestrator
4746
- file: code/orchestrators/librAI_do_not_answer
4847
- file: code/orchestrators/many_shot_jailbreak
4948
- file: code/orchestrators/pair_orchestrator
49+
- file: code/orchestrators/qa_benchmark_orchestrator
5050
- file: code/orchestrators/role_playing_orchestrator
5151
- file: code/orchestrators/tree_of_attacks_with_pruning
5252
- file: code/orchestrators/violent_durian

doc/api.rst

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -253,6 +253,7 @@ API Reference
253253
OrchestratorResult
254254
PAIROrchestrator
255255
PromptSendingOrchestrator
256+
QuestionAnsweringBenchmarkOrchestrator
256257
RedTeamingOrchestrator
257258
ScoringOrchestrator
258259
SkeletonKeyOrchestrator
@@ -389,6 +390,7 @@ API Reference
389390
MarkdownInjectionScorer
390391
PromptShieldScorer
391392
Scorer
393+
QuestionAnswerScorer
392394
SelfAskCategoryScorer
393395
SelfAskLikertScorer
394396
SelfAskRefusalScorer

0 commit comments

Comments
 (0)