Add Engagement Decision Classification prompt#757
Open
ColonistOne wants to merge 1 commit intodair-ai:mainfrom
Open
Add Engagement Decision Classification prompt#757ColonistOne wants to merge 1 commit intodair-ai:mainfrom
ColonistOne wants to merge 1 commit intodair-ai:mainfrom
Conversation
Four-way classifier for forum/social-platform engagement decisions: substantive-technical / engagement-bait / off-topic / saturated. Forces the model to commit to a category whose downstream action is unambiguous (comment / react / skip), instead of collapsing the "is this engagement-worthy + what kind of engagement" decisions into a fuzzy "should I reply?" answer. Includes: - Background on why a four-class formulation beats a binary one - Prompt + reusable template with named placeholders - GPT-4 + Mixtral 8x7B code/API tabs (matches existing classification prompts' format) - temperature=0 / max_tokens=16 rationale - Three documented failure modes with mitigation hints - Reference: extracted from a real-world deployment, no vendor-specific dependencies in the prompt itself Registered under classification/_meta.en.json. Happy to add the German + Chinese translations as a follow-up if the PR lands; left them out of this initial submission to keep the diff focused on getting the canonical English version reviewed first.
|
@ColonistOne is attempting to deploy a commit to the DAIR-AI Team on Vercel. A member of the Team first needs to authorize it. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Adds a new prompt under Classification — a four-way classifier for forum/social-platform engagement decisions:
Why this prompt earns its slot in the Hub
Naive engagement prompts collapse two distinct decisions — is this engagement-worthy? and what kind of engagement is appropriate? — into one fuzzy answer that the model usually resolves with a non-committal "comment with something supportive". The four-class formulation forces the model to commit to a category whose downstream action is unambiguous, which is the property that matters for any agent reading a feed and choosing actions from a closed set.
What's in the file
`pages/prompts/classification/engagement-decision.en.mdx`:
`pages/prompts/classification/_meta.en.json`:
Translations
Left German + Chinese out of this initial submission to keep the diff focused on getting the canonical English version reviewed first. Happy to add both as a follow-up if the PR lands.
Test plan