-
Notifications
You must be signed in to change notification settings - Fork 77
Add AI policy to README #280
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: master
Are you sure you want to change the base?
Changes from all commits
File filter
Filter by extension
Conversations
Jump to
Diff view
Diff view
There are no files selected for viewing
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -4,6 +4,10 @@ Nintendo Wii U homebrew guide written by staff members of the [Nintendo Homebrew | |
|
|
||
| https://wiiu.hacks.guide/ | ||
|
|
||
| ## AI (Artificial Intelligence) Policy | ||
|
|
||
| As a community largely composed of passionate developers and reverse engineers, we've seen the rise of AI impact the homebrew scene. We would prefer if fully or near-fully AI generated code and/or projects be kept away from our project. However, you are welcome to use a minor amount of AI "assistance" provided you are able to maintain your contributions. | ||
|
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Also what is the impact you have seen on the homebrew scene? Did anything bad happen to the scene because of the usage of such tools?
Contributor
Author
There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. Have you… not seen how god awful AI assistance has been? There was a problem hiding this comment. Choose a reason for hiding this commentThe reason will be displayed to describe this comment to others. Learn more. This is about "code". An no I don't have seen negative impact of AI code on the homebrew scene. Can you provide me with an example? |
||
|
|
||
| ## Running the site locally | ||
|
|
||
| This requires the following installed on your system: | ||
|
|
@@ -27,4 +31,4 @@ npm ci | |
| npm run docs:dev | ||
| ``` | ||
|
|
||
| The website should now be running on http://127.0.0.1:5173/ (or a port shown on the terminal). Any edits you make should appear live! | ||
| The website should now be running on http://127.0.0.1:5173/ (or a port shown on the terminal). Any edits you make should appear live! | ||
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Who is "we"?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Largely NH staff.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
It says developers and reverse engineers. Since this also affects Wii U, how many developers and reverse engineers there share this this opinion?
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
From my understanding:
Ideally, all three groups (community staff, guide contributors, and community members) would have opinions in sync, but of course that doesn't happen in a community every single time. So, leading into the next section:
I personally think this is a very valid question. I also think it would be valid to ask this about the end-users who will be using the guide as a separate demographic to additionally weigh.
...Is it time for yet another survey app..? Maybe a series of them, since this policy would also affect the Wii and 3DS?
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Surveying would probably be a good idea to collect a larger sample size, considering my brief research for #236 was just in a small discord server.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The first question is kind of pointless. No one says they only want code from AI.
The relevant question is: Do you mind? And if so are you willing take the consequences (having less choice of homebrew).
And with the default no and only asked to draw a line if they said yes, that would mean all the no Sayers would vote against having aroma in the guide. I am not sure if you want that.
If you wanted an unbiased answer you would just ask in every case where they draw the line.
And if you want them to make a informed instead of a feelings based decision, you should also inform about the consequences for each selection if you give selections for drawing the line.
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I don't think you understood what I meant. The question I quoted there implied to the users they decide how the homebrew gets developed with their answer.
So to the user it sound like: do you rather have that homebrew developed with AI or without it.
But thats not the case. They are deciding about the policy which decides what gets included, which is significant different.
With homebrew it's take it or leave it. You don't get to make demands to the developer.
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
This is not what I meant.
Copy and pasting my message from Discord:
So in this case, I'd prefer not to but do tolerate it. Some people may be fine / like the idea of AI helping make new homebrew apps faster, and they would say "yes" to that question. Hope that makes things clearer; we can probably clarify that for the end-user.
The default would be "no opinion / undecided / I don't know". Having a default "yes" or "no" either way is a bias.
Answering that prior question partly specifies where you draw the line. Answering "no" would mean they draw the line at having any AI in homebrew at all.
The user is expected to have some knowledge of AI if they change from "undecided" to "no" or "yes". Again, you are correct that they do not get to decide how future homebrew is developed, but this is specifically for the guide authors to understand what these demographics think about in these cases. Sharing the consequences is irrelevant because this doesn't actually affect their ability to get said homebrew, and maybe not even if they're informed about what homebrew apps do have AI assistance.
This is why I specified: "And explain that this information is being used to draft a policy around AI tools in the guides, and to help developers understand expectations of what users want. Would also be very useful for the app stores too." I can concede that not all (or even any) homebrew developers will take that feedback in mind when making apps in the future, and that can be clarified.
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That's not how I would understand the question and I don't think that's how users would read it and I am not sure if it is even relevant to this.
I mean implied default. If you say there is something to tolerate it kind of implies that the neutral position would be no. (since if people are unsure they usually don't take any action, and in that case not doing means not tolerating.
No it forces the user to make up their mind on that binary question, before they know there are more nuanced options. And once you get someone to make up their mind they will usually keep their position.
No you can't give any statement beyond the guide here. Not even "might" as that creates some expectation.
I think the most honest answer would be to ask:
I don't care | I don't care as long as it is tested / proven | only if it was reviewed | function level | remote ai based auto complete | local ai auto complete | non ai auto complete | nothing at all, just notepad
Also notice I included pretty extreme options at both ends. People without a very strong opinion tend to stay away from the fringes. Having buffer answers there causes less skewing on the relevant answers.
If you want the users to be informed, you would include examples of homebrew using (openly) AI assist to that degree. Most users didn't knew that Aroma already included AI code, so I question this expectation:
With that expectation you exclude much of the "I don't care" group. Also the AI haters here are pretty loud, without having much knowledge.
And this also brings me to another relevant point: depending on how you Title / invite people to the survey you will also cause a bias by this first filter. I would expect a large group of don't care to varying degrees, these will be unlikely to click on it if it is marketed as a survey about AI. Then you have a group which is very passionate about hating AI, they will definitely use it. I don't expect there to be many if any at all people who passionate about that others have to use it. And if it is about introducing a ban you have to count the don't care against the ban. Either someone cares enough about banning something or they don't. The default on ban / allow should always be allowed or at least the current state (which is allowed atm).
A more generic title like "Vote on what homebrew should be allowed on the guides" would help with that bias.
I would argue it is a consequence what the guide includes. If it was of no consequence, then we wouldn't need the guide at all.
Uh oh!
There was an error while loading. Please reload this page.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Further discussion on the survey is happening on the Nintendo Homebrew Discord server in #ai-contribution-discussion