hi guys,
I just tried swe-bench evaluation with the golden patches extracted from the dataset, but found an issues which led to failure. Accoding to test_output.txt, it failed to find sendmail. I supposed that the sendmail should have been installed in docker images, but not. I am not sure if it's a docker image issue. Anybody ever tried the golden patches? Thanks.
The instance is instance_NodeBB__NodeBB-04998908ba6721d64eba79ae3b65a351dcfbc5b5-vnan.
info: [install/enableDefaultPlugins] activating default plugins {"0":"nodebb-plugin-dbsearch","1":"nodebb-widget-essentials","2":"nodebb-plugin-composer-default"}
email confirmation (v3 api)
error: [user.create] Validation email failed to send
[emailer.send] Error: [[error:sendmail-not-found]]
at Emailer.sendToEmail (/app/src/emailer.js:345:10)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Emailer.send (/app/src/emailer.js:267:2)
at async UserEmail.sendValidationEmail (/app/src/user/email.js:169:3)
at async create (/app/src/user/create.js:112:4)
at async User.create (/app/src/user/create.js:30:11)
at async registerAndLoginUser (/app/src/controllers/authentication.js:50:14)
at async authenticationController.register (/app/src/controllers/authentication.js:108:16)
✔ should have a pending validation
✔ should not list their email
✔ should not allow confirmation if they are not an admin
✔ should not confirm an email that is not pending or set
✔ should confirm their email (using the pending validation)
✔ should still confirm the email (as email is set in user hash) (496ms)
hi guys,
I just tried swe-bench evaluation with the golden patches extracted from the dataset, but found an issues which led to failure. Accoding to test_output.txt, it failed to find sendmail. I supposed that the sendmail should have been installed in docker images, but not. I am not sure if it's a docker image issue. Anybody ever tried the golden patches? Thanks.
The instance is instance_NodeBB__NodeBB-04998908ba6721d64eba79ae3b65a351dcfbc5b5-vnan.
info: [install/enableDefaultPlugins] activating default plugins {"0":"nodebb-plugin-dbsearch","1":"nodebb-widget-essentials","2":"nodebb-plugin-composer-default"}
email confirmation (v3 api)
error: [user.create] Validation email failed to send
[emailer.send] Error: [[error:sendmail-not-found]]
at Emailer.sendToEmail (/app/src/emailer.js:345:10)
at process.processTicksAndRejections (node:internal/process/task_queues:95:5)
at async Emailer.send (/app/src/emailer.js:267:2)
at async UserEmail.sendValidationEmail (/app/src/user/email.js:169:3)
at async create (/app/src/user/create.js:112:4)
at async User.create (/app/src/user/create.js:30:11)
at async registerAndLoginUser (/app/src/controllers/authentication.js:50:14)
at async authenticationController.register (/app/src/controllers/authentication.js:108:16)
✔ should have a pending validation
✔ should not list their email
✔ should not allow confirmation if they are not an admin
✔ should not confirm an email that is not pending or set
✔ should confirm their email (using the pending validation)
✔ should still confirm the email (as email is set in user hash) (496ms)