Skip to content

--skip-code-validation flag not being honored #112

Description

@priyanshugahlot2004

kane-cli version

0.4.8

Operating System

Windows (x64)

Installation method

npm

What happened?

Bug: --skip-code-validation CLI flag is not honored (always uses default true)

Summary
The --skip-code-validation flag passed to kane-cli run has no effect. Regardless of the value passed, the setting stays at its default (true), so code validation ("Execute and Verify") is skipped and never triggers. The setting can only be changed via the TUI, not the CLI.

Environment

  • kane-cli version: 0.4.8
  • skill version: 0.0.13
  • OS / shell: Windows / cmd.exe

Additional details

Expected behavior
Passing --skip-code-validation false should set the value to false, causing the "Execute and Verify" code validation step to run.

Actual behavior
The flag is ignored. The value remains true (default), so "Execute and Verify" does not trigger. The CLI gives no error indicating the flag/value was rejected.

Steps to reproduce

  1. Run any flow with the flag, e.g.: kane-cli run "" --url --headless --agent --skip-code-validation false
  2. Observe that code validation ("Execute and Verify") does not run.
  3. The effective value of Skip Validation remains true.

Variations tried (none worked)

  • --skip-code-validation false
  • --skip-code-validation False
  • --no-skip-code-validation

Workaround
Setting it through the TUI works:

  • TUI → Skip Validation → off

Only after this does the default value update to false and validation trigger correctly in CLI and TUI.

Error output / logs

C:\Users\priyanshug>kane-cli run "Search for laptops" --url google.com --headless --agent --name sample1 --skip-code-validation false
{"type":"recording_state","enabled":true,"session_id":"85d9f1cb-fd40-4f8e-b871-6c6cb2e64f50","persist":true,"session_name":"sample1","test_path":"C:\\Users\\priyanshug\\.testmuai\\tests\\sample1_test.md","output_path":"C:\\Users\\priyanshug\\.testmuai\\tests\\output-sample1"}
{"type":"bifurcation","flows":["Navigate to https://google.com then Search for laptops"],"count":1}
{"step":2,"status":"running","remark":"Step 1"}
{"step":2,"status":"done","remark":"navigate: Navigate to https://google.com"}
{"step":3,"status":"running","remark":"Step 2"}
{"step":3,"status":"done","remark":"type: Filled 'laptops' via DOM locator: internal:role=combobox[name=\"Search\"i]"}
{"step":4,"status":"running","remark":"Step 3"}
{"step":4,"status":"done","remark":"click: Clicked via DOM locator: internal:role=button[name=\"Google Search\"i] >> nth=0"}
{"step":5,"status":"running","remark":"Step 4"}
{"type":"run_end","status":"failed","summary":"You wanted to use the site’s search feature to search for “laptops.”\nThe automation navigated to Google to run the search.\nGoogle showed a “Sorry”/verification page (captcha) instead of the search results.\nBecause the captcha requires a human to complete it, the search couldn’t be submitted and results couldn’t be reached.","one_liner":"attempted to search for laptops on Google","final_state":{"url":"https://www.google.com/sorry/index?continue=https://www.google.com/search%3Fq%3Dlaptops%26sca_esv%3D7269236fd9f7d28b%26source%3Dhp%26ei%3DLGI-aqbMAYmqur8PkJDliAs%26iflsig%3DABILxe8AAAAAaj5wPHK0J2gr96T62nngKSBGLHd1yV0q%26ved%3D0ahUKEwimkvGr5qSVAxUJle4BHRBIGbEQ4dUDCCI%26oq%3Dlaptops%26gs_lp%3DEgdnd3Mtd2l6IgdsYXB0b3BzMgsQABiABBixAxiDATIFEAAYgAQyCBAAGIAEGLEDMgUQABiABDIIEAAYgAQYsQMyBRAAGIAEMggQABiABBixAzIFEAAYgAQyBRAAGIAEMgUQABiABEiNTVApWClwAXgAkAEAmAFqoAFqqgEDMC4xuAEMyAEA-AEBmAICoAJ0qAIKwgIKEAAYAxiPARjqAsICChAuGAMYjwEY6gKYAwbxBTVb7A1PTcI_kgcDMS4xoAfEBbIHAzAuMbgHbsIHBTAuMS4xyAcHgAgB%26sclient%3Dgws-wiz%26sei%3DQGI-aoffJJnikPIPpt6H0QI&q=EgR2uV4dGMHE-dEGIjBecwIq8gZXHTs8dVbC6RUyQ8KQUISGjcxIDNKotd5JJkypQbOQpNQXFNL-s3WEWi0yAVJaAUM"},"reason":"Hard blocker: captcha","duration":53.8,"bifurcated":false,"total_runs":1,"context":{"memory":{},"variables":{},"pointer":"(failed) attempted to search for laptops on Google"},"credits_consumed":10.797689999999998,"session_dir":"C:\\Users\\priyanshug/.testmuai/kaneai/sessions\\85d9f1cb-fd40-4f8e-b871-6c6cb2e64f50","run_dir":"C:\\Users\\priyanshug/.testmuai/kaneai/sessions\\85d9f1cb-fd40-4f8e-b871-6c6cb2e64f50\\runs\\0","result_code":610,"reason_code":"blocker.captcha","per_flow_metadata":[{"result_code":"610","reason_code":"blocker.captcha","error_message":"Hard blocker: captcha","summary":"You wanted to use the site’s search feature to search for “laptops.”\nThe automation navigated to Google to run the search.\nGoogle showed a “Sorry”/verification page (captcha) instead of the search results.\nBecause the captcha requires a human to complete it, the search couldn’t be submitted and results couldn’t be reached.","one_liner":"attempted to search for laptops on Google","credits_consumed":10.797689999999998}],"test_url":"https://test-manager.lambdatest.com/projects/01KT4A6T62SKG096YANK1JXJFK/test-cases/01KW1TYPRX9100AJBYM3MG92YV/dashboard/share/US_K1V493PQNEL8D0DD8BWCUO2O8Q4O34FXDDCD8113XTU8C0YW5PLV5TM8QSYONVZH?type=summary&agentView=true&fqdn=summary-page"}

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type
    No fields configured for issues without a type.

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions