|
1 | 1 | # Extensible SQL Lexer and Parser for Rust Agents Guidelines |
2 | 2 |
|
3 | 3 | ## General Agent Workflow |
4 | | -1. You will receive a coding task from your operator. |
5 | | -2. You will analyze the task and come up with a code change to complete it. |
6 | | -3. You will write unit tests to ensure your code change is working as expected. |
7 | | -4. You will run the commands in the Pre Commit Checks section below to ensure your change is ready for a pull request. |
8 | | -5. When instructed to open a PR, you will follow the instructions in the Pull Request Guidelines section below. |
9 | | - |
10 | | -## Agent Workflow for Fixing Parsing Issues in SQL Statements |
11 | | -1. You will receive a SQL statement that is not parsed correctly by the project. Typically parsing will fail with an error. |
12 | | -2. You will add a unit test to check that the SQL statement is indeed unparsed. Follow the instructions in the "Unit Tests" section below. |
13 | | -3. You will analyze why the SQL statement is not parsed correctly, pointing to the code section that you think is faulty. See more info in the Analyzing Parsing Issues and General Coding Guidelines below. |
14 | | -4. You will fix the parsing issue and ensure that the new unit test passes successfully by running `cargo test --all-features`. |
15 | | -5. You will remove the first unit test that you added in step 2 and instead create "synthetic" unit tests to cover the code sections that you modified, to ensure that similar parsing issues are caught in the future. |
16 | | -6. Run the commands in the Pre Commit Checks section below to ensure that all unit tests are passing and that the code is ready for a pull request. |
17 | | -7. You will create a PR in the with the changes you made, follow the instructions on Pull Request Guidelines below. |
| 4 | +1. You will write unit tests to ensure your code change is working as expected. |
| 5 | +2. You will run the commands in the Pre Commit Checks section below to ensure your change is ready for a pull request. |
| 6 | +3. When instructed to open a PR, you will follow the instructions in the Pull Request Guidelines section below. |
18 | 7 |
|
19 | 8 | ## General Coding Guidelines |
20 | | -1. Refrain from adding conditions on specific dialects, such as `dialect_id!(self is SnowflakeDialect)` or `dialect_of!(self is SnowflakeDialect | BigQueryDialect | MySqlDialect | HiveDialect)`. Instead, define a new function in the `Dialect` trait that describes the condition, so that dialects can turn this condition on more easily. |
| 9 | +1. Refrain from adding conditions on specific dialects, such as `dialect_is!(...)` or `dialect_of!(... | ...)`. Instead, define a new function in the `Dialect` trait that describes the condition, so that dialects can turn this condition on more easily. |
21 | 10 | 2. Make targeted code changes and refrain from refactoring, unless it's absolutely required. |
22 | 11 |
|
23 | | -## Unit Tests |
24 | | -Follow these rules: |
25 | | -- When testing a multi-line SQL statement, use a raw string literal (r#"..."#) to preserve formatting. |
| 12 | +## Unit Tests Guidelines |
| 13 | +- When testing a multi-line SQL statement, use a raw string literal, i.e. `r#"..."#` to preserve formatting. |
26 | 14 | - You can use the following template for simple unit tests: |
27 | 15 | ```rust |
28 | 16 | <dialect>().parse_sql_statements(r#"..."#).unwrap(); |
29 | 17 | ``` |
30 | | -For example: `snowflake().parse_sql_statements(r#"SELECT * FROM my_table;"#).unwrap();` |
31 | | - |
32 | | -- New unit tests should be added to the `tests` module in the corresponding dialect file (e.g., `src/tests/sqlparser_redshift.rs` for Redshift), and should be placed at the end of the file. |
| 18 | +For example: `snowflake().parse_sql_statements(r#"SELECT * FROM my_table"#).unwrap();` |
| 19 | +- New unit tests should be added to the `tests` module in the corresponding dialect file (e.g., `tests/sqlparser_redshift.rs` for Redshift), and should be placed at the end of the file. |
| 20 | +- If the new functionality is gated using a dialect function, and the SQL is likely relevant in most dialects, tests should be placed under `tests/sqlparser_common.rs`. |
33 | 21 |
|
34 | 22 | ## Analyzing Parsing Issues |
35 | 23 | You can try to simplify the SQL statement to identify the root cause of the parsing issue. This may involve removing certain clauses or components of the SQL statement to see if it can be parsed successfully. Additionally, you can compare the problematic SQL statement with similar statements that are parsed correctly to identify any differences that may be causing the issue. |
|
0 commit comments