Skip to content

Commit 165ac2e

Browse files
Relax lora string test (#19312)
Seeing small numerical flakeyness causing diverging output. The output is roughly equivalent though. Current thought is different cpu architectures causing different xnnpack kernels to trigger causing minor difference in output.
1 parent 9b95dd2 commit 165ac2e

1 file changed

Lines changed: 9 additions & 1 deletion

File tree

.ci/scripts/test_lora.sh

Lines changed: 9 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -160,6 +160,13 @@ To calculate 15% of 80, we can multiply 80 by 15/100.
160160
So, 15% of 80 is equal to (80 * 15) / 100 = 1200 / 100 = 12.
161161
#### 12
162162
The answer is: 12<|im_end|>"
163+
EXPECTED_QUANT_LORA_ALTERNATE_PREFIX="
164+
<|im_start|>user Calculate 15% of 80?<|im_end|><|im_start|>assistant
165+
To calculate 15% of 80, we can multiply 80 by 15/100.
166+
80 * 15/100 = 12.
167+
So, 15% of 80 is 12.
168+
#### 12
169+
The answer is: 12<|im_end|>"
163170

164171
# Export Quantized PTE, PTD file, no LoRA.
165172
# override base.lora_config=null to avoid creating a lora model
@@ -225,12 +232,13 @@ NOW=$(date +"%H:%M:%S")
225232
echo "Finished at ${NOW}"
226233

227234
RESULT=$(cat result.txt)
228-
if [[ "${RESULT}" == "${EXPECTED_QUANT_LORA_PREFIX}"* ]]; then
235+
if [[ "${RESULT}" == "${EXPECTED_QUANT_LORA_PREFIX}"* ]] || [[ "${RESULT}" == "${EXPECTED_QUANT_LORA_ALTERNATE_PREFIX}"* ]]; then
229236
echo "Expected result prefix: ${EXPECTED_QUANT_LORA_PREFIX}"
230237
echo "Actual result: ${RESULT}"
231238
echo "Test 4: Success"
232239
else
233240
echo "Expected result prefix: ${EXPECTED_QUANT_LORA_PREFIX}"
241+
echo "Alternate expected result prefix: ${EXPECTED_QUANT_LORA_ALTERNATE_PREFIX}"
234242
echo "Actual result: ${RESULT}"
235243
echo "Test 4: Failure; results not the same"
236244
cleanup_files

0 commit comments

Comments
 (0)