internlm test

[fjaijf]

Before submitting

• Lint code. If there are lint issues, please format the code first.

# Install and register `pre-commit` in the project folder
pip install pre-commit && pre-commit install

# Process previous code files separately
pre-commit run --file XXXX.py

• Add test cases into tests folder. If there are codecov issues, please add tests cases first.

PR types

PR changes

Description

模型前向精度对齐，前10个token的logits diff为0.08
模型推理生成正常
模型sft loss为
[2026-05-20 01:25:59,358] [ INFO] - loss: 2.46186185, learning_rate: 5e-06, global_step: 1, current_memory_allocated: 13.973276853561401, current_memory_reserved: 26.491707801818848, max_memory_allocated: 26.48780107498169, max_memory_reserved: 26.491707801818848, interval_runtime: 12.092, interval_samples_per_second: 0.3308, interval_steps_per_second: 0.0827, ppl: 11.726624443222343, progress_or_epoch: 0.3333, cpu_used_memory: 16.1, cpu_available_memory: 30.93
[2026-05-20 01:25:59,358] [ INFO] - [DataLoad global_step: 1] data_load_time: 44.99 ms (accumulated over 4 micro-batches)
[2026-05-20 01:25:59,360] [ INFO] - Not using packing mode for data iteration.
[2026-05-20 01:26:00,303] [ INFO] - loss: 2.7151227, learning_rate: 1e-05, global_step: 2, current_memory_allocated: 13.973276853561401, current_memory_reserved: 26.491707801818848, max_memory_allocated: 26.48780107498169, max_memory_reserved: 26.491707801818848, interval_runtime: 0.9452, interval_samples_per_second: 4.2321, interval_steps_per_second: 1.058, ppl: 15.106463521258013, progress_or_epoch: 0.6667, cpu_used_memory: 16.1, cpu_available_memory: 30.92
[2026-05-20 01:26:00,303] [ INFO] - [DataLoad global_step: 2] data_load_time: 0.66 ms (accumulated over 4 micro-batches)
[2026-05-20 01:26:01,250] [ INFO] - loss: 2.56071281, learning_rate: 1.5e-05, global_step: 3, current_memory_allocated: 13.973276853561401, current_memory_reserved: 26.491707801818848, max_memory_allocated: 26.48780107498169, max_memory_reserved: 26.491707801818848, interval_runtime: 0.9468, interval_samples_per_second: 4.2245, interval_steps_per_second: 1.0561, ppl: 12.945041382596827, progress_or_epoch: 1.0, cpu_used_memory: 16.11, cpu_available_memory: 30.91

[paddle-bot]

Thanks for your contribution!

[Paddle-CI-Bot]

PaddleFormers Log Analysis

Run #26204065608 · Attempt 1

API Error: 503 {"error":{"message":"当前分组 default 下对于模型 claude-sonnet-4-6 无可用渠道 (request id: 2026052111455214824593167034320)","type":"one_api_error"}}

---

_{🔄 每次 Re-run 后自动更新}

[codecov-commenter]

Codecov Report

❌ Patch coverage is 64.74227% with 171 lines in your changes missing coverage. Please review.
⚠️ Please upload report for BASE (develop@08d8839). Learn more about missing BASE report.

Files with missing lines	Patch %	Lines
paddleformers/transformers/internlm/tokenizer.py	0.00%	98 Missing ⚠️
paddleformers/transformers/internlm/modeling.py	79.81%	67 Missing ⚠️
...eformers/transformers/internlm/auto_dist_config.py	33.33%	4 Missing ⚠️
...ddleformers/transformers/internlm/configuration.py	95.45%	2 Missing ⚠️

❌ Your patch status has failed because the patch coverage (64.74%) is below the target coverage (75.00%). You can increase the patch coverage or adjust the target coverage.

Additional details and impacted files

@@            Coverage Diff             @@
##             develop    #4495   +/-   ##
==========================================
  Coverage           ?   46.53%           
==========================================
  Files              ?      480           
  Lines              ?    91124           
  Branches           ?        0           
==========================================
  Hits               ?    42409           
  Misses             ?    48715           
  Partials           ?        0           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.