It seemed that there are two wrong annotated images in the dataset annotation

[leizhenyu-lzy]

710 58 948 370 0 0 0 0 0 0 12--Group/12_Group_Group_12_Group_Group_12_839.jpg
496 50 956 706 0 0 0 1 0 0 28--Sports_Fan/28_Sports_Fan_Sports_Fan_28_959.jpg

you can find them in the txt file: list_98pt_rect_attr_train.txt
The first is in line 1035
The second is in line 2748

the points's position is not in the rectangle

look forward to your soon reply