Commit d00d964
committed
[KVCache] unify host block allocation through allocate_host_blocks
## Motivation
直接调用 `_host_pool.allocate()` 时不会触发驱逐,导致在 host block 空闲不足
但存在 evictable block 的情况下,`can_allocate_host_blocks` 返回 True 但分配
静默失败。
## Modifications
- `prepare_prefetch_metadata`:将 `_host_pool.allocate()` 替换为 `allocate_host_blocks()`,
空闲不足时自动驱逐 evictable host block 后再分配
- 删除未被生产代码调用的 `offload_to_host` 方法及其全部测试用例1 parent f1850f5 commit d00d964
2 files changed
Lines changed: 3 additions & 101 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
909 | 909 | | |
910 | 910 | | |
911 | 911 | | |
912 | | - | |
913 | | - | |
914 | | - | |
915 | | - | |
916 | | - | |
917 | | - | |
918 | | - | |
919 | | - | |
920 | | - | |
921 | | - | |
922 | | - | |
923 | | - | |
924 | | - | |
925 | | - | |
926 | | - | |
927 | | - | |
928 | | - | |
929 | | - | |
930 | | - | |
931 | | - | |
932 | | - | |
933 | | - | |
934 | | - | |
935 | | - | |
936 | | - | |
937 | | - | |
938 | | - | |
939 | | - | |
940 | | - | |
941 | | - | |
942 | | - | |
943 | | - | |
944 | | - | |
945 | | - | |
946 | | - | |
947 | | - | |
948 | | - | |
949 | | - | |
950 | | - | |
951 | 912 | | |
952 | 913 | | |
953 | 914 | | |
| |||
1063 | 1024 | | |
1064 | 1025 | | |
1065 | 1026 | | |
1066 | | - | |
1067 | | - | |
1068 | | - | |
| 1027 | + | |
| 1028 | + | |
| 1029 | + | |
1069 | 1030 | | |
1070 | 1031 | | |
1071 | 1032 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
788 | 788 | | |
789 | 789 | | |
790 | 790 | | |
791 | | - | |
792 | | - | |
793 | | - | |
794 | | - | |
795 | | - | |
796 | | - | |
797 | | - | |
798 | | - | |
799 | | - | |
800 | | - | |
801 | | - | |
802 | | - | |
803 | | - | |
804 | | - | |
805 | | - | |
806 | | - | |
807 | | - | |
808 | | - | |
809 | | - | |
810 | | - | |
811 | | - | |
812 | | - | |
813 | | - | |
814 | | - | |
815 | | - | |
816 | | - | |
817 | | - | |
818 | | - | |
819 | | - | |
820 | | - | |
821 | | - | |
822 | | - | |
823 | | - | |
824 | | - | |
825 | | - | |
826 | | - | |
827 | | - | |
828 | | - | |
829 | | - | |
830 | | - | |
831 | | - | |
832 | | - | |
833 | | - | |
834 | | - | |
835 | | - | |
836 | | - | |
837 | | - | |
838 | | - | |
839 | | - | |
840 | | - | |
841 | | - | |
842 | | - | |
843 | | - | |
844 | | - | |
845 | | - | |
846 | | - | |
847 | | - | |
848 | | - | |
849 | | - | |
850 | 791 | | |
851 | 792 | | |
852 | 793 | | |
| |||
0 commit comments