i have been trying for the last few days to run this on my gaming laptop (which is admittedly quite shitty since it only has a 4GB VRAM GTX 1650), and i've managed to get the webui and ffmpeg working at least. however, when i try to actually get the beatmap to generate ("inference") it gives me this error message:
Exception in thread Thread-22 (_start_server):
Traceback (most recent call last):
File "C:\Users\chris\AppData\Local\Programs\Python\Python310\lib\threading.py", line 1016, in _bootstrap_inner
self.run()
File "C:\Users\chris\AppData\Local\Programs\Python\Python310\lib\threading.py", line 953, in run
self._target(*self._args, **self._kwargs)
File "C:\Users\chris\Mapperatorinator\osuT5\osuT5\inference\server.py", line 406, in _start_server
model = model_loader()
File "C:\Users\chris\Mapperatorinator\osuT5\osuT5\utils\model_utils.py", line 183, in model_loader
model = Mapperatorinator.from_pretrained(
File "C:\Users\chris\AppData\Local\Programs\Python\Python310\lib\site-packages\transformers\modeling_utils.py", line 4094, in from_pretrained
model = cls(config, *model_args, **model_kwargs)
File "C:\Users\chris\Mapperatorinator\osuT5\osuT5\model\modeling_mapperatorinator.py", line 75, in __init__
self.spectrogram = MelSpectrogram(
File "C:\Users\chris\Mapperatorinator\osuT5\osuT5\model\spectrogram.py", line 40, in __init__
self.transform = torchaudio.transforms.MelSpectrogram(
File "C:\Users\chris\AppData\Local\Programs\Python\Python310\lib\site-packages\torchaudio\transforms\_transforms.py", line 608, in __init__
self.mel_scale = MelScale(
File "C:\Users\chris\AppData\Local\Programs\Python\Python310\lib\site-packages\torchaudio\transforms\_transforms.py", line 400, in __init__
fb = F.melscale_fbanks(n_stft, self.f_min, self.f_max, self.n_mels, self.sample_rate, self.norm, self.mel_scale)
File "C:\Users\chris\AppData\Local\Programs\Python\Python310\lib\site-packages\torchaudio\functional\functional.py", line 580, in melscale_fbanks
if (fb.max(dim=0).values == 0.0).any():
File "C:\Users\chris\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\utils\_device.py", line 109, in __torch_function__
return func(*args, **kwargs)
File "C:\Users\chris\AppData\Local\Programs\Python\Python310\lib\site-packages\torch\_meta_registrations.py", line 7779, in meta_local_scalar_dense
raise RuntimeError("Tensor.item() cannot be called on meta tensors")
RuntimeError: Tensor.item() cannot be called on meta tensors
i've tried uninstalling and reinstalling transformers, checking torch and torchaudio (both versions match) and installing CUDA, but none of these have done anything. what should i do?
i have been trying for the last few days to run this on my gaming laptop (which is admittedly quite shitty since it only has a 4GB VRAM GTX 1650), and i've managed to get the webui and ffmpeg working at least. however, when i try to actually get the beatmap to generate ("inference") it gives me this error message:
i've tried uninstalling and reinstalling transformers, checking torch and torchaudio (both versions match) and installing CUDA, but none of these have done anything. what should i do?