[BUG]: RuntimeError(f"Could not compute metadata for {kind} target {target}: {e}")

[arminzhu]

Is there an existing issue for this bug?

• I have searched the existing issues

The bug has not been fixed in the latest main branch

• I have checked the latest main branch

Do you feel comfortable sharing a concise (minimal) script that reproduces the error? :)

Yes, I will share a minimal reproducible script.

🐛 Describe the bug

Is it because the PyTorch version is not right?

Traceback (most recent call last):
  File "/usr/local/lib/python3.12/dist-packages/colossalai/fx/tracer/tracer.py", line 300, in _meta_data_computing
    attr_itr = getattr(attr_itr, atom)
               ^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/torch/fx/_symbolic_trace.py", line 852, in module_getattr_wrapper
    return self.getattr(attr, attr_val, parameter_proxy_cache)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/torch/fx/_symbolic_trace.py", line 632, in getattr
    maybe_parameter_proxy = maybe_get_proxy_for_attr(
                            ^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/torch/fx/_symbolic_trace.py", line 626, in maybe_get_proxy_for_attr
    val_proxy = self.create_proxy("get_attr", n, (), {}, **kwargs)  # type: ignore[arg-type]
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/colossalai/fx/tracer/tracer.py", line 142, in create_proxy
    meta_out = self._meta_data_computing(
               ^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.12/dist-packages/colossalai/fx/tracer/tracer.py", line 313, in _meta_data_computing
    raise RuntimeError(f"Could not compute metadata for {kind} target {target}: {e}")
RuntimeError: Could not compute metadata for get_attr target transformer.h.0.attn.c_attn.bias: Could not compute metadata for get_attr target transformer.h.0.attn.c_attn.bias: Could not compute metadata for get_attr target transformer.h.0.attn.c_attn.bias: ......

Environment

No response