Revert D110214945

Differential Revision: D110352920

Pull Request resolved: pytorch#20669

Author: rascani

backends/arm/tosa/dialect/BUCK

@@ -9,8 +9,6 @@ fbcode_target(_kind = runtime.python_library,
         "shape.py",
     ],
     deps = [
-        "fbsource//third-party/tosa_tools:serializer",
-        "fbsource//third-party/tosa_tools:tosa_reference_model",
         "//caffe2:torch",
         "//executorch/backends/arm/tosa:mapping",
         "//executorch/backends/arm/tosa:tosa",