Gating for inputs

[NehaMotlani]

Hello,

I was hoping to get some pointers related to the below query.
I want to apply gating to my inputs using attention such that only important ones go forward in the network. While searching for inbuilt attention libraries in PyTorch, I came across this. But I having problems understanding what the inputs are (i.e context and query). Would really appreciate any pointers.

Thanks,
Neha