Fix bug where nodes (like Text) with a non-visible primary input would gain a primary input when shaken

Fix bug where nodes (like Text) with a non-visible primary input would gain a primary input when shaken #7163