Latency Counting port inference for input only or output only.

[VonTum]

It's turning out very common to have input only and output only domains. Manually annotating with absolute latencies is unintuitive and prone to making bad judgements. Even if not perfect, we should strive to do an inference for such ports too.