I avoid Canada for business purposes.I'm not having any problems so far, many years on. I file taxes separately for the US and Canada. H&R Block does this for me. Yes, for years that US citizens have no US income they still have to file a $0 return (not required in Canada), but the Block's fee for that is minimal.
My family once made a pile of money up there. Those assets ended up trapped in Canada due to threat of double taxation. It took years to unwind.

.