There's your trouble - at least part of it.
So if you observed a crow flying by and within an hour it started to rain - and this happened 4 times without fail in a fortnight - you would assign causation to this without all that pesky math or rigorous testing or analysis?
And don't say "no"...