One way to say that:
Example #1: Okay, got it. Now, back to the matter at hand.
Example #2: Are you some kind of mind reader?"
"Not at all."
"Oh. Okay, just checking. Now, back to the matter at hand. Your foot placement was off. Excellent job at moving the earth though."