Scobie explained: "[Their romance came] at the expense of the family image. It was felt that Harry was rushing into something that had serious blowback potential."Things reportedly started to escalate…