You should never leave the front door open. While I can appreciate that you might want to enable Terminal Services directly to your desktop, at least make it a little difficult for attackers to find you.
Change the RDP port (TCP 3389) to anything else (avoiding reserved port numbers of course 1-1024). It only takes a few minutes and combined with a strong password, gives you better security than your neighbour – thus an attacker will move on to them and leave you alone… ๐
How to Change Terminal Server’s Listening Port