Currently because anybody can enter your house providing you're online, people often just camp at the portal, wait for someone to walk over to it, type their username and can go in their house for spec pool.
I'm fine with this staying as it is, but when i go to enter my house right as somebody else enters it using my name, it says "please wait a few seconds before doing that!" which means i then have to click the portal again, and click to enter my house before it lets me in. Although this can mean the difference of just a few seconds it can be frustrating and I feel allowing anybody to make use of my house shouldn't result in leaving me with a disadvantage e.g. if I tele'd from combat and somebody was attacking me during the pvp timer they could kill me in that last second.