That's why it's a joke for a security guard to stand at his/her podium asking hotel guests to show their room key as a measure of "security" before getting on an elevator. There are plenty of room keys around from previous hotel guests that don't get turned back in and on ebay for anyone bent on criminal activity who wants to obtain keys for nefarious purposes.