I've also found a white eraser works...
... like the white plastic technical eraser from Staples. As long as the card is really plastic and the laminate is still in good shape the eraser will generally get minor to medium glue or other gunk off the card pretty easily without any harm.
