export the game
create the .ico in some web (16, 32, 48, 64, 128, 256 sizes are required)
open the exported .exe with resource hacker and replace the icon for your .ico
save and close. done
if you dont see changes, move the the files to another folder. Its a cache thing.