The bad thing about leaving the tags there is that, any potential hacker can easily identify which version you are using. From another angle, if someone manages to find a security glitch in any WordPress version, he would be able to search for all blogs using that particular version.