Depends on what you want to do with it. But I would not keep both.
Plan A:
Keep the vps. You won't have any hassle. Enough RAM for database, webserver and a lot of scripts. If it has got enough CPU power and I/O speed for you then just keep it. Do not buy something you do not use.
Plan B...