Good question, the answer is going to vary greatly.
I'd say in most cases when renting a server, it's going to be used hardware. The CPU, RAM, and hard-drives were once probably used by someone else. Even some providers who own their hardware may use some used parts, or use a used server all...