7 WTC was burning, uncontrolled, for literally seven hours before collapsing. The debris damaged the building, yes, but more important it caught it on fire, and that's what ultimately led to the collapse.
Many of the other buildings were seriously damaged by debris, but they did not catch on...