About 40 people were left temporarily homeless Sunday afternoon by a fire that destroyed an eight-unit building and caused minor damage to an adjacent eight-unit building in the Village Green Apartments in Van Buren, fire and Red Cross officials said.