The waste of the house is called garbage.
Similarly, the impurities in the ore are called gangue.