The X Factor's audience has sunk still further after the latest show dipped below eight million viewers for the first time in almost five years.