X Factor bosses have said the weekend's warm weather was to blame for the drastic drop in viewing figures for this year's launch episode of the show.