Sahih Bukhari | Volume 9 | Hadith Number 254

Narrated by Ibn 'Umar
Allah's Apostle said, "This matter (caliphate) will remain with the Quraish even if only two of them were still existing."