Sahih Muslim | Book 20 | Hadith Number 4726
Narrated by Anas
It has been narrated on the authority of Anas b. Malik that the Messenger of Allah (may peace be upon him) would not come (back) to his family by night. He would come to them in the morning or in the evening. Another version of the tradition narrated on the some authority is a little differently worded. It says: (He) would not enter (upon his household at night).