When a man sits in a place where he can listen (to the sermon) and look (at the imam), where he remains silent and does not interrupt, he will receive a double reward. If he stays away, sits in a place where he cannot listen (to the sermon), silent, and does not interrupt, he will receive the reward only once. If he sits in a place where he can listen (to the sermon) and look (at the imam), and he does not remain silent, he will have the burden of it. If anyone says to his companion sitting besides him to be silent (while the imam is preaching), he is guilty of idle talk. Anyone who interrupts (during the sermon) will receive nothing (no reward) on that Friday.
Then he (the narrator) says in the end of this tradition: I heard the Messenger of Allah (ﷺ) say so.
Abu Dawud said: This tradition has been narrated by al-Walid b. Muslim from Ibn Jabir. This version adds: bi'l-raba'ith (instead of al-raba'ith, needs preventing the people from prayer). Further, this adds: Freed slave of his wife Umm 'Uthman b. 'Ata.
In-book : Book 2, Hadith 662
English translation : Book 3, Hadith 1046