Should spreading rumors be punishable by law?

Sometimes they and their consequences can balloon far beyond,"a little harmless gossip". In small towns they sometimes make people have to move away, whether they're true or not. For those reasons they go far beyond Freedom of Speech, which I'm sure some will invoke to defend the practice. What do you think?
Thank you; you know, I had forgotten about these. Dopey me.