Correct. Freedom of Speech does not imply freedom from consequence and only protects you from the government. The State can’t tell you what you’re allowed say and can’t jail you for saying them (outside of a limited band of things that have been thoroughly litigated). However, that does nothing to modify the social contract. If you say something that most people don’t like, they’re going to get you to stop saying it one way or another.