Lol you're misunderstanding the difference between free speech and causing harm.
Attempting(and in many cases succeeding) to prevent a person from maintaining or acquiring gainful employment because they said something you don't like, is injurious, it is not a function of free speech. You are stifling free speech by doing this, not exercising it.
What you're supporting is called McCarthyism. The infuriating thing about this is that everyone who supports it now reads about McCarthyism and they agree that it's bad. They just think they're so much smarter, it's not like all the thousands of times this has been done in history, THIS TIME we know whose lives should be ruined based on what they said. Give yer head a shake
comparing "that guy is a communist" to "that guy who screamed the N word in an old lady's face deserves to keep his job" is honestly pretty funny. and it really misses the point tbh. lets alter the comparison.
-Joe works at a gas station
-Joe has a viral video where he screams the N word in an elderly black lady's face
-Patrons boycott the gas station until Joe is fired
-Joe's employer fires him
so the people who decided maybe another gas station that doesnt employ Joe is a better place to take their business are in the wrong? they must just continue to get gas at his station or they're infringing his free speech?
in reality people who understand how a society of social creatures such as humans works realize that when you say something publicly you open the door to people treating you differently after. As an enlightened society we strive to make that different treatment non-violent. We even try to keep the treatment directed at the person who spoke, and not those associated or related to them, but that's typically the first breaking point for extremists who are entirely anti free speech.
being realistic on free speech means defending the legal right of someone akin to Alex Jones to say what he thinks, but also defending society's non-legal and rather social reaction to that speech.