Can someone sue because they were called a criminal?

If you say to someone "I have the right to refuse business to criminals" over public airwaves, can it be contrieved as slander? As yes, they have been arrested and convicted of a crime before.