You didn't provide the other table's name, nor the names of the columns, so substitute where applicable.
SELECT a.[my_date_column]
FROM dbo.[mytable] AS a
RIGHT JOIN dbo.[holiday_dates] AS b
ON CONVERT(DATE,a.[my_date_column]) <> CONVERT(DATE,b.[holiday_date]);