Your query is currently returning records where
either field is false or null, because you've used an
OR
to combine the conditions. Try:
WHERE
A.Accountid ='XXXXXXXXX'
AND
(B.CASLOptOut ='F' Or B.CASLOptOut = null)
AND
(B.CASLEXCEPTION ='F' Or B.CASLEXCEPTION = null)