On the optimality of Naive Bayes with dependent binary features
Summary:
While Naïve Bayes classifier (NB) is Bayes-optimal for independent features,
we prove that it is also optimal for two equiprobable classes
and two features with equal class-conditional covariances.
Although strict optimality does not extend for three features,
equal covariances are expected to be beneficial in higher-dimensional spaces.