Other notes on KNNs can be found in ML for Trading section

KNN Preference Bias

Bias due to algorithm

• Locality - near points are assumed to be similar
• Smoothness - averaging is performed, and since averaging happens on neighbors, the function is expected to behave smoothly
• All features matter equally

Curse of Dimensionality

As the number of features or dimensions grows, the amount of data we need to generalize accurately grows exponentially.