The power parameter p controls which distance metric is used in determining neighbors of a point. The default is p=2, which specifies Euclidean distance. Setting p=1 specifies Manhattan distance (aka city block distance), which calculates distance along a grid-like path. Manhattan distance is preferred for high-dimensional data.

"p" Parameter for KNN Classifier

The weights parameter can be set to 'uniform' or to 'distance'. Setting weights='uniform' means that the k nearest neighbors of a point have equal influence on how that point gets classified. On the other hand, weights='distance' causes closer neighbors to have greater influence.

"weights" Parameter for KNN Classifier

The n_neighbors parameter specifies the number of neighbors to consider when classifying points. This number is sometimes referred to as "K". A high n_neighbors risks overfitting the test data and being poor at predicting new data (high bias). On the other hand, a low n_neighbors risks underfitting the data, hence oversimplifying the model and resulting in a "jumpy" plot of predictions (high variance). The best value for K will depend on the dataset, so one value for K may work well for some datasets, but not for others.

"n_neighbors" Parameter for KNN Classifier

University of Michigan - Ann Arbor

Scikit-learn enables the creation of classifier objects. For example, 
```python
from sklearn.neighbors import KNeighborsClassifier
knn = KNeighborsClassifier(n_neighbors = 5, weights = 'distance')
```
In this example, the classifier object (named knn) will consider 5 neighbors in its kneighbors queries.   Setting the weights parameter to 'distance' means that closer neighbors will be more influential than those farther away  (in terms of detemrining which category the "target" point belongs to).

sklearn.neighbors.KNeighborsClassifier

https://scikit-learn.org/stable/modules/generated/sklearn.neighbors.KNeighborsClassifier.html

Documentation for sklearn.neighbors.KNeighborsClassifier

- fit(X_train, y_train)
- predict(X_test)
- score(X_test, y_test)

Useful Methods for KNN Classifier

Which of the following is true for the nearest neighbor classifier?

To implement a K-Nearest Neighbors (KNN) classifier in Python using `scikit-learn`, the `KNeighborsClassifier` can be used. After splitting the dataset into training and testing sets, the model is initialized, fitted to the training data, and then used to make predictions and score its accuracy on the testing data.

```python
from sklearn.model_selection import train_test_split
from sklearn.neighbors import KNeighborsClassifier

X_train, X_test, y_train, y_test = train_test_split(X, y, random_state=0)
knnc = KNeighborsClassifier(n_neighbors=5).fit(X_train, y_train)
knnc.predict(X_test)
knnc.score(X_test, y_test)
```

Learn Before

Related

Learn After