K-nearest neighbors

• KNN is used for classification and regression, and involves looking at the k-nearest neighbors
• Classification = Categorization into a group
• Regression = predicting a response (like a number)
• Featuer Extraction means converting an item into a list of numbers that can be compared
• Pick good features is important to make a successfull algorithm