less than 1 minute read

Tags: , ,

SVM

  • linear svm
  • largrange multiplier and KKT condition

說實話 真的是不知道在共殺姣 XDDD

kernel

Imgur

Popular kernels

  • Linear kernel

  • Polynomial kernel

  • Gaussian (RBF) kernel

Imgur

Summary

  • Large margin: prevent overfitting
  • Soft margin: make the margin become larger to prevent overfitting

  • Kernel trick

    • Make the data linearly separable
    • Efficiently transform the input features into high (could be infinite) dimensional space

Regularized linear regression

Imgur

Linear or Kernel ? SVM or Logistic Regression?

Imgur

SVM Concept

Imgur

Sklearn SVM SVC

sklearn SVM SVR

Summary

Imgur