>But now I learned with the minimal dataset I have (<5K samples), linear regression, SVM, or decision tress is the way to go.

Decision Trees are prone to overfitting and especially susceptible for small datasets. Random Forest is a good substitute that's become standard practice.