Errors in ML (bias-variance tradeoff)

• Total Error=Bias Error+Variance Error+Irreducible Error

• Low complexity ⇒ bias error, underfitting

• High complexity ⇒ variance error, overfitting

• Irreducible error ⇒ due to not wide enough sampling, noise in measurements, errors in data collection process