National University of Computer & Emerging Sciences, Karachi.
FAST School of Computing,
Machine Learning QUIZ # 2
Question 1.
a.
Defining a loss function. Also, residual error, define different loss functions discussed in the class.
b. Formulate an optimization problem:
to find the model parameters such that a loss function is minimized.
Question. 2
a. Formulate the polynomial regression model for the single feature regression problem.
b. What’s happening with the increase in M. How do we handle overfitting in such a case?
Question. 3
a. Why do we use regularization? Explain L2, and L1 regularization with Examples.
b. Explain how does the gradient decent works in Linear Regression?
c. How does the learning rate affect the performance of a Gradient Descent algorithm?