Which of these would be a good algorithm or technique for doing this classification into things like people, places, and drugs.

And, just to give this another name, this is also called multivariate linear regression.

And that's called the support vector machine, and compared to both the logistic regression and neural networks, the

I just drew in magenta. The curve that I just drew purple and magenta.

Armed with these definitions, we are now ready to build the support vector machine.

In the next video we'll start working out the details of the logistic regression algorithm.

Except that we don't sum over the terms corresponding to these bias values

And it will compute the test error as follows.

How about if we were doing a classification problem and say using logistic regression instead.

And the term logistic function, that's what give rise to the name logistic progression.

And so this builds in an extra safety factor or safety margin factor into the support vector machine.

My cost function, j of theta is now going to be the following is minus one over m of a sum of a similar term to what we have in logistic regression.

I've drawn the blue box around.

So here's a quick quiz for you.

The cost function we use for the neural network is going to be a generalization of the one that we use for logistic regression.

For logistic regression, we used to minimize the cost function j of theta that was minus 1 over m of this cost function and then plus this extra regularization term here, where this was a sum from j equals 1 through n, because we did not regularize the bias term theta zero.

logistic regression and we're seeing what the mathematical formula is defining the hypothesis for logistic regression.

First, we're going to get rid of the 1 over m terms and this just, this just happens to be a slightly different convention that people use for support vector machines compared to for logistic regression.

We already have linear regression and we have logistic regression, so why do we need, you know, neural networks?

If you want to apply logistic regression to this problem, one thing you could do is apply

Let F of XP, or linear function, and the output of logistic regression is obtained by the following function

That's the term that a single training example contributes to the overall objective function for logistic regression.

Consider a supervised learning classification problem where you have a training set like this.

less than 0 because that corresponds to hypothesis of outputting a value close to 0.

Machine and where you minimize that function then what you have is the parameters

But that's just the name it was given for historical reasons so don't be confused by that.

All of these methods take corners and reduce the various variants like rotational variants by extracting statistics that are invariant to things like rotation and scale and certain perspective transformation.

It gets even easier if we want to look at the standardized regression coefficient.

The second bit of notational change, we're just designating the most standard convention, when using as the SVM, instead of logistic regression as a following.

Or another way of writing it, it's change in y over change in x.

And finally, the second term here is the regularization term similar to what we had for logistic regression.

Change volume

That's a lot of blood.

And in order to explain some of the math, I'm going to use z to denote failure of transpose x here.

Tropic of Cancer

Tropic of Capricorn

KHTML Regression Testing Utility

So its slope is just delta I'm still using the line tool again delta y over delta x.

So let's figure out the slope of this line.

And today, I'd like to introduce you to multiple regression.

Mass Conversions

And I would argue this is a clear linear regression case, you have two variables, so this is what you're going to do.

So the slope of my secant

That is your change in y.

It doesn't matter that much but that's the new cost function we're going to use where y is equal to 1 and you can imagine you should do something pretty similar to logistic regression but it turns out that this will give the support vector machine computational advantage that will give us later on an easier optimization problem, that will be easier for stock trades and so on.