In the last video, along with the ideas of

vector addition and scalar multiplication, I described vector coordinates, where’s this back and forth between, for example,

pairs of numbers and two-dimensional vectors. Now, I imagine that vector coordinates were

already familiar to a lot of you, but there’s another kind of interesting way

to think about these coordinates, which is pretty central to linear algebra. When you have a pair of numbers that’s meant

to describe a vector, like [3, -2], I want you to think about each coordinate

as a scalar, meaning, think about how each one stretches

or squishes vectors, In the xy-coordinate system, there are two

very special vectors: the one pointing to the right with length

1, commonly called “i-hat”, or the unit vector in the x-direction, and the one pointing straight up, with length

1, commonly called “j-hat”, or the unit vector in the y-direction. Now, think of the x-coordinate of our vector

as a scalar that scales i-hat, stretching it by a factor of 3, and the y-coordinate as a scalar that scales

j-hat, flipping it and stretching it by a factor of 2. In this sense, the vectors that these coordinates

describe is the sum of two scaled vectors. That’s a surprisingly important concept, this

idea of adding together two scaled vectors. Those two vectors, i-hat and j-hat, have a

special name, by the way. Together, they’re called the basis of a coordinate

system What this means, basically, is that when you

think about coordinates as scalars, the basis vectors are what those scalars actually,

you know, scale. There’s also a more technical definition,

but I’ll get to that later. By framing our coordinate system in terms

of these two special basis vectors, it raises a pretty interesting, and subtle,

point: We could’ve chosen different basis vectors,

and gotten a completely reasonable, new coordinate system. For example, take some vector pointing up

and to the right, along with some other vector pointing down and to the

right, in some way. Take a moment to think about all the different

vectors that you can get by choosing two scalars, using each one to scale one of the vectors,

then adding together what you get. Which two-dimensional vectors can you reach

by altering the choices of scalars? The answer is that you can reach every possible

two-dimensional vector, and I think it’s a good puzzle to contemplate

why. A new pair of basis vectors like this still

gives us a valid way to go back and forth between pairs of numbers and two-dimensional vectors, but the association is definitely different

from the one that you get using the more standard basis of i-hat and

j-hat. This is something I’ll go into much more detail

on later, describing the exact relationship between different coordinate systems, but for right

now, I just want you to appreciate the fact that any time we describe vectors numerically,

it depends on an implicit choice of what basis vectors we’re using. So any time that you’re scaling two vectors

and adding them like this, it’s called a linear combination of those

two vectors. Where does this word “linear” come from? Why does this have anything to do with lines? Well, this isn’t the etymology, but one way

I like to think about it is that if you fix one of those scalars, and let the

other one change its value freely, the tip of the resulting vector draws a straight

line. Now, if you let both scalars range freely,

and consider every possible vector that you can get, there are two things that can happen: For most pairs of vectors, you’ll be able

to reach every possible point in the plane; every two-dimensional vector is within your

grasp. However, in the unlucky case where your two

original vectors happen to line up, the tip of the resulting vector is limited

to just this single line passing through the origin. Actually, technically there’s a third possibility

too: both your vectors could be zero, in which

case you’d just be stuck at the origin. Here’s some more terminology: The set of all possible vectors that you can

reach with a linear combination of a given pair of vectors is called the span of those two vectors. So, restating what we just saw in this lingo, the span of most pairs of 2-D vectors is all

vectors of 2-D space, but when they line up, their span is all vectors

whose tip sits on a certain line. Remember how I said that linear algebra revolves

around vector addition and scalar multiplication? Well, the span of two vectors is basically

a way of asking, “What are all the possible vectors you can

reach using only these two fundamental operations, vector addition and scalar multiplication?” This is a good time to talk about how people

commonly think about vectors as points. It gets really crowded to think about a whole

collection of vectors sitting on a line, and more crowded still to think about all

two-dimensional vectors all at once, filling up the plane. So when dealing with collections of vectors

like this, it’s common to represent each one with just

a point in space. The point at the tip of that vector, where,

as usual, I want you thinking about that vector with its tail on the origin. That way, if you want to think about every

possible vector whose tip sits on a certain line, just think about the line itself. Likewise, to think about all possible two-dimensional

vectors all at once, conceptualize each one as the point where

its tip sits. So, in effect, what you’ll be thinking about

is the infinite, flat sheet of two-dimensional space itself, leaving the arrows out of it. In general, if you’re thinking about a vector

on its own, think of it as an arrow, and if you’re dealing with a collection of

vectors, it’s convenient to think of them all as points. So, for our span example, the span of most

pairs of vectors ends up being the entire infinite sheet of two-dimensional

space, but if they line up, their span is just a

line. The idea of span gets a lot more interesting

if we start thinking about vectors in three-dimensional space. For example, if you take two vectors, in 3-D

space, that are not pointing in the same direction, what does it mean to take their span? Well, their span is the collection of all

possible linear combinations of those two vectors, meaning all possible vectors you get by scaling each

of the two of them in some way, and then adding them together. You can kind of imagine turning two different

knobs to change the two scalars defining the linear combination, adding the scaled vectors and following the

tip of the resulting vector. That tip will trace out some kind of flat

sheet, cutting through the origin of three-dimensional space. This flat sheet is the span of the two vectors, or more precisely, the set of all possible

vectors whose tips sit on that flat sheet is the span of your two vectors. Isn’t that a beautiful mental image? So what happens if we add a third vector and

consider the span of all three of those guys? A linear combination of three vectors is defined

pretty much the same way as it is for two; you’ll choose three different scalars, scale

each of those vectors, and then add them all together. And again, the span of these vectors is the

set of all possible linear combinations. Two different things could happen here: If your third vector happens to be sitting

on the span of the first two, then the span doesn’t change; you’re sort

of trapped on that same flat sheet. In other words, adding a scaled version of

that third vector to the linear combination doesn’t really give you access to any new

vectors. But if you just randomly choose a third vector,

it’s almost certainly not sitting on the span of those first two. Then, since it’s pointing in a separate direction, it unlocks access to every possible three-dimensional

vector. One way I like to think about this is that

as you scale that new third vector, it moves around that span sheet of the first

two, sweeping it through all of space. Another way to think about it is that you’re

making full use of the three, freely-changing scalars that you have at your disposal to access the full

three dimensions of space. Now, in the case where the third vector was

already sitting on the span of the first two, or the case where two vectors happen to line

up, we want some terminology to describe the fact

that at least one of these vectors is redundant—not adding anything to our

span. Whenever this happens, where you have multiple

vectors and you could remove one without reducing the span, the relevant terminology is to say that they

are “linearly dependent”. Another way of phrasing that would be to say

that one of the vectors can be expressed as a linear combination of the others since it’s

already in the span of the others. On the other hand, if each vector really does

add another dimension to the span, they’re said to be “linearly independent”. So with all of that terminology, and hopefully

with some good mental images to go with it, let me leave you with puzzle before we go. The technical definition of a basis of a space

is a set of linearly independent vectors that span that space. Now, given how I described a basis earlier, and given your current understanding of the

words “span” and “linearly independent”, think about why this definition would make

sense. In the next video, I’ll get into matrices

and transforming space. See you then!

Oh shiiiit that's why the convention in programming is using I++ and j++!?

What is the program that he is using to represent the vectors ?

thank you

Good graphics and I can understand the concepts

thanks a lot

Rewatched this a 2nd time. Now it's finally clicking. Thx for this =)

Wonderful visualization!

Which application are your using to create those visualization?

Take a vow Grant….

You're a modern day hero. Thanks Grant!

Do something for tensors. These videos are great but I think vectors are quite intuitive for most people. Tensors are harder to explain.

What is the software you are using to generate the graphs? Is it affordable for an individual?

Kindly can u add subtitles for the video.. please

You sir, are awesome.

Thank you

all this time… this is the best way someone has ever described a linear combination

Thank you so much for making such a wonderful video.

Took two semesters of linear algebra and honestly passed those classes by just memorizing the patterns in how to solve the problems. Never actually gleamed any knowledge on any of it which is a shame. Thanks for these vids.

i just want to say thank you!!!!!!! finally got it!!!!!!!

Only you make me realize how beautiful math can be. Please make a video on Complex number too. 😀

There's no basic z-vector called k-hat?

what is vector space in the quiz, you did not define it?

@ 9:33 Quiz

The definition of a basis sort of obviously makes sense because if a set S of vectors spans the space then every point in the space corresponds to some linear combination of the vectors in S. So in that sense S is a "basis" for the space. Then, if the S isn't linearly independent, some of its vectors are linear combinations of others. When these are eliminated, this reduced set will also span that space. It seems desirable that a "basis" not have redundant vectors. And, a linearly independent set that spans a space has no redundant vectors

I think the definition holds true as basis are defined as î and j cap are unit vectors(basis) , So in 2d we can think of it is as one unit vector pointing in x direction whereas j pointing out in the y direction and therefore every scaled up vector would be on top of î covering the x axis and therefore that space and the j cap would do the same for y axis and therefore covering the 2 spaces i.e SPAN.

Great video. Clarifies lots of questions in my mind after 34 years 😁

incredibly crystal clear explanation 🙏🏽

You're brilliant!

The definition of basis you gave us at the start of the video says shortly: a basis is a vector that is scaled by a number… then you sum up the vectors you scaled, i and j, (by doing this two things you do a linear combination) obtaining the first vector you introduced in the video.

Since that vector could be any other vector (it's arbitrarious) in the 2d space, i and j, which are a set, are linearly independent.

So i and j generate a span (which contains all the vectors described by the linear combination of i and j), and since we are in two dimensions , that span is the full space.

So it's right to say that a basis is a set of linearly independent vectors that span the full space.

*short answer*: a span comes out from a linear combination (of indip. vect.), since what you do at the start of the video, to describe a basis, is a linear combination of i and j ( which are indip.), it's right to say that a basis is a set of lin. indip. vectors that span the full space.

…What you say in the end is nothing less than the formal definition of the procedure you do at the start.

Pls reply to me i want to know other thoughts, i know its been two years… but please reply… i spent a lot thinking about it…

also sorry for my english

Things i wrote before coming up with what i think a good answer .-.

Ok so, let's say we are in two dimensions, two linear independent vectors (that belong to that 2D space) span that full space(if linearly combined); that span is the set of all the other vectors that can be "reached" by linearly combining the two vectors generating the span; all those vectors are called linearly dependent by those two vectors. Now if we take any other vector which belongs to the 2D space, this vector is linearly dependent by the other two (by what i said earlier). We can think the third vector in terms of the linear combination of the first two (a linear combination is basically an addition of 2 vectors (in this case) each

scaledby an arbitrary number).You should make Udemy courses!

DDDDUUUUUUDDDDEEEEE this is too good, you have explained all of the things I had a hard time understanding in Linear Algebra at my university in all of 20 minutes. I love your videos but these linear algebra videos are frickin' gold.

Beautiful

It is very sad when we get some book that does not explain the reasons of each word used but simply throw you a set of math rules.

brilliant

So in the 3D case with 3 vectors where they do not line up..The span will be infinitely many sheets that are in 3D space stacked one after another?

Oh it gives me a hint why in programming, variable i is always used for iterating through lists, and when it is a matrix, it uses i for the x and j for the y. hmmm

Why the span area for 3d vectors is represented crossly why can't it be straight rectangle ?

yes technically that definition make sense becoz the base or surface or space of any sheet is just the combination of dots (vector or arrow ) which the independent of each other like a infinite sheet distributed with infinite number of electron having some approx. space between them but independent to eachother

Very good explanation along with its visualization. may I know what software you were using?

Soy de Colombia y a pesar de que no hablo ingles, encontre el mejor canal de tofo youtube 🙂 I Love you

The flat sheet is Euclid fifth postulate. The linear dependent is Euclid 2nd post.

Thanks!

Hey can anyone plz explain the answer of the very last question asked in the video(that why the two definitions are equal)?

Wow. You explanation of spam is the best I've ever heard.

MY MIND IS BLOWN! ❤️

did any one have a notes i want to take notes for definition and other things but i cant

You have been very helpful in my learning. Your pace and explanation for things being done seem to increase my own thinking abilities. I can memorize very complex things and get the "right" answers. But this approach is far more useful long term. Creative thinking comes in for many. Thank you so much 3b1b!

At least better than my 70 year old algebra teacher

Using this line of reasoning that u've stated in the initial 3 mins of the video, any vector in 2d space is a linear combination of the basic vectors{I hat & J hat}.Is that correct?

10 minutes of watching a video and two months of linear algebra class material just clicked. Beautiful!!!!

legend

In the video, you pointed out that the span of two 3-d vectors is a sheet (plane); but I am wondering if it is possible for the two 3-d vectors to trace out the whole 3-d space?

You deserve a noble prize for your such a contribution.

Thanks I understand better visually.

I pray that you overcome every difficulty of life the way we have overcome our difficulties watching the video.

Ok I’m late as hell but I’m going to say it, I came here for a basic understanding and that was supposed to be it, but now I have watched all the videos in the series and I understand it way more and way easier then school teaches it. Bravo you are a god sent

All along video I was going "oooohhh" & "aaahhh" all around. This video gives a brilliant explanation and illustration of the terms used in linear algebra! During my college years, I've never thought that any of this could be explained in a very elegant and easy to understand way. Well done mate.

Thanks so much for this video!

Thanks alot.

You made the most clear definition of this. You could easily repalce Khan acedamy

Today students are SO LUCKY!

the best explanation ever !!

I don't really know how to feel about these childlike animations, they seem too kiddy for me

Wow span well explained took 4 years until I watch this vid to understand the span….

Is it necessary for basis vectors to be orthonormal ? Also in 6:42 couldn't you decompose the two vectors in 3 orthogonal axis so their span would be the 3D space ?

Wow, awesome videos. Clearly introduced linear algebra!

good video

Why use I-hat and J-hat when you have X and Y?

Do a series of videos on group theory or graph theory. Hehe.

You've turned my once dislike for math into a love of the abstract concepts and visuals behind it. Thank you for allowing me to discover an interest I used to think I never had

great work!!!!! using numbers will clarify he concepts even more…..

excellent video with many visual diagrams!!!!!!!

thanks you, because of this i can have a deeper understanding.

I wonder how people understood essence of calculus and linear algebra when there were no animations…

Excellent! Thanks very much!

You are the fucking best!!!

I learned more about the geometrical interpretation of basic concepts in linear algebra from this 10 minute video than I did from an entire course at a public university. That is a marvelous achievement on your part. Hats off.

Dear Sir,

Are these Videos are beneficial for Machine learning as well ???

Could you do a video on covectors? And maybe tensors?

Definition: The basis of vector space is a set of linearly independent vectors that span the full space.

The definition makes sense because i represents a unit vector on x-axis and j represent a unit vector on the y-axis. Now they will always be linearly independent(because both i and j are in different directions, they will never coincide each other). When we do a linear combination and scale the two vectors(i and j) we can reach any point in the plane(including origin). For more understanding, draw an XY plane up to 4 pt on the x-axis and 4 pt on the y-axis. Now fix a=1 and increase b from 0 to 0,1,2,3 and 4. Make dots on all the points you get after doing linear combinations. Similarly, fix a=2 and increase b and do the same. Do this for all a and all b. You will find that there is a dot at every point i.e. filling up the whole space.

P.S. In order to fill the whole space we also have to take decimal scalers but that will make our plane complex.

I had multiple lin alg and quantum mechanics courses at university. But this is the first time I actually, fully understood the concepts. You are my hero and your videos are so much more valuable than any lecture I've had! Which is somehow really nice and really sad at the same time. 😅

This is all weirdly erotic

To answer the question on 9:50, if there was a solution to av + bw +cu = 0 that was not a = b = c = 0, it would mean that there was a linear combination of the three vectors such that the vector addition returned to the origin (0,0). This would have to mean one of the vectors are linearly dependent on another vector. So all the vectors have to be linearly independent by having a unique solution at a = b = c = 0.

Hopefully that made some sense.

Brilliant Videos. Very good for imagination/ Thank you so much!!

spam

Огромное спасибо за проделанную работу, за великолепные объяснения и визуализации!

Thank you so much for the work done, for the excellent explanations and visualizations!

翻譯品質極其低落

Linearly Dependent 8:30

I understand the concept of basis vectors i-hat, j-hat, k-hat. Can someone please explain why he then used the basis vector notation v, w, u?

Are they not the same thing?

Gimbal Lock. Because linear dependency. Nice video!!!

You are awesome bro…🙏

i learned its called linear algebra because you are using vector addition, you are linearly combining two vectors multiplied by x or y to get the b vector when you do the linear combination from equations

I wasn't able to understand span of 3d vectors (taken two)

Somebody help

Ok !thanhks

I count myself as one of the luckiest people to have stumbled on this video just before taking linear algebra in college

Understanding LA without visulisation is very difficult. Thank you for putting the efforts to make these videos. You are doing a great job.

can i know the book you are using or research paper of yours

i will definetly buy all of thosse

please help to understand 9:51 onwards that script

WHY THE HELL ARE WE NOT TAUGHT LIKE THIS!

Why is the span in 3d just a flat plane? 🙁

I thought it would be more of a sphere

My dear! A lot of efforts behind this explanation & visuals. Thanks very much 🙏🙏🙏. As if vectors and scalars in a cartoon movie.

excellent explained using with outstanding graphics