Skip to main content

Vectors and Their Operations

Vectors are one of the foundational concepts in linear algebra. They represent quantities that have both magnitude and direction, making them essential in various fields such as physics, engineering, computer graphics, and data science. This article explores the key properties of vectors and the fundamental operations that can be performed on them.

1. What is a Vector?​

A vector is an ordered list of numbers that represents a point in space, a direction, or a quantity with both magnitude and direction. Vectors can exist in any dimension, but they are most commonly encountered in two-dimensional (2D) or three-dimensional (3D) space.

1.1 Notation​

A vector is typically denoted by a bold lowercase letter, such as v, or as a list of components in parentheses or square brackets:

  • v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n) for an nn-dimensional vector.

1.2 Visual Representation​

In 2D, a vector can be visualized as an arrow pointing from the origin (0,0)(0,0) to the point (v1,v2)(v_1, v_2). The length of the arrow represents the magnitude of the vector, and the direction of the arrow represents the direction of the vector.

2. Vector Addition​

Vector addition is the process of combining two or more vectors to produce a resultant vector. This operation follows the parallelogram rule or the triangle rule.

2.1 Geometric Interpretation​

When two vectors u\mathbf{u} and v\mathbf{v} are added, the resultant vector r=u+v\mathbf{r} = \mathbf{u} + \mathbf{v} can be visualized as the diagonal of the parallelogram formed by u\mathbf{u} and v\mathbf{v}.

2.2 Component-wise Addition​

The sum of two vectors is obtained by adding their corresponding components:

  • If u=(u1,u2,…,un)\mathbf{u} = (u_1, u_2, \dots, u_n) and v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n), then r=u+v=(u1+v1,u2+v2,…,un+vn)\mathbf{r} = \mathbf{u} + \mathbf{v} = (u_1 + v_1, u_2 + v_2, \dots, u_n + v_n).

3. Scalar Multiplication​

Scalar multiplication involves multiplying a vector by a scalar (a single number). This operation scales the vector, changing its magnitude but not its direction (unless the scalar is negative, which also reverses the direction).

3.1 Geometric Interpretation​

If you multiply a vector v\mathbf{v} by a scalar cc, the resultant vector cvc\mathbf{v} has a magnitude scaled by ∣c∣|c| and points in the same direction as v\mathbf{v} if c>0c > 0, or the opposite direction if c<0c < 0.

3.2 Component-wise Multiplication​

The scalar multiplication of a vector is performed by multiplying each component of the vector by the scalar:

  • If v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n) and cc is a scalar, then cv=(c⋅v1,c⋅v2,…,c⋅vn)c\mathbf{v} = (c \cdot v_1, c \cdot v_2, \dots, c \cdot v_n).

4. Dot Product​

The dot product (also known as the scalar product) is an operation that takes two vectors and returns a scalar. It is a measure of the extent to which two vectors point in the same direction.

4.1 Geometric Interpretation​

The dot product of two vectors u\mathbf{u} and v\mathbf{v} is given by:

u⋅v=∣u∣∣v∣cos⁡(θ)\mathbf{u} \cdot \mathbf{v} = |\mathbf{u}| |\mathbf{v}| \cos(\theta)

where θ\theta is the angle between the two vectors.

4.2 Component-wise Calculation​

The dot product can also be computed by multiplying corresponding components of the vectors and summing the results:

  • If u=(u1,u2,…,un)\mathbf{u} = (u_1, u_2, \dots, u_n) and v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n), then u⋅v=u1v1+u2v2+⋯+unvn\mathbf{u} \cdot \mathbf{v} = u_1v_1 + u_2v_2 + \dots + u_nv_n.

5. Cross Product (3D Vectors)​

The cross product is an operation that takes two vectors in 3D space and returns a vector that is perpendicular to both. This operation is unique to three dimensions and is widely used in physics and engineering.

5.1 Geometric Interpretation​

The magnitude of the cross product u×v\mathbf{u} \times \mathbf{v} is given by:

∣u×v∣=∣u∣∣v∣sin⁡(θ)|\mathbf{u} \times \mathbf{v}| = |\mathbf{u}| |\mathbf{v}| \sin(\theta)

where θ\theta is the angle between the vectors u\mathbf{u} and v\mathbf{v}. The direction of the resulting vector is determined by the right-hand rule.

5.2 Component-wise Calculation​

The cross product is calculated as follows:

  • If u=(u1,u2,u3)\mathbf{u} = (u_1, u_2, u_3) and v=(v1,v2,v3)\mathbf{v} = (v_1, v_2, v_3), then:
u×v=(u2v3−u3v2,u3v1−u1v3,u1v2−u2v1)\mathbf{u} \times \mathbf{v} = (u_2v_3 - u_3v_2, u_3v_1 - u_1v_3, u_1v_2 - u_2v_1)

6. Vector Magnitude and Normalization​

The magnitude (or length) of a vector is a measure of its size, and normalization is the process of scaling a vector so that it has a magnitude of 1.

6.1 Magnitude of a Vector​

The magnitude of a vector v=(v1,v2,…,vn)\mathbf{v} = (v_1, v_2, \dots, v_n) is given by:

∣v∣=v12+v22+⋯+vn2|\mathbf{v}| = \sqrt{v_1^2 + v_2^2 + \dots + v_n^2}

6.2 Normalizing a Vector​

To normalize a vector, divide each of its components by its magnitude:

vnormalized=v∣v∣\mathbf{v}_{\text{normalized}} = \frac{\mathbf{v}}{|\mathbf{v}|}

Conclusion​

Vectors are fundamental to linear algebra and have wide-ranging applications in various fields, including physics, engineering, and computer science. Understanding vector operations such as addition, scalar multiplication, dot product, and cross product is crucial for solving problems in these domains. Mastering these concepts will provide a strong foundation for more advanced topics in linear algebra.