Linear System Of Equations Website Links For
System 		 

Information About

Linear System Of Equations
  CATEGORIES ABOUT SYSTEM OF LINEAR EQUATIONS
   
algebra
   
equations
   
linear algebra
   
APPAREL
BABY
BEAUTY
BOOKS
CAR TOYS
CELL PHONES
DVD'S
ELECTRONICS
GOURMET FOOD
GROCERIES
HEALTH & PERSONAL
HOME & GARDEN
JEWELRY
MUSIC
MUSIC INSTRUMENTS
OFFICE PRODUCTS
SOFTWARE
SPORTING GOODS
TOOLS & HARDWARE
TOYS
VIDEO GAMES
SHOPPING HOME
MORE SHOPPING...



: 3''x''1 + 2''x''2 − ''x''3 = 1
: 2''x''1 − 2''x''2 + 4''x''3 = −2
: −''x''1 + ½''x''2 − ''x''3 = 0.

The problem is to find those values for the unknowns ''x''1, ''x''2 and ''x''3 which satisfy all three equations simultaneously.

Systems of linear equations belong to the oldest problems in mathematics and they have many applications, such as in Digital Signal Processing , estimation, forecasting and generally in Linear Programming and in the approximation of non-linear problems in Numerical Analysis . An efficient way to solve systems of linear equations is given by the Gauss-Jordan Elimination or by the Cholesky Decomposition .

In general, a system with ''m'' linear equations and ''n'' unknowns can be written as
: ''a''11''x''1 + ''a''12''x''2 + … + ''a''1''n''''x''''n'' = ''b''1
: ''a''21''x''1 + ''a''22''x''2 + … + ''a''2''n''''x''''n'' = ''b''2
:     :
:     :
: ''a''''m''1''x''1 + ''a''''m''2''x''2 + … + ''a''''mn''''x''''n'' = ''b''''m'',

where ''x''1, ... ,''x''''n'' are the unknowns and the numbers ''a''''ij'' are the coefficients of the system. We can separate the coefficients in a matrix as follows:
:
\begin{bmatrix}
a_{11} & a_{12} & \cdots & a_{1n} \
a_{21} & a_{22} & \cdots & a_{2n} \
dots & dots & \ddots & dots \
a_{m1} & a_{m2} & \cdots & a_{mn} \end{bmatrix}

\begin{bmatrix}
x_1 \
x_2 \
dots \
x_n
\end{bmatrix}
=
\begin{bmatrix}
b_1 \
b_2 \
dots \
b_m
\end{bmatrix}



If we represent each matrix by a single letter, this becomes
: ''A''x = b,
where ''A'' is an ''m''-by-''n'' Matrix above, x is a column vector with ''n'' entries and '''b''' is a column vector with ''m'' entries. The above mentioned Gauss-Jordan elimination applies to all these systems, even if the coefficients come from an arbitrary Field .

If the field is Infinite (as in the case of the Real or Complex Number s), then only the following three cases are possible for any given system of linear equations:
  • the system has no solution (in this case, we say that the system is overdetermined)

  • the system has a single solution (the system is exactly determined)

  • the system has infinitely many solutions (the system is underdetermined).


A system of the form
: ''A''x = 0
is called a ''homogeneous'' system of linear equations. The set of all solutions of such a homogeneous system is called the Null Space of the matrix A and is written as ''Nul A''.

Especially in view of the above applications, several more efficient alternatives to Gauss-Jordan Elimination have been developed for a wide diversity of special cases. Many of these improved algorithms are of complexity O(''n''²) . Some of the most common special cases are:
  • For problems of the form ''A''x = b, where ''A'' is a symmetric Toeplitz Matrix , we can use Levinson Recursion or one of its derivatives. One special commonly used Levinson-like derivative is Schur Recursion , which is used in many Digital Signal Processing applications.

  • For problems of the form ''A''x = b, where ''A'' is a Singular Matrix or nearly singular, the matrix A is decomposed into the product of three matrices in a process called Singular-value Decomposition . The left and right hand matrices are left and right hand singular vectors. The middle matrix is a Diagonal Matrix and contains the singular values. The matrix can then be inverted simply by reversing the order of the three components, transposing the singular vector matrices, and taking the reciprocal of the diagonal elements of the middle matrix. If any of the singular values is too close to zero and therefore close to being singular, they are set to zero.

    • EXTERNAL LINKS