1 今天，看了一下avstar的論文。。沒有發(fā)現(xiàn)使用foot constraints的方法。。真是崩潰。。
2 上午上課，矩陣分析與應(yīng)用。。。。很扯的一節(jié)課。。整理了一下課堂講義。。等有時間一起發(fā)出來吧。。
3 晚上聽了一個Convex Optimization的Stanford Course。。。恩，收獲還是挺大的。。。
4 下午去辦牡丹卡。。
5 看了一下PCA。。沒搞的太明白。。。明天繼續(xù)。。
明日：
1 論文
2 PCA
3 把課程的講義整理一下。。不能白看啊。。
整理的筆記：
\documentclass[11pt]{article}
\usepackage{ctex}
\usepackage{graphicx}
\usepackage{float}
\DeclareGraphicsRule{.jpg}{eps}{.bb}{}
\DeclareGraphicsRule{.png}{eps}{.bb}{}
\begin{document}
\title{Matrix Analysis and Application}
\author{Sosi}
\maketitle
\section{Jacobian and Hessian Matrix}
\begin{enumerate}
\item Jacobian Matrix\\
the Jacobian matrix is the matrix of all first-order partial derivatives
of a vector or scalar-value function with respect to another vector. Suppose
$F:R^n \rightarrow R^m $is a function from Euclidean n-space to Euclidean m-space.Such a function is given by $m$ real-value component function,$y_1(x_1,...,x_n),...,y_m(x_1,...,x_n)$.The partial derivatives of
all these functions (if they exit) can be organized in a $m-by-n$matrix,the Jacobian matrix $J$ of $F$,as follows:
\begin{displaymath}
\mathbf{X} =
\left( \begin{array}{ccc}
x_{11} & x_{12} & \ldots \\
x_{21} & x_{22} & \dots \\
\vdots & \vdots & \ddots
\end{array} \right)
\end{displaymath}
\begin{displaymath}
\mathbf{J} =
\left( \begin{array}{ccc}
\frac{ \partial y_1}{ \partial x_1}
& \ldots &
\frac{{\partial}y_1}{{\partial} x_n} \\ %求導(dǎo)使用的是\prime 偏導(dǎo)使用的是\partial
\vdots & \ddots &\vdots\\
\frac{ {\partial} y_m}{ {\partial} x_1}
& \ldots &
\frac{ {\partial} y_m}{ {\partial} x_n}
\end{array}
\right)
\end{displaymath}
\item Hessian Matrix\\
in mathematics, the Hessian matrix is the square matrix of second-order
partial derivatives of a function; that is, it describes the local curvatrue of a function of many variables.The Hessian matrix was developed in the 19th century by the German mathematician Hesse and later named after him.
\begin{displaymath}
\mathbf{H(f)} =
\left( \begin{array}{cccc}
\frac{ \partial ^2 f}{ \partial x_1^2}
&
\frac{ \partial ^2 f}{ \partial x_1 \partial x_2}
& \ldots &
\frac{{\partial}^2 f}{{\partial}x_1 {\partial}x_n} \\ %求導(dǎo)使用的是\prime 偏導(dǎo)使用的是\partial
\frac{ \partial ^2 f}{ \partial x_2{\partial}x_1}
&
\frac{ \partial ^2 f}{ \partial x_2^2 }
& \ldots &
\frac{{\partial}^2 f}{{\partial}x_2 {\partial}x_n} \\
\vdots &\vdots\ \ddots &\vdots\\
\frac{ \partial ^2 f}{ \partial x_n{\partial}x_1}
&
\frac{ \partial ^2 f}{ \partial x_n \partial x_2}
& \ldots &
\frac{{\partial}^2 f}{{\partial}x_n^2} \\
\end{array}
\right)
\end{displaymath}
Hessian matrices are used in large-scale optimization problems with Newton-type methods because they are the coefficient of the quadratic term of a local Taylor expansion of a function.That is
\begin{displaymath}
y=f(x+\Delta x)\approx f(x)+J(x)\Delta x +\frac{1}{2}\Delta x^TH(x)\Delta x
\end{displaymath}
\end{enumerate}
\section{對稱矩陣性質(zhì)}
一種對稱矩陣的定義方法：
\begin{displaymath}
Ax=\bigtriangledown f(x) \\f(x)=\frac{x^TAx}{2}
\end{displaymath}
\section{證明}
有限維線性空間任意兩個極大無關(guān)組所含向量個數(shù)相同\\
證明：
$ (x_1,...,x_n)=(y_1,...,y_m)A $\\
$(y_1,...,y_m)=(x_1,...,x_n)B$\\
$(y_1,...,y_m)= (y_1,...,y_m)AB$\\
$AB=E_n$\\
$BA=E_m$\\
$tract(AB)=trace(BA)$\\
$m=n$\\
\section{性質(zhì)}
過渡矩陣非奇異\\
A為奇異矩陣的定義是：存在非零n維向量使得$Ax=0$
\end{document}