close
Warning:
Can't synchronize with repository "(default)" (/var/svn/tolp does not appear to be a Subversion repository.). Look in the Trac log for more information.
- Timestamp:
-
Dec 24, 2010, 3:23:01 PM (14 years ago)
- Author:
-
Víctor de Buen Remiro
- Comment:
-
--
Legend:
- Unmodified
- Added
- Removed
- Modified
-
v1
|
v2
|
|
20 | 20 | of the likelihood (except an additive constant), its gradient and its hessian, |
21 | 21 | and an optional set of constraining inequations, in order to define the feasible |
22 | | region. Each inequation can be linear or not and the gradient and hessian must |
| 22 | region. Each inequation can be linear or not and the gradient must |
23 | 23 | be also calculated. Note that this implies that priors should be continuous and |
24 | | two times differentiable but this an admisible restricion in almost all cases. |
| 24 | two times differentiable and restrictions must be continuous and differerentiable, |
| 25 | but this an admisible restricion in almost all cases. |
| 26 | |
| 27 | == Chained priors == |
| 28 | |
| 29 | A prior can depend on a set of parameters that can be defined as constant |
| 30 | values or another subset of the model variables. For example we can define |
| 31 | hierarquical structures among the variables using a latent variable that is |
| 32 | the average of a normal prior for a subset of variables. We also can consider |
| 33 | that the varianze of these normal prior is another variable and to define |
| 34 | an inverse chi-square prior over this one. |
25 | 35 | |
26 | 36 | == Non informative priors == |
… |
… |
|
46 | 56 | |
47 | 57 | === Polytope prior === |
48 | | A polytope is defined by a system of arbitrary linear inequalities |
| 58 | A polytope is defined by a system of arbitrary linear inequalities [[BR]] |
49 | 59 | |
50 | 60 | [[LatexEquation( A\beta\leq a\wedge A\in\mathbb{R}^{r\times n}\wedge a\in\mathbb{R}^{r} )]] |
| 61 | |
| 62 | We can define this type of prior bye means of a set of [[LatexEquation( r )]] |
| 63 | inequations due NonLinGloOpt doesn't have any special behaviour for linear |
| 64 | inequations, and it could be an inefficient implementation. |
| 65 | |
| 66 | However we can define just one non linear inequation that is equivalent to the |
| 67 | full set of linear inequations. If we define |
| 68 | |
| 69 | [[LatexEquation( d\left(\beta\right)=A\beta-a=\left(d_{k}\left(\beta\right)\right)_{k=1\ldots r} )]] |
| 70 | |
| 71 | then |
| 72 | |
| 73 | [[LatexEquation( D_{k}\left(\beta\right)=\begin{cases} 0 & \forall d_{k}\left(\beta\right)\leq0\\ d_{k}\left(\beta\right) & \forall d_{k}\left(\beta\right)>0\end{cases} )]] |
| 74 | |
| 75 | is a continuous function in [[LatexEquation( \mathbb{R}^{n} )]] and |
| 76 | |
| 77 | [[LatexEquation( D_{k}^{3}\left(\beta\right)=\begin{cases} 0 & \forall d_{k}\left(\beta\right)\leq0\\ d_{k}^{3}\left(\beta\right) & \forall d_{k}\left(\beta\right)>0\end{cases} )]] |
| 78 | |
| 79 | is a continuous and differentiable in [[LatexEquation( \mathbb{R}^{n} )]] |
| 80 | |
| 81 | [[LatexEquation( \frac{\partial D_{k}^{3}\left(\beta\right)}{\partial\beta_{i}}=\begin{cases} 0 & \forall d_{k}\left(\beta\right)\leq0\\ 3d_{k}^{2}\left(\beta\right)A_{ki} & \forall d_{k}\left(\beta\right)>0\end{cases} )]] |
| 82 | |
| 83 | The feasibility condition can then be defined as a single continuous nonlinear |
| 84 | inequality and twice differentiable everywhere |
| 85 | |
| 86 | [[LatexEquation( g\left(\beta\right)=\underset{k=1}{\overset{r}{\sum}}D_{k}^{3}\left(\beta\right)\leq0 )]] |
| 87 | |
| 88 | The gradient of this function is |
| 89 | |
| 90 | [[LatexEquation( \frac{\partial g\left(\beta\right)}{\partial\beta_{i}}=3\underset{k=1}{\overset{r}{\sum}}D_{k}^{2}\left(\beta\right)A_{ki} )]] |
| 91 | |
| 92 | |
| 93 | == Multinormal prior == |
| 94 | |
| 95 | == Scalar bounded normal prior == |
| 96 | |
| 97 | == Inverse chi-square prior == |
| 98 | |
| 99 | |