13

Could anyone recommend a method for the following least-squares problem:

find $R \in \mathbb{R}^{3 \times 3}$ that minimizes: $\sum\limits_{i=0}^N (Rx_i - b_i)^2 \rightarrow \min$, where $R$ is a unitary (rotation) matrix.

I could get an approximate solution by minimizing $\sum\limits_{i=0}^N (Ax_i - b_i)^2 \rightarrow \min$ (arbitrary $A \in \mathbb{R}^{3 \times 3}$), taking matrix $A$ and:

  • computing SVD: $A = U \Sigma V^T$, dropping $\Sigma$ and approximating $R \approx U V^T$
  • computing polar decomposition: $A = U P$, dropping scale-only symmetric (and positive definite in my case) $P$ and approximating $R \approx U$

I could also use QR decomposition, but it wouldn't be isometric (would depend on the choice of the coordinate system).

Does anyone know of a way to do this, at least approximately, but with better approximation than the two methods above?

Anton Menshov
  • 8,672
  • 7
  • 38
  • 94
Sergiy Migdalskiy
  • 431
  • 2
  • 9
  • 4
    I used Kabsch's algorithm for a similar problem, which is essentially the SVD method you mentioned http://en.wikipedia.org/wiki/Kabsch_algorithm if i'm not wrong the svd method minimizes the equation, I'm not sure what you mean by a 'better' method? – isti_spl Jan 20 '14 at 20:22
  • 2
    OMG I just got the same reply IRL. Thanks! Apparently dropping $\Sigma$ works unless $det(UV^T)$ is negative, in which case the optimal rotation includes a reflection (and any rotation is equally bad).

    This technically answers the question, however, does anybody know of a cheaper method than computing SVD? It's a 3x3 SVD, but I need to do a lot of them (this is for FEM simulation, and the problem is computed for each FE)

    Also, the problem is apparently called Wahba's problem, and it apparently appears in aeronautics to determine a craft orientation.

     – Sergiy Migdalskiy Jan 20 '14 at 20:26
  • i've seen this related problems:http://scicomp.stackexchange.com/questions/7552/algorithm-for-principal-eigenvector-of-a-real-symmetric-3x3-matrix – isti_spl Jan 20 '14 at 20:35
  • and this one:http://dsp.stackexchange.com/questions/1911/analytical-expression-for-the-eigenvectors-of-a-3x3-real-symmetric-matrix – isti_spl Jan 20 '14 at 20:37
  • @isti_spl: Could you please migrate your comment to an answer? – Geoff Oxberry Jan 20 '14 at 23:19
  • It's also called Wahba's problem in the aerospace community. – Damien Jan 21 '14 at 06:20

1 Answers1

10

The problem is called Wahba's problem, one algorithm for it is called Kabsch algorithm, and the later more popular is called Davenport q method. It's apparently used and studied in aeronautics to determine a craft orientation. There are lots of reviews about the methods.

Beware that the best fit may include reflection.

Kabsch method computes a 3x3 covariance matrix SVD and drops the $\Sigma$ term (modulo one reflection, which usually is accounted for by negating the last column of $U$ in the SVD). It's very straightforward to generalize to other number of dimensions.

Davenport q method is often touted as the first practical algorithm, perhaps someone can comment why. It also constructs a 3x3 covariance matrix, but then parametrizes the rotation matrix as a function of a quaternion, and the problem becomes that of computing the max-eigenvalue eigenvector of a symmetrical 4x4 matrix.

(Some of) the most popular numerical implementations are called QUEST and FOMA. These methods are usually a variation on the theme of computing the max eigenvalue by writing out and optimizing the characteristic polynomial (a quartic), and either solving it analytically (pretty involved computations, going through Kardano formulae), or with Newton iteration.

Schuster also developed and analyzed some iterative algorithm variants.

Sergiy Migdalskiy
  • 431
  • 2
  • 9