[math-fun] Stupid math question: least-squares

Does anything interesting/fun happen when you apply so-called "least(?)-squares" algorithms to finite fields -- e.g., GF(2) ? In particular, the theory of pseudo-inverses, etc. Also, what about least-squares in fields with non-standard orderings (valuations) ? Any references would be appreciated. Thx.