Read more about Series on Analytic Methods in Dimensionality Reduction - Data-adaptive Compression: "Best basis" algorithms, vector quantization and other symbol library methods
Read more about Series on Analytic Methods in Dimensionality Reduction - Foundations of Transform Coding: orthonormal bases, wavelets and frames, wavelet packets.
Read more about From Euler to Clinton: An Unexpected Statistical Journey (Or: Size Does Matter, But You Might Be in for a Surprise …)