Because the decoding function is not necessarily linear. Check kernel PCA.
Show admin stats
Because the decoding function is not necessarily linear. Check kernel PCA.
Here's a bit more detailed proof (the moderator can check for any errors in the proof):
consider this:
if we want to use the first l principal components represented by Dl, we have the reconstruction error:
Now if want to use an additional principal component, one good idea to do it is to extract the first PC of the above error, which will follow the same way when extracting the first PC of X.
let: