I can't remember specific threads, sorry. Best do a search there, or just ask and someone will point you in the right direction.
I agree about the Pi clock, it is not really intended for this purpose.
The DAC+ Pro design shows that you do not need to use the Pi as a clock source, it will work fine as an I2S slave.
It looks like the Buffalo DAC can use an external source, so in that case, you would have your choice of clocks, too.
To me, the Pi and any one of the better I2S DACs sounds fine, for casual listening. The DAC chip uses an internal PLL to correct the clock, and I am ok with that. The bigger issue for me, is the SNR of anything connected to a Pi (and I assume to an Odroid C1 or C2). That is something I notice, especially with headphones.
Nevertheless, it seems like a fun project putting it all together. I wish you best of luck with it, and I hope you will post the results at some point!