I build under Linux as well. I made sure to pick libraries that have cross-compiler support on Fedora. I did pick one that wasn't included and had to manually grab it but otherwise it has worked great.
