You often get free samples at cosmetic shops and you could prabably sample some food in gourmet shops.
It would help if you were a bit more specific.
Are you talking about synth samples, drum samples, one hit samples, loops, effect samples, noise samples, single cycles, pads, bass samples, acoustic samples, stabs, vocal samples or fart samples?
There are tons of resources out there, it just depends on what YOU think are good samples. Professionally mixed and mastered samples and loops specifically made for certain styles or recreating specific sounds aren’t usually free, but you don’t really need those to make something that sounds good, at least if you’re aiming for electronic music.
A pro renoiser should be able to make lovely music out of a single fart sample.
First of all i would recommend the downloads section, there are lots of nice samples, instruments and all kinds of other resources you’ll need to make all kinds of music.
The downloads are located here:http://forum.renoise.com/index.php/files/