After years of having 40GB+ of samples I decided to limit myself to the core of what I would normally use. For me this has worked out really well, because I know my samples inside out. Plus I`m challenged to make the sounds I want too.
I would highly recommend the Legowelt stuff and Rhythmn Lab (all free)