I'm looking to scrape lots of sites and search on all of them, what system should I use?

In terms of Node based webcrawlers, check these links out.

Nutch is actually perfect for this. It contains Lucene/Solr as its search engine component.

I cant really gove you an answer,but what I can give you is a way to a solution, that is you have to find the anglde that you relate to or peaks your interest. A good paper is one that people get drawn into because it reaches them ln some way.As for me WW11 to me, I think of the holocaust and the effect it had on the survivors, their families and those who stood by and did nothing until it was too late.