When crawling a page, how to get full URL from or attributes?

Anything after the domain name can map to whatever the person configuring the domain wants.

If http://www.abc.com/def is a directory then the web server will usually redirect to http://www.abc.com/def/ in order to avoid confusing the client. You simply need to notice the redirect and use urlparse.urljoin() or the appropriate function in to fuse the two components together in either case as a browser would.

I cant really gove you an answer,but what I can give you is a way to a solution, that is you have to find the anglde that you relate to or peaks your interest. A good paper is one that people get drawn into because it reaches them ln some way.As for me WW11 to me, I think of the holocaust and the effect it had on the survivors, their families and those who stood by and did nothing until it was too late.