How to deal with utf-8 encoded String and BeautifulSoup?

I think what you need are ICU transliterators I think there is a way to transliterate HTML entities into Unicode Try the transliterator id Hex/XML-Any that should to what you want. On the Demo page you can choose "Insert Sample: Compound" and then enter Hex/XML-Any into the "Compound 1" box, add some input data in the box and press "transform". Does this help?

There is a Python ICU binding, but its not taken care of well, I think.

I think what you need are ICU transliterators. I think there is a way to transliterate HTML entities into Unicode. Try the transliterator id Hex/XML-Any that should to what you want.

On the Demo page you can choose "Insert Sample: Compound" and then enter Hex/XML-Any into the "Compound 1" box, add some input data in the box and press "transform". Does this help? There is a Python ICU binding, but its not taken care of well, I think.

Htmlentitydefs. Entitydefs"quot" returns '"' That's a dictionary that translates entities to their actual character. You should be able to continue easily from that point.

If BeautifulSoup would give me the right entities at all. See my edit – vikingosegundo Oct 29 '10 at 18:25.

Ok, the problem was silly, I have to confess. I was working on an old version of rows in the interactive interpreter. I don't know what was wrong with it contents, but this is the correct code: from BeautifulSoup import BeautifulSoup f = open('path_to_file','r') lines = I for I in f.readlines() soup = BeautifulSoup(''.

Join(lines)) rows = soup. FindAll('tr') allArticles = for row in rows: l = for r in row. FindAll('td'): l += r.

String allArticles+=l shame on me!

I cant really gove you an answer,but what I can give you is a way to a solution, that is you have to find the anglde that you relate to or peaks your interest. A good paper is one that people get drawn into because it reaches them ln some way.As for me WW11 to me, I think of the holocaust and the effect it had on the survivors, their families and those who stood by and did nothing until it was too late.