Azure Project - Need guidance?

I would put the documents into Azure blob storage an put a work item in a queue. The workers would pull an entry from the queue and delete it while they process the document. Just keep in mind that if a worker fails, you'll want some way to re-queue the work.

You could do this by reknewing the lock on the queue item before deleting it, or by using another store, say a table entry that you can check perioically and use to requeue failed items.

– Steve Morgan Jul 14 at 19:44 So I actually want to know how to create multiple worker roles in azure. Should every worker role have a queue containing pointers to the documents in the blob? – Supraja Jayakumar Jul 14 at 23:24 Your solution will contain only one Worker Role.

But in the ServiceConfiguration. Cscfg file, you'll configure the number of instances of that role to run. The role will simply read a message from the queue, process it and read the next message.

In this way, as long as there's work to process, each instance will be busy. And as I pointed out in my post, the record in the queue should point to the document in the blob (the document will have a URL; you can use that). – Steve Morgan Jul 15 at 12:52 Thanks.

So as a starting point, I did this. Read all files in a directory and make them into blobs and get reference and store it in queue as message. I tried running this and got deployment error due to incorrect NTFS permission in web.config.

Can you pl tell me how to rectify this error? – Supraja Jayakumar Jul 15 at 16:50 also can the instance count be set dynamically depending on the work? – Supraja Jayakumar Jul 15 at 18:42.

I'd recommend that you start by reading up on Azure Queue Storage (Queue Services API). By inserting messages into a queue, worker roles can take work from that queue as they are able. The size of an entry on a queue is limited to 8KB, so I'd recommend that you put that actual document in SQL Azure (if your application is using it) or Azure BLOB Storage (Blob Storage API) and post a message on the queue that contains a reference to the stored document.

. I will look into this and implement it and get back in case of errors/other problems. – Supraja Jayakumar Jul 14 at 20:47.

A good learning resource to start with is the Developing Application for the Cloud guide and a sample app from Microsoft patterns & practices.

I cant really gove you an answer,but what I can give you is a way to a solution, that is you have to find the anglde that you relate to or peaks your interest. A good paper is one that people get drawn into because it reaches them ln some way.As for me WW11 to me, I think of the holocaust and the effect it had on the survivors, their families and those who stood by and did nothing until it was too late.