Transforming binary data using ssis and sql server 2008?

I think you are out of luck here - SSIS is just not the tool for that. Binary manipulation is not what they had in mind when they were conceptualiztin it. SSIS is basically in the core for ETL processes loading data warehouses with all kinds of data.

Agree. Although you could in theory do something like this in a script task, it's really the wrong tool for the job. – Meff Apr 15 '10 at 15:12 I was thinking the same thing... just wanted to get a different perspective.

I intend to take the data that does get processed into the database (held as varbinary) into ssis warehouse. Do you see any hurdles in that task in that the data is not processed into specific data types? – Rick Apr 15 '10 at 16:41.

SSIS will work just fine. You can improve the process by not grabbing all 13k files in a single task. You can round robin pulling in the files.

Split your files based upon the number of CPUs you have on your SSIS box. If the C#app can be slimmed down you can put that into a script task. I have a framework that will enable you to move the files in parallel.

I use it to move . Pdf files into sql server. If you send me your email I will forward it to you.

I cant really gove you an answer,but what I can give you is a way to a solution, that is you have to find the anglde that you relate to or peaks your interest. A good paper is one that people get drawn into because it reaches them ln some way.As for me WW11 to me, I think of the holocaust and the effect it had on the survivors, their families and those who stood by and did nothing until it was too late.