Apache Camel File Output Component Performance slow - Java?

You are of course limited by the speed of the IO of the disks. So you need to be able to write 440 files/sec.

You are of course limited by the speed of the IO of the disks. So you need to be able to write 440 files/sec. Now are all of those 440 files unique file names?

I am asking because you have? FileExist=Append. The Camel file component will serialize writes to the same file name, so if all 440 is writing to the same file name, they are doing this in sequence.

A reason for doing this is that Camel community users have reported "lost writes" when they do parallel writes to the same file. Camel uses the NIO API to write to files, so I doubt you can make it go significant faster.

How about combining the Strings to a larger String using an aggregator or a custom Processor. If you write only to one File then that might improve performance quite a lot. Of course it means you will have some delay before the write happens and you could loose some data when a crash happens.

I cant really gove you an answer,but what I can give you is a way to a solution, that is you have to find the anglde that you relate to or peaks your interest. A good paper is one that people get drawn into because it reaches them ln some way.As for me WW11 to me, I think of the holocaust and the effect it had on the survivors, their families and those who stood by and did nothing until it was too late.

Related Questions