Friday, 27 September 2013

java performance on large file uploads

java performance on large file uploads

I need to 'proxy' many simultaneous ( 600 + connections ) large file
uploads ( 300 MB + ) from browser to Youtube. So far I've tried Java on
Beanstalk and the results are not very good. At 500 connections Beanstalk
starts about 97 instances which is quite expensive. Am I using the wrong
tool for this job ? The task is fairly simple (proxy-> upload). Is there
anything that I can do to optimize the performance ?
I think an issue is that the file is loaded in memory before providing the
file items (and streams).I basically just want to proxy the request body
from the one to other side transparently without altering it or storing it
in memory in any way.

No comments:

Post a Comment