CPU utilization:Thread Pooling

[Bom]

Hi,

I have a requirement where i am creating a Web based app which retrieves the data from different data sources.For this purpose i'av created a thread pool in which i am queing the request for data from different data sources.As of now i'av queued 50 request in the pool.

This is working fine but it is consuming 100% of CPU :(.After getting data from different data sets i merge it into a single dataset which contains around 1000 records.

What shall i do to reduce the CPU usage?Is there any other approach to this kind of requirement.

Regards,
Bom

[tbrummel]

Are you running 50 threads? You said that you've queued 50 requests -- but it sounds like you're running 50 at a time. Naturally, this is going to kill a single processor box. It would be faster to execute each request (I'm assuming these are all coming from different web clients) in sequence.

Is this SQLServer? Given the nature of IIS and connection pooling provided by SQLServer are you sure you want to be creating another thread pool? Just curious.

Also, are the clients request different data or is the page doing the same queries many times. If the later, take a look at the ASP.NET provided caching which can cache the page for a specified time so that as other clients request it, it's just returned from the cache.

I hope I'm not just wasting your time with the obvious but it's sort of hard to tell what's going on from just reading the post.