Main Page | Report Page

 

  Computers Forum Index » Computer Languages (IDL-PVWAVE) » IDL_IDLBridge limited to 4?...

Author Message
Donald Woodraska...
Posted: Thu Nov 04, 2010 4:14 pm
 
I've been using the IDL_IDLBridge to run tasks in parallel in the
background. However, when I increase the number of IDL_IDLBridge
objects beyond 4, they don't seem to do anything. Although they are
given tasks, the linux top command doesn't show any increase in CPU
usage. I've cranked it up from 4 to as many as 14 IDL_IDLBridge
objects, but the CPU usage doesn't go beyond 400%.

My box has dual quad cores with hyperthreading, so it looks like 16
CPU cores are available. IDL recognizes all 16 in !CPU, but I can't
seem to use them.

IDL> help,!cpu,/str
** Structure !CPU, 6 tags, length=32, data length=32:
HW_VECTOR LONG 0
VECTOR_ENABLE LONG 0
HW_NCPU LONG 16
TPOOL_NTHREADS LONG 16
TPOOL_MIN_ELTS LONG64 100000
TPOOL_MAX_ELTS LONG64 0

I've split my job into 4 pieces and run 4 separate IDL instances with
4 bridge objects each on 4 separate terminals. There has to be a
better way.

Is there some kind of an internal limit in IDL preventing me from
using more than 4 bridge objects at the same time? Is there a startup
parameter I need to change? I'm running version 7.0.8 (no DE) on
Redhat 5.

Thanks!
 
Bennett...
Posted: Thu Nov 04, 2010 7:30 pm
 
On Nov 4, 12:14 pm, Donald Woodraska <don.woodra... at (no spam) gmail.com> wrote:
Quote:
I've been using the IDL_IDLBridge to run tasks in parallel in the
background. However, when I increase the number of IDL_IDLBridge
objects beyond 4, they don't seem to do anything. Although they are
given tasks, the linux top command doesn't show any increase in CPU
usage. I've cranked it up from 4 to as many as 14 IDL_IDLBridge
objects, but the CPU usage doesn't go beyond 400%.

My box has dual quad cores with hyperthreading, so it looks like 16
CPU cores are available. IDL recognizes all 16 in !CPU, but I can't
seem to use them.

IDL> help,!cpu,/str
** Structure !CPU, 6 tags, length=32, data length=32:
   HW_VECTOR       LONG                 0
   VECTOR_ENABLE   LONG                 0
   HW_NCPU         LONG                16
   TPOOL_NTHREADS  LONG                16
   TPOOL_MIN_ELTS  LONG64                    100000
   TPOOL_MAX_ELTS  LONG64                         0

I've split my job into 4 pieces and run 4 separate IDL instances with
4 bridge objects each on 4 separate terminals. There has to be a
better way.

Is there some kind of an internal limit in IDL preventing me from
using more than 4 bridge objects at the same time? Is there a startup
parameter I need to change? I'm running version 7.0.8 (no DE) on
Redhat 5.

Thanks!

Are you using the NOWAIT keyword for asynchronous operation?
 
 
Page 1 of 1    
All times are GMT
The time now is Wed Apr 23, 2014 12:56 pm