We had checked approaches for this problem but haven't got a
good setting yet.. We will keep an eye on this issue

Bjarte Johansen writes:

The program would wait for a result even though all workers had quit because of
an error or a C-c. This isn't the most elegant fix, but it is the only one I
could manage in the time I had.

diff --git a/tools/grid.py b/tools/grid.py
index 40f55fb..7c5b744 100755
--- a/tools/grid.py
+++ b/tools/grid.py
@@ -390,6 +390,7 @@ def find_parameters(dataset_pathname, options=''):

job_queue._put = job_queue.queue.appendleft

• workers = []

fire telnet workers

if telnet_workers:
@@ -400,6 +401,7 @@ def find_parameters(dataset_pathname, options=''):
worker = TelnetWorker(host,job_queue,result_queue,
host,username,password,options)
worker.start()

•       workers.append(worker)
  

  fire ssh workers

@@ -407,12 +409,14 @@ def find_parameters(dataset_pathname, options=''):
for host in ssh_workers:
worker = SSHWorker(host,job_queue,result_queue,host,options)
worker.start()

•       workers.append(worker)
  

  fire local workers

  for i in range(nr_local_worker):
  worker = LocalWorker('local',job_queue,result_queue,options)
  worker.start()

•   workers.append(worker)
  

  gather results

@@ -436,7 +440,11 @@ def find_parameters(dataset_pathname, options=''):
for line in jobs:
for (c,g) in line:
while (c,g) not in done_jobs:

•           (worker,c1,g1,rate1) = result_queue.get()
  

•           while any(map(Thread.is_alive, workers)):
  

•               try:
  

•                   (worker,c1,g1,rate1) = result_queue.get(True, 1)
  

•               except:
  

•                   continue
          done_jobs[(c1,g1)] = rate1
          if (c1,g1) not in resumed_jobs:
              best_c,best_g,best_rate = update_param(c1,g1,rate1,best_c,best_g,best_rate,worker,False)
  

  --
  2.2.0

—
Reply to this email directly or view it on GitHub.*

from libsvm.

I discovered today that my quick fix was a bit too quick. I would look into using async. I think an async model or the go channel model would work well here. A model where you could wait on open channels, but drop closed ones would be ideal I think.

from libsvm.