[Bigjob-users] Multiple pilot-jobs with affinity
pradeep kumar Mantha
pmanth2 at cct.lsu.edu
Sun Sep 25 11:23:56 CDT 2011
Hi!
I am trying to run example example-manyjob-affinity.py on oliver.
with below resource urls.
resource_list.append( {"resource_url" : "gram://
oliver1.loni.org/jobmanager-pbs", "number_nodes" : "2", "allocation" : None,
"queue" : "workq",
"working_directory": (os.getcwd() +
"/agent"),
"walltime": 10, "affinity" : "affinity1"})
resource_list.append( {"resource_url" : "gram://
eric1.loni.org/jobmanager-pbs", "number_nodes" : "2", "allocation" : None,
"queue" : "workq",
"working_directory": (os.getcwd() +
"/agent"),
"walltime": 10, "affinity" : "affinity2"})
I created 8 jobs with affinity value as "affinity2".
for i in range(0, NUMBER_JOBS):
# create job description
jd = saga.job.description()
jd.executable = "/bin/date"
jd.number_of_processes = "1"
jd.spmd_variation = "single"
jd.arguments = [""]
jd.working_directory = os.getcwd()
jd.output = os.getcwd() + "/stdout-" + str(i) + ".txt"
jd.error = os.getcwd() + "/stderr-" + str(i) + ".txt"
*jd.environment = ["affinity=affinity2"]*
subjob = mjs.create_job(jd)
subjob.run()
print "Submited sub-job " + "%d"%i + "."
jobs.append(subjob)
job_start_times[subjob]=time.time()
job_states[subjob] = subjob.get_state()
As per my understanding all the jobs should execute on eric as it has
affinity value affinity2. But I see jobs jobs distributing among both the
resources.
Is this valid behavior or something is wrong?
thanks
pradeep
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.cct.lsu.edu/pipermail/bigjob-users/attachments/20110925/b7b2cadc/attachment.html
More information about the Bigjob-users
mailing list