[Bigjob-users] Multiple pilot-jobs with affinity

pradeep kumar Mantha pmanth2 at cct.lsu.edu
Sun Sep 25 11:23:56 CDT 2011


Hi!

I am trying to run example example-manyjob-affinity.py  on oliver.

with below resource urls.

        resource_list.append( {"resource_url" : "gram://
oliver1.loni.org/jobmanager-pbs", "number_nodes" : "2", "allocation" : None,
                               "queue" : "workq",
                               "working_directory": (os.getcwd() +
"/agent"),
                               "walltime": 10, "affinity" : "affinity1"})

        resource_list.append( {"resource_url" : "gram://
eric1.loni.org/jobmanager-pbs", "number_nodes" : "2", "allocation" : None,
                               "queue" : "workq",
                               "working_directory": (os.getcwd() +
"/agent"),
                               "walltime": 10, "affinity" : "affinity2"})


I created 8 jobs with affinity value as "affinity2".


       for i in range(0, NUMBER_JOBS):
            # create job description
            jd = saga.job.description()
            jd.executable = "/bin/date"
            jd.number_of_processes = "1"
            jd.spmd_variation = "single"
            jd.arguments = [""]
            jd.working_directory = os.getcwd()
            jd.output =  os.getcwd() + "/stdout-" + str(i) + ".txt"
            jd.error = os.getcwd() + "/stderr-" + str(i) + ".txt"
            *jd.environment = ["affinity=affinity2"]*
            subjob = mjs.create_job(jd)
            subjob.run()
            print "Submited sub-job " + "%d"%i + "."
            jobs.append(subjob)
            job_start_times[subjob]=time.time()
            job_states[subjob] = subjob.get_state()


As per my understanding all the jobs should execute on eric as it has
affinity value affinity2. But I see jobs jobs distributing among both the
resources.

Is this valid behavior or something is wrong?

thanks
pradeep
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.cct.lsu.edu/pipermail/bigjob-users/attachments/20110925/b7b2cadc/attachment.html 


More information about the Bigjob-users mailing list