[Bigjob-users] Cannot access Redis from compute nodes on alamo.

Andre Merzky andremerzky at gmail.com
Tue Jan 31 12:16:51 CST 2012


On Mon, Jan 30, 2012 at 11:38 PM, pradeep kumar Mantha
<pradeepm66 at gmail.com> wrote:
> Hi!
>
> I still get the same problem.
>
> But its interesting to see the old version  on compute node c079

FWIW, I don't do anything special on the compute nodes in respect to CSA...

Cheers, Andre.


> [pmantha at c079 ~]$ cd
> /N/soft/SAGA/saga/1.6/gcc-4.1.2/lib/python2.7/site-packages/
> [pmantha at c079 site-packages]$ ls -ltr
> total 96
> drwxr-xr-x 9 merzky users  4096 Nov 24 06:50 saga
> -rw-r--r-- 1 merzky users  1779 Nov 24 06:51 site.pyc
> -rw-r--r-- 1 merzky users  2362 Nov 24 06:51 site.py
> drwxr-xr-x 9 merzky users  4096 Nov 24 06:51 BigJob-0.3.2-py2.7.egg
> -rw-r--r-- 1 merzky users 37188 Nov 24 06:51 redis-2.2.4-py2.7.egg
> drwxr-xr-x 4 merzky users  4096 Nov 24 06:51 virtualenv-1.6.4-py2.7.egg
> -rw-r--r-- 1 merzky users 12888 Nov 24 06:51 threadpool-1.2.7-py2.7.egg
> -rw-r--r-- 1 merzky users 13846 Nov 24 06:51 uuid-1.30-py2.7.egg
> -rw-r--r-- 1 merzky users   314 Nov 24 06:51 easy-install.pth
>
>
> New version on head node.
>
> [pmantha at login1 site-packages]$ ls -ltr
> total 960
> -rw-r--r-- 1 merzky users   1779 Jan  9 06:45 site.pyc
> -rw-r--r-- 1 merzky users   2362 Jan  9 06:45 site.py
> -rw-r--r-- 1 merzky users   3026 Jan  9 06:45 setuptools_git-0.4.2-py2.7.egg
> drwxr-xr-x 9 merzky users   4096 Jan  9 06:45 saga
> drwxr-xr-x 9 merzky users   4096 Jan  9 06:45 BigJob-0.4.23-py2.7.egg
> drwxr-xr-x 4 merzky users   4096 Jan  9 06:45 bliss-0.1.17-py2.7.egg
> -rw-r--r-- 1 merzky users  37188 Jan  9 06:45 redis-2.2.4-py2.7.egg
> drwxr-xr-x 4 merzky users   4096 Jan  9 06:45 virtualenv-1.7-py2.7.egg
> -rw-r--r-- 1 merzky users  12888 Jan  9 06:45 threadpool-1.2.7-py2.7.egg
> -rw-r--r-- 1 merzky users  13846 Jan  9 06:45 uuid-1.30-py2.7.egg
> -rw-r--r-- 1 merzky users 298430 Jan  9 06:45
> paramiko_on_pypi-1.7.6-py2.7.egg
> -rw-r--r-- 1 merzky users   6406 Jan  9 06:45 openssh_wrapper-0.2-py2.7.egg
> -rw-r--r-- 1 merzky users 560496 Jan  9 06:46
> pycrypto_on_pypi-2.3-py2.7-linux-x86_64.egg
> -rw-r--r-- 1 merzky users    459 Jan  9 06:46 easy-install.pth
> [pmantha at login1 site-packages]$
>
> thanks
> pradeep
>
>
> On Mon, Jan 30, 2012 at 4:29 PM, Andre Merzky <andremerzky at gmail.com> wrote:
>>
>> Done!
>>
>> Cheers, Andre.
>>
>>
>> On Mon, Jan 30, 2012 at 10:58 PM, Andre Luckow <aluckow at cct.lsu.edu>
>> wrote:
>> > Hi Pradeep,
>> > the agent is picking up an old CSA BJ version (which does not support
>> > password based authentication for Redis):
>> >
>> >
>> > /N/soft/SAGA/saga/1.6/gcc-4.1.2/lib/python2.7/site-packages/BigJob-0.3.2-py2.7.egg/coordination/bigjob_coordination_redis.py
>> >
>> > @AndreM: Could you please remove/update this old BJ version from Alamo?
>> >
>> > Thanks,
>> > Andre
>> >
>> > On Mon, Jan 30, 2012 at 10:11 PM, pradeep kumar Mantha
>> > <pradeepm66 at gmail.com> wrote:
>> >> Hi!
>> >>
>> >> I am trying to run bigjob example on alamo using pbs-ssh. But it fails
>> >> due
>> >> to the following error, where as it works for fork( since it runs on
>> >> head
>> >> node).
>> >>
>> >>
>> >> [pmantha at login1 bj-ce3420b4-4b86-11e1-be3d-a4badb0c3696]$ vi
>> >> stderr-bigjob_agent.txt
>> >>
>> >> DEBUG:root:Utilizing Redis Backend:
>> >> redis://ILikeBigJob_wITH-REdIS@gw68.quarry.iu.teragrid.org:6379. Please
>> >> make
>> >> sure Redis server is configured in bigjob_coordination_redis.py
>> >> DEBUG:root:Connect to Redis:
>> >> ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org Port: 6379
>> >> ERROR:root:Please start Redis server!
>> >> Traceback (most recent call last):
>> >>   File "<string>", line 35, in <module>
>> >>   File
>> >>
>> >> "/N/soft/SAGA/saga/1.6/gcc-4.1.2/lib/python2.7/site-packages/BigJob-0.3.2-py2.7.egg/bigjob/bigjob_agent.py",
>> >> line 110, in __init__
>> >>     self.coordination =
>> >> bigjob_coordination(server_connect_url=self.coordination_url)
>> >>   File
>> >>
>> >> "/N/soft/SAGA/saga/1.6/gcc-4.1.2/lib/python2.7/site-packages/BigJob-0.3.2-py2.7.egg/coordination/bigjob_coordination_redis.py",
>> >> line 62, in __init__
>> >>     raise Exception("Please start Redis server!")
>> >> Exception: Please start Redis server!
>> >> Connection closed by 10.141.0.79^M
>> >> Connection closed by 10.141.0.79^M
>> >> Connection closed by 10.141.0.79^M
>> >> Connection closed by 10.141.0.79^M
>> >> Connection closed by 10.141.0.79^M
>> >> Connection closed by 10.141.0.79^M
>> >> Connection closed by 10.141.0.79^M
>> >> Connection closed by 10.141.0.79^M
>> >>
>> >> thanks
>> >> pradeep
>> >>
>> >>
>> >> _______________________________________________
>> >> Bigjob-users mailing list
>> >> Bigjob-users at mail.cct.lsu.edu
>> >> https://mail.cct.lsu.edu/mailman/listinfo/bigjob-users
>> >>
>>
>>
>>
>> --
>> Nothing is ever easy...
>
>



-- 
Nothing is ever easy...


More information about the Bigjob-users mailing list