From pradeepm66 at gmail.com  Tue Apr  3 23:50:51 2012
From: pradeepm66 at gmail.com (pradeep kumar Mantha)
Date: Tue, 3 Apr 2012 23:50:51 -0500
Subject: [Bigjob-users] BigJob fails with Bliss
Message-ID: <CALqJaV93v5BcP58VFdEQBh6M9QJkEoZYtnWWzVctCNK37A79Rw@mail.gmail.com>

Hi !

I tried to run BigJob with Bliss on LSU HPC machine. It failed with below
error.


(python)[wairimu at philip1 ~]$ python example_eric.py
Logging level: logging.DEBUG
Set logging level: logging.DEBUG/10
04/03/2012 11:48:49 PM - bigjob - INFO - Loading BigJob version: 0.4.46
>
/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py(33)<module>()
-> if SAGA_BLISS == False:
(Pdb) c
04/03/2012 11:48:50 PM - bigjob - WARNING - SAGA C++ and Python bindings
not found. Using Bliss.
/home/wairimu/.bigjob/python/lib/python2.6/site-packages/pycrypto_on_pypi-2.3-py2.6-linux-x86_64.egg/Crypto/Util/randpool.py:40:
RandomPool_DeprecationWarning: This application uses RandomPool, which is
BROKEN in older releases.  See http://www.pycrypto.org/randpool-broken
04/03/2012 11:48:50 PM - bigjob - WARNING - pbs-ssh://<hostname> plugin not
compatible with SAGA Bliss. Use pbs+ssh://<hostname>
04/03/2012 11:48:50 PM - bigjob - WARNING - sge-ssh://<hostname> plugin not
compatible with SAGA Bliss.
04/03/2012 11:48:50 PM - root - DEBUG -
['/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/coordination/../ext/redis-2.4.9/',
'/home/wairimu',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/pip-1.1-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/bliss-0.1.19-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/redis-2.2.4-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/virtualenv-1.7.1.2-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/threadpool-1.2.7-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/uuid-1.30-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/paramiko_on_pypi-1.7.6-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/openssh_wrapper-0.2.2-py2.6.egg',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/pycrypto_on_pypi-2.3-py2.6-linux-x86_64.egg',
'/home/wairimu/.bigjob/python/lib/python26.zip',
'/home/wairimu/.bigjob/python/lib/python2.6',
'/home/wairimu/.bigjob/python/lib/python2.6/plat-linux2',
'/home/wairimu/.bigjob/python/lib/python2.6/lib-tk',
'/home/wairimu/.bigjob/python/lib/python2.6/lib-old',
'/home/wairimu/.bigjob/python/lib/python2.6/lib-dynload',
'/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6',
'/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6/plat-linux2',
'/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6/lib-tk',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages',
'/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6/site-packages',
'/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob']
04/03/2012 11:48:50 PM - bigjob - DEBUG - Utilizing Redis Backend
04/03/2012 11:48:50 PM - bigjob - DEBUG - Parsing URL: redis://
ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379
04/03/2012 11:48:50 PM - bigjob - ERROR - URL redis://
ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379 could not be parsed
Traceback (most recent call last):
  File
"/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py",
line 625, in __parse_url
    raise BigJobError("BLISS URL broken.")
BigJobError: 'BLISS URL broken.'
04/03/2012 11:48:50 PM - bigjob - DEBUG - Result:
ParseResult(scheme='redis', netloc='', path='//
ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379', params='',
query='', fragment='')
04/03/2012 11:48:50 PM - bigjob - DEBUG - Python 2.6 fallback
04/03/2012 11:48:50 PM - bigjob - DEBUG -
ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379
04/03/2012 11:48:50 PM - bigjob - DEBUG - redis://
ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org 6379
04/03/2012 11:48:50 PM - bigjob - DEBUG - Connect to Redis:
ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org Port: 6379
04/03/2012 11:48:50 PM - bigjob - ERROR - Please start Redis server!
Traceback (most recent call last):
  File "example_eric.py", line 30, in <module>
    bj = bigjob(COORDINATION_URL)
  File
"/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py",
line 118, in __init__
    self.coordination = self.__init_coordination(coordination_url)
  File
"/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py",
line 180, in __init_coordination
    password=password, dbtype=dbtype, url_prefix=scheme)
  File
"/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/coordination/bigjob_coordination_redis.py",
line 83, in __init__
    raise Exception("Please start Redis server!")
Exception: Please start Redis server!
(python)[wairimu at philip1 ~]$



Could you please have a look at it.

thanks
pradeep
-------------- next part --------------
An HTML attachment was scrubbed...
URL: http://mail.cct.lsu.edu/pipermail/bigjob-users/attachments/20120403/68f1b878/attachment.html 

From aluckow at cct.lsu.edu  Wed Apr  4 00:35:00 2012
From: aluckow at cct.lsu.edu (Andre Luckow)
Date: Wed, 4 Apr 2012 07:35:00 +0200
Subject: [Bigjob-users] BigJob fails with Bliss
In-Reply-To: <CALqJaV93v5BcP58VFdEQBh6M9QJkEoZYtnWWzVctCNK37A79Rw@mail.gmail.com>
References: <CALqJaV93v5BcP58VFdEQBh6M9QJkEoZYtnWWzVctCNK37A79Rw@mail.gmail.com>
Message-ID: <CAD8t0M8xSQbntsnGTTrowAxhtKVixtBM_kt4NaHQr-CadujWFw@mail.gmail.com>

Hi Pradeep,
the URL parser in Bliss is broken with Python <2.7 - the behaviour is
different from the SAGA C++ URL class (it relies on Python urlparse
which behaves differently in Python 2.6 and 2.7).

I opened a ticket.

Andre

On Wed, Apr 4, 2012 at 6:50 AM, pradeep kumar Mantha
<pradeepm66 at gmail.com> wrote:
> Hi !
>
> I tried to run BigJob with Bliss on LSU HPC machine. It failed with below
> error.
>
>
> (python)[wairimu at philip1 ~]$ python example_eric.py
> Logging level: logging.DEBUG
> Set logging level: logging.DEBUG/10
> 04/03/2012 11:48:49 PM - bigjob - INFO - Loading BigJob version: 0.4.46
>>
>> /home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py(33)<module>()
> -> if SAGA_BLISS == False:
> (Pdb) c
> 04/03/2012 11:48:50 PM - bigjob - WARNING - SAGA C++ and Python bindings not
> found. Using Bliss.
> /home/wairimu/.bigjob/python/lib/python2.6/site-packages/pycrypto_on_pypi-2.3-py2.6-linux-x86_64.egg/Crypto/Util/randpool.py:40:
> RandomPool_DeprecationWarning: This application uses RandomPool, which is
> BROKEN in older releases. ?See http://www.pycrypto.org/randpool-broken
> 04/03/2012 11:48:50 PM - bigjob - WARNING - pbs-ssh://<hostname> plugin not
> compatible with SAGA Bliss. Use pbs+ssh://<hostname>
> 04/03/2012 11:48:50 PM - bigjob - WARNING - sge-ssh://<hostname> plugin not
> compatible with SAGA Bliss.
> 04/03/2012 11:48:50 PM - root - DEBUG -
> ['/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/coordination/../ext/redis-2.4.9/',
> '/home/wairimu',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/pip-1.1-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/bliss-0.1.19-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/redis-2.2.4-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/virtualenv-1.7.1.2-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/threadpool-1.2.7-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/uuid-1.30-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/paramiko_on_pypi-1.7.6-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/openssh_wrapper-0.2.2-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/pycrypto_on_pypi-2.3-py2.6-linux-x86_64.egg',
> '/home/wairimu/.bigjob/python/lib/python26.zip',
> '/home/wairimu/.bigjob/python/lib/python2.6',
> '/home/wairimu/.bigjob/python/lib/python2.6/plat-linux2',
> '/home/wairimu/.bigjob/python/lib/python2.6/lib-tk',
> '/home/wairimu/.bigjob/python/lib/python2.6/lib-old',
> '/home/wairimu/.bigjob/python/lib/python2.6/lib-dynload',
> '/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6',
> '/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6/plat-linux2',
> '/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6/lib-tk',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages',
> '/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6/site-packages',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob']
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Utilizing Redis Backend
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Parsing URL:
> redis://ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379
> 04/03/2012 11:48:50 PM - bigjob - ERROR - URL
> redis://ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379 could not be
> parsed
> Traceback (most recent call last):
> ? File
> "/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py",
> line 625, in __parse_url
> ? ? raise BigJobError("BLISS URL broken.")
> BigJobError: 'BLISS URL broken.'
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Result:
> ParseResult(scheme='redis', netloc='',
> path='//ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379', params='',
> query='', fragment='')
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Python 2.6 fallback
> 04/03/2012 11:48:50 PM - bigjob - DEBUG -
> ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - redis://
> ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org 6379
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Connect to Redis:
> ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org Port: 6379
> 04/03/2012 11:48:50 PM - bigjob - ERROR - Please start Redis server!
> Traceback (most recent call last):
> ? File "example_eric.py", line 30, in <module>
> ? ? bj = bigjob(COORDINATION_URL)
> ? File
> "/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py",
> line 118, in __init__
> ? ? self.coordination = self.__init_coordination(coordination_url)
> ? File
> "/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py",
> line 180, in __init_coordination
> ? ? password=password, dbtype=dbtype, url_prefix=scheme)
> ? File
> "/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/coordination/bigjob_coordination_redis.py",
> line 83, in __init__
> ? ? raise Exception("Please start Redis server!")
> Exception: Please start Redis server!
> (python)[wairimu at philip1 ~]$
>
>
>
> Could you please have a look at it.
>
> thanks
> pradeep
>
>
>
>
> _______________________________________________
> Bigjob-users mailing list
> Bigjob-users at mail.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/bigjob-users
>