[Bigjob-users] BigJob fails with Bliss

[Andre Luckow]

Hi Pradeep,
the URL parser in Bliss is broken with Python <2.7 - the behaviour is
different from the SAGA C++ URL class (it relies on Python urlparse
which behaves differently in Python 2.6 and 2.7).

I opened a ticket.

Andre

On Wed, Apr 4, 2012 at 6:50 AM, pradeep kumar Mantha
<pradeepm66 at gmail.com> wrote:
> Hi !
>
> I tried to run BigJob with Bliss on LSU HPC machine. It failed with below
> error.
>
>
> (python)[wairimu at philip1 ~]$ python example_eric.py
> Logging level: logging.DEBUG
> Set logging level: logging.DEBUG/10
> 04/03/2012 11:48:49 PM - bigjob - INFO - Loading BigJob version: 0.4.46
>>
>> /home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py(33)<module>()
> -> if SAGA_BLISS == False:
> (Pdb) c
> 04/03/2012 11:48:50 PM - bigjob - WARNING - SAGA C++ and Python bindings not
> found. Using Bliss.
> /home/wairimu/.bigjob/python/lib/python2.6/site-packages/pycrypto_on_pypi-2.3-py2.6-linux-x86_64.egg/Crypto/Util/randpool.py:40:
> RandomPool_DeprecationWarning: This application uses RandomPool, which is
> BROKEN in older releases.  See http://www.pycrypto.org/randpool-broken
> 04/03/2012 11:48:50 PM - bigjob - WARNING - pbs-ssh://<hostname> plugin not
> compatible with SAGA Bliss. Use pbs+ssh://<hostname>
> 04/03/2012 11:48:50 PM - bigjob - WARNING - sge-ssh://<hostname> plugin not
> compatible with SAGA Bliss.
> 04/03/2012 11:48:50 PM - root - DEBUG -
> ['/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/coordination/../ext/redis-2.4.9/',
> '/home/wairimu',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/setuptools-0.6c11-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/pip-1.1-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/bliss-0.1.19-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/redis-2.2.4-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/virtualenv-1.7.1.2-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/threadpool-1.2.7-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/uuid-1.30-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/paramiko_on_pypi-1.7.6-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/openssh_wrapper-0.2.2-py2.6.egg',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/pycrypto_on_pypi-2.3-py2.6-linux-x86_64.egg',
> '/home/wairimu/.bigjob/python/lib/python26.zip',
> '/home/wairimu/.bigjob/python/lib/python2.6',
> '/home/wairimu/.bigjob/python/lib/python2.6/plat-linux2',
> '/home/wairimu/.bigjob/python/lib/python2.6/lib-tk',
> '/home/wairimu/.bigjob/python/lib/python2.6/lib-old',
> '/home/wairimu/.bigjob/python/lib/python2.6/lib-dynload',
> '/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6',
> '/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6/plat-linux2',
> '/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6/lib-tk',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages',
> '/usr/local/packages/python/2.6.4/intel-11.1/lib/python2.6/site-packages',
> '/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob']
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Utilizing Redis Backend
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Parsing URL:
> redis://ILikeBigJob_wITH-REdIS@gw68.quarry.iu.teragrid.org:6379
> 04/03/2012 11:48:50 PM - bigjob - ERROR - URL
> redis://ILikeBigJob_wITH-REdIS@gw68.quarry.iu.teragrid.org:6379 could not be
> parsed
> Traceback (most recent call last):
>   File
> "/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py",
> line 625, in __parse_url
>     raise BigJobError("BLISS URL broken.")
> BigJobError: 'BLISS URL broken.'
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Result:
> ParseResult(scheme='redis', netloc='',
> path='//ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379', params='',
> query='', fragment='')
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Python 2.6 fallback
> 04/03/2012 11:48:50 PM - bigjob - DEBUG -
> ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org:6379
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - redis://
> ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org 6379
> 04/03/2012 11:48:50 PM - bigjob - DEBUG - Connect to Redis:
> ILikeBigJob_wITH-REdIS at gw68.quarry.iu.teragrid.org Port: 6379
> 04/03/2012 11:48:50 PM - bigjob - ERROR - Please start Redis server!
> Traceback (most recent call last):
>   File "example_eric.py", line 30, in <module>
>     bj = bigjob(COORDINATION_URL)
>   File
> "/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py",
> line 118, in __init__
>     self.coordination = self.__init_coordination(coordination_url)
>   File
> "/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/bigjob/bigjob_manager.py",
> line 180, in __init_coordination
>     password=password, dbtype=dbtype, url_prefix=scheme)
>   File
> "/home/wairimu/.bigjob/python/lib/python2.6/site-packages/BigJob-0.4.46-py2.6.egg/coordination/bigjob_coordination_redis.py",
> line 83, in __init__
>     raise Exception("Please start Redis server!")
> Exception: Please start Redis server!
> (python)[wairimu at philip1 ~]$
>
>
>
> Could you please have a look at it.
>
> thanks
> pradeep
>
>
>
>
> _______________________________________________
> Bigjob-users mailing list
> Bigjob-users at mail.cct.lsu.edu
> https://mail.cct.lsu.edu/mailman/listinfo/bigjob-users
>