[Saga-devel] Re: Tests for Saga-Cloud paper

[Katerina Stamou]

On Wed, 14 Jan 2009 22:22:09 +0100
Andre Merzky <andre at merzky.net> wrote:

> Quoting [Katerina Stamou] (Jan 14 2009):
> > 
> > I'm unable to find your AMI, (doing ec2-describe-images -a | grep -i ami-8bb057e2).
> > Perhaps we're using a different availability zone, and images are not global ?
> > My $EC2_URL points to http://us-east-1.ec2.amazonaws.com, what are you using ?
> 
> I did not realize my image was private - it is public now!
> 
>   jonas merzky ~...adaptors/aws/external/ec2-api-tools/bin : ./ec2-describe-images | grep -i saga
>   IMAGE ami-8bb057e2  /saga-images/hardy_saga.manifest.xml 189011143168  available public	i386  machine aki-a71cf9ce ari-a51cf9cc
> 
> 

Thanks! I can see your image now. I'll test things on that if I'm unable to
resolve the errors on my instance shortly.

> 
> > > > some trouble. Looking more into it right now, and will send out a mail
> > > > later or tomorrow morning for the debugging details.
> > > 
> > > Yes, please.  thanks for checking that out!
> > > 
> > 
> > So, the situation is the following, I have the mapreduce config xml set for
> > EC2, and using postgres as the advert backend (set to fortytwo.cct.lsu.edu).
> > The worker/agent running in the instance dies with the following error:
> > 
> > INFO       : engine.cpp                : loading dynamic adaptors
> > Created exception: SAGA(NoAdaptor): adaptor_selector.cpp(184): Could not select any matching adaptor for: advert_directory_cpi::__init__
> > Created exception: SAGA(NoAdaptor): proxy.cpp(227): No adaptor succeeded in executing constructor for advert_directory_cpi
> > Created exception: SAGA(NoAdaptor): proxy.cpp(227): No adaptor succeeded in executing constructor for advert_directory_cpi
> > Created exception: SAGA(NoAdaptor): proxy.cpp(227): No adaptor succeeded in executing constructor for advert_directory_cpi
> > FAILED (SAGA(NoAdaptor): proxy.cpp(227): No adaptor succeeded in executing constructor for advert_directory_cpi)
> > MapReduceBase::init : Exception caught : SAGA(NoAdaptor): proxy.cpp(227): No adaptor succeeded in executing constructor for advert_directory_cpi
> > 
> > As a side note, I had troubles getting SAGA detecting my postgres, I'm running
> > 8.0.15, and digging into your config scripts it appears that 8.0.X doesn't define
> > PG_VERSION_NUM on the pg_config.h. The same is NOT true for postgres 8.2.X.
> 
> I think that this is the problem, really: your error above
> indicates that the default job adaptor cannot handle the
> remote adverts...
> 

Found what it was, the instance was missing some postgres library dependencies.
Now it appears that the worker is launched on the vm, but there's a new set
of errors - investigating it right now.

> If 8.0.15 is not defining PG_VERSION_NUM - do you have any
> idea how I can detect the PG version?
> 

There's #define PG_VERSION "8.0.15" on my installation, and appears that
you can find the same thing in 8.2.X releases too (they include both
PG_VERSION and PG_VERSION_NUM). Don't know how you could compare the
PG_VERSION string in your config system really.

Hope my "2.93" AWS billing total is dollars, and not something else,
like hundreds of dollars (there's no $ sign anywhere on the activity page) :)

More updates soon,

Best,
Katerina

> Thanks, Andre.
> 
> 
> > Best,
> > Katerina
> > 
> > > 
> > > > As I had stated from the very beginning of this effort last week, I
> > > > couldn't promise for the accomplishment of our goal, since I am really
> > > > in Cloud Computing, as well as the relevant Saga implementations
> > > > (Saga-MapReduce, relevant adaptors, etc) are really new and of course
> > > > not well tested also.
> > > 
> > > Understood! :-)
> > > 
> > > 
> > > > To sum up, I would like to first of all say that I'm really sorry for
> > > > not being able to sufficiently contribute in the current effort. I
> > > > really wish I had more time, and I know that I will have a lot of time
> > > > in the future not only to conduct such trivial tests but also offer to
> > > > the Saga-Cloud and MapReduce efforts regardless of this paper.
> > > > Although, I ll keep continue setting up this image in EC2, it would be
> > > > mythical to say that I'll manage in time to run the experiments and
> > > > comment on them in the paper (as human-weak being I also have to sleep,
> > > > and go to school ;-) ), and I don't know if it would be valuable for
> > > > further efforts to report what I've done so far.
> > > 
> > > Everything helps, and is appreciated!  
> > > 
> > > 
> > > > It will be a quite tough day for me today to schedule a possible
> > > > telecon through Skype, as I have to attend several classes and decide
> > > > eventually which one to participate, but I'll be online on aim and I'll
> > > > keep reading emails.
> > > > 
> > > > Shantenu, Andre -again my apologies for missing the our final goal, I
> > > > really did the best I could in such little amount of time.
> > > 
> > > Well, I have very bad news for you: Shantenu managed to get
> > > us an extension until Sunday night...  So, not all is lost.
> > > 
> > > I agree with your assessement of GumboCloud: unless there is
> > > significant improvement (IP numbers assigned, some idea why
> > > the new image won't run, etc), we should not put more effort
> > > in it - it has eaten up too much time already.
> > > 
> > > Best, Andre.
> > > 
> > > > 
> > > > Best,
> > > > Katerina
> > > > 
> > > 
> > > 
> > > 
> > > -- 
> > > Nothing is ever easy.
> -- 
> Nothing is ever easy.
> 


-- 
Katerina Stamou <kstamou at cct.lsu.edu>