[Bbob-discuss] Request for BBOB algorithms.

Petr Pošík posik at labe.felk.cvut.cz
Tue Feb 28 09:54:41 CET 2012

Hi Olivier.


Regarding the running time: you are right that the graphs produced by BBOB
postprocessing do not show the running time. Nevertheless, the BBOB
methodology suggests (requires?) to run also a timing experiment to indicate
the wall-clock time needed to find a solution. (See e.g. the exampetiming.m
file). In the first BBOB issue in 2009, almost all papers actually contained
the information about the time requirements of the algorithms. In 2010, I am
not that sure...


So, the questions are:

- Should the BBOB methodology be modified to really REQUIRE the info about
the time demands of the algorithms?

- Should/can the COCO framework be modified to do this more automatically?

- Should the time demands be more emhasized in the latex templates?


Cheers, Petr


From: bbob-discuss-bounces at www.lri.fr
[mailto:bbob-discuss-bounces at www.lri.fr] On Behalf Of Olivier Teytaud
Sent: Tuesday, February 28, 2012 12:21 AM
To: Daniel Molina
Cc: Nikolaus Hansen; Francisco Herrera; bbob-discuss at www.lri.fr
Subject: Re: [Bbob-discuss] Request for BBOB algorithms.


Hi Daniel + thanks for this interesting link.

In particular I see that this site includes higher dimensions than BBOB
(without downloading, changing parameters and rerunning :-) ). For a
starting project (using optimization, but not focusing on it) I must choose
which algorithms downloading/implementing/testing, and this test bed might
be the best approximation for my needs (I do not consider 40-D as a good
approximation of 40000D).

Another (related) remark on BBOB is that computational costs are usually
given in terms of number of iterations; computation times are not given in
the usual graphs; whereas it is an important issue; if you run 40-D only and
don't show the evolution of the running time, you might not see that some
algorithms can run in dimension 10 000 and some others can not. This is
certainly not a negligible issue.

Best regards,

The source code of my proposal in previous BBOB, MA-CMA-LS Chains, is
available in

Also, the source code of several other algorithms (with its reference, of
course), like MOS, is also
available in the same website.

There is also a section on the website in


-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://lists.lri.fr/pipermail/bbob-discuss/attachments/20120228/be117b77/attachment.html>

More information about the bbob-discuss mailing list