From: Jin on
why bombing the queue?
I sugguest adding some submission limits, such as 1
entry/per min/per ip.

From: Jin on
why bombing? when is the end?
From: Markus Buehren on
Alans bombing as well as his analysis both speak for adding
a "captcha" to the submission site (which I think is even
better than an IP limit). This would prevent the
over-over-over-specification of the solver to the test suite
which occurs due to the many parameter variations that are
submitted.

I have found some algorithmic improvement yesterday, which
dramatically boosted the score on the test suite we are
having at home. However, as the leading code is so
over-specified to the actual test suite, my change even lead
to a worse score on it. I think the parameter tweaking by
numerous automated uploads takes away the room for
algorithmic improvements.

The most obvious sign for tweaking is the introduction of
randomness into the algorithm. Not only that parameters of
the code are varied, we even don't know which parameters
that are! In my opinion the use of random generators (rand,
randn, randperm etc.) should be forbidden.

Any other thoughts?

Markus

From: srach on
> I have found some algorithmic improvement yesterday, which
> dramatically boosted the score on the test suite we are
> having at home. However, as the leading code is so
> over-specified to the actual test suite, my change even lead
> to a worse score on it. I think the parameter tweaking by
> numerous automated uploads takes away the room for
> algorithmic improvements.

But sometimes such differences also come with different
matlab versions or different machines. Earlier in the
contest, I found a small change that led to an improvement
of about 10 sec on my computer. I checked that on a
different computer (with a more recent matlab version) and
there this change led to a worsening of 10 sec.

(Same was true at the end of the last contest, where the
final tweak that I saved for the last seconds of the contest
actually made the score worse, although it led to
improvements on my system.)

I second your thoughts about randomness.

Regards,
srach
From: srach on
> I have found some algorithmic improvement yesterday, which
> dramatically boosted the score on the test suite we are
> having at home. However, as the leading code is so
> over-specified to the actual test suite, my change even lead
> to a worse score on it. I think the parameter tweaking by
> numerous automated uploads takes away the room for
> algorithmic improvements.

But sometimes such differences also come with different
matlab versions or different machines. Earlier in the
contest, I found a small change that led to an improvement
of about 10 sec on my computer. I checked that on a
different computer (with a more recent matlab version) and
there this change led to a worsening of 10 sec.

(Same was true at the end of the last contest, where the
final tweak that I saved for the last seconds of the contest
actually made the score worse, although it led to
improvements on my system.)

I second your thoughts about randomness.

Regards,
srach