|
From: Steve Hoelzer on 7 May 2008 15:14 "Yi Cao" <y.cao(a)cranfield.ac.uk> wrote in message <fvstsb$m4n$1(a)fred.mathworks.com>... > "Steve Hoelzer" <shoelzer(a)gmail.com> wrote in message > <fvsqp9$8gg$1(a)fred.mathworks.com>... > > No. The same code must give the same score every time it > > runs. Otherwise, a new type of random variable "tuning" is > > possible: submitting the same code multiple times. I too > > wish that magic number tuning was not a part of the > contest, > > but I don't think it can be programmatically enforced. > > > > Steve > > However, currently, it is already possible to resubmit the > same code several time to get the best score because the > same code wont get the same result on timeing. > > Yi True, but the timing variation is small and has little impact on score compared to varying the random number seed. That said, I would support a change to the scoring function such that run time is rounded to the nearest second. That should mostly eliminate the effect of timing variation. Steve |