Suraj Kumar

Matlab cody problem submission is removed. Why?

Suraj Kumar on 15 Mar 2022
Latest activity Reply by John D'Errico on 5 Jan 2023

I have submitted a problem in cody some days back. Now it is not showing in my profile. Initially it was accepted and some people submitted the solutions also, however It has been removed after that, are there some guidelines which I am not following?
Christian Schröder
Christian Schröder on 30 Dec 2022
It's hard to say for sure without having seen the specific problem you submitted.
That said, in my experience, problems sometimes get deleted when they are altogether too simple and provide no value whatsoever to Cody. The bar's really quite low, but just to give an example I've seen problems with descriptions such as "sqrt(2)" and a single test case get deleted.
A problem that has a decent title and description and multiple test cases, that requires more than hard-coded results, and that it is not a duplicate of an existing problem should survive.
If it does not, I would suggest asking the Cody admins about it.
John D'Errico
John D'Errico on 5 Jan 2023
Yes. A Cody problem with only 1 test case is a bad problem. It invites hacks. It invites a solver to just return the known answer.
A good problem has multiple test cases. The best problems have multiple randomly generated test cases, reducing the chances of a solver posting a hack.
Arunika on 5 Jan 2023
Thanks for answering Christian. This is the most plausible explanation for what might have happened last year around the time of problem deletion. My guess is also that a Cody admin at that time thought best to delete the problem thinking it was a spam or duplicate.
I have taken a look at the problem myself and it does not come across as spam to me. So I have restored it just now:
Looking at the problem, it might be that the admins deleted it because it only has one test case, and such problems are very easy to create bad-quality solutions for. So I suggest adding more test cases to improve the quality of the problem and prevent low-quality cheat solution submissions.

See Also