Grader says answer Verified in Reference Solution is wrong when submitted by a Learner
4 views (last 30 days)
Show older comments
William Stuckey
on 23 Mar 2020
Edited: Cris LaPierre
on 7 May 2020
The Grader is saying an answer that is Verified by the Reference Solution is wrong when submitted in a Learner Code.
Reference Solution:
eqns = [Mass_bullet*V_i == (Mass_bullet + Mass_block)*v, (Mass_bullet + Mass_block)*g*d*mu == 0.5*(Mass_bullet + Mass_block)*v^2];
Solving for v and d.
Only way to get Grader to say the Learner's value for d is correct is to move mu to front of second expression:
eqns = [Mass_bullet*V_i == (Mass_bullet + Mass_block)*v, mu*(Mass_bullet + Mass_block)*g*d == 0.5*(Mass_bullet + Mass_block)*v^2];
If the Learner enters the code as in the Reference Solution, it produces exactly the same value for d (to all shown sig figs), but Grader says it's incorrect.
How can I get Grader to confirm the correct d from the Learner without having the Learner type that line of code in a specific order?
1 Comment
Cris LaPierre
on 23 Mar 2020
Edited: Cris LaPierre
on 23 Mar 2020
Can you share your complete reference solution? Or at least something similar if you don't want students to come across the solution here.
Accepted Answer
Cris LaPierre
on 23 Mar 2020
Edited: Cris LaPierre
on 7 May 2020
From what I can see, the issue is that you are comparing two symbolic variables. Symbolic variables do not have a concept of tolerance, so the values have to be exactly equal in order to pass the assessment. Changing the order of operations produces a slightly different (Δ= 8.8818e-16) value for Distance.
In order to incorporate tolderance, the final answer must be numeric. My suggestion would be to either have the students convert the symbolic values to doubles
Distance = double(Distance)
Velocity = double(Velocity)
or you can perform the conversion in the assessment test (select MATLAB Code as the type). Adding the code below as a new MATLAB Code assessment test to the problem in its current state works (converts the vpa solution to double), or you could have the students stop at the solve step. I've tested the assessment code for a variety of permutations of mu, g, and d). It worked for all of them.
% Get reference solution
refD = double(referenceVariables.Distance);
Distance = double(Distance);
% Compare with learner solution.
assessVariableEqual('Distance', refD);
Note that I use the same variable name (Distance) because, in the scenario where there is an issue, the variable name is included in the default error message. Using a different variable name the students don't see in their code could be confusing.
I wanted to add a final comment on Validate Reference Solution. This test just makes sure the reference solution can pass the assessment tests. Validating, then, does not mean the reference solution is correct, the assessment tests are robust, etc. Please do still exercise the normal caution you use when creating any problem for your students.
2 Comments
Cris LaPierre
on 23 Mar 2020
Edited: Cris LaPierre
on 23 Mar 2020
I'll pass that on. I can see how this could be misleading in this scenario.
More Answers (1)
Communities
More Answers in the Distance Learning Community
See Also
Categories
Find more on Logical in Help Center and File Exchange
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!