[LON-CAPA-admin] Fwd: [LON-CAPA] Stringresponse Grading Discrepancy

[Stuart Raeburn]

Hi,

LON-CAPA 2.10.0.RC2 includes a version of caparesponse.pm which will  
send an e-mail to the server administrator should the award status  
change for an identical submission for a particular problem part by a  
particular student, *just for stringresponse* (this detection was  
implemented to identify the cause of the rare bug: 5531; fixed in  
2.10.0 final).

Unfortunately the implementation in 2.10.0.RC2 (caparesponse.pm rev  
1.243) would report instances where a status change was legitimate  
(e.g., when randomizetry was in use).  The version of caparesponse.pm  
(rev 1.246) being included in 2.10.0 will not report those types of  
false positives.

See bug 6421 in bugs.loncapa.org for more discussion.

However, a reported "changed from EXACT_ANS (submissions: 1) to  
INCORRECT;" is definitely worthy of investigation, and I would  
recommend looking at the submission history for this particular  
problem part for the particular student.

If this turns out to be a false positive then it would be good to know  
so the existing detector code can be modified to exclude that type of  
transaction.

Stuart Raeburn
MSU LON-CAPA group


Quoting "Lucas, Mark" <lucasm at ohio.edu>:

> I just received the following message from one of my machines. Some   
> information
> has been removed and replaced with <> tags.
>
> Could someone shed light on what probably is going on?  Has the   
> computer gone back
> and regraded a problem?
>
> Mark
>
> Begin forwarded message:
>
> Subject: [LON-CAPA] Stringresponse Grading Discrepancy
>
> *** This is an automatic e-mail generated by the LON-CAPA system.
> *** Please do not reply to this address.
> *** A reply will not be received by the recipient!
>
> String Response (Case insensitive) grading discrepancy: award for   
> response of <blah> changed from EXACT_ANS (submissions: 1) to   
> INCORRECT; user: <JDoe> in course: <blah> for part: 0 response: 11   
> for symb: <funproblem>
>
> --
> Mark Lucas  email: lucasm at ohiou.edu<mailto:lucasm at ohiou.edu>
> 252D Clippinger Lab phone: (740)597-2984
> Department of Physics and Astronomy fax: (740)593-0433
> Ohio University
> Athens, OH 45701