[LON-CAPA-users] Bubblesheet Grading: Use same CODE for a copy of a course folder?

[Stuart Raeburn]

Hi,

>> Note: to compute Exam 2 scores you will need to combine totals from both
>> Folder A and Folder B.  This suggested approach also assumes that a
>> given student was only assigned to either Exam 1 or Exam 2.
>
> Seems this is the problem. Some of them already took part at the first exam.
>
>
> So, I guess Stuarts solution is not possible. Any chance?
>

My suggested solution could still be used.

For the students who completed the assignment from folder A with CODE  
2222 in both exam 1 (two weeks ago) and exam 2 today, you could make a  
third bubblesheet raw data file, derived from the raw data file for  
exam 1, containing only those students assigned folder A with CODE  
2222 for both exams, and bubbles for only those particular questions.

Make a record of the current scores for those students for exam 1,  
before completing step 8 from my previous post to this thread:

>> 8. Grade the Folder A exam using the second derived bubblesheet file,
>> now containing only bubbles for the resources from Folder A, with the
>> checkbox checked for "Skip hidden resources when grading".

Add two additional steps:

9. Record new scores for students for Folder A questions.  These will  
be their exam 2 scores.

10. Grade the Folder A exam yet again using the third derived  
bubblesheet file,
(for exam 1) now containing only bubbles for the resources from Folder  
A (and students who received CODE 2222 for both exams).

The net result will be that the submission record for Folder A for the  
group of students assigned CODE 2222 for both exam 1 and exam 2 will  
contain three entries:

(i) Exam 1 bubbles - graded according to CODE of 2222 (from two weeks ago)
(ii) Exam 2 bubbles - graded according to CODE of 2222 (today)
(iii) Exam 1 bubbles - graded according to CODE of 2222 (today --  
repeat of (i))

Each student's score shown for folder A will be based on the last  
submission, i.e., this would be for exam 1.

Submission history would be viewable by each student via "Previous  
Tries" if you choose to set an answer date.

Stuart Raeburn
LON-CAPA Academic Consortium


Quoting Stefan Bisitz <st.bisitz at ostfalia.de>:

> Thanks for your help so far.
>
> I try to follow your suggestions - still fighting with some other major
> issues in the background, so I'd like to apologize if I'm not capable
> to fully follow all the details.
>
>
> One important hint:
>> The copied folder will contain different
>> symbs, so the randomseed will be different for a given CODE, and the
>> randomization could therefore be different [...]
>
> So, we cannot use this way. Would have been nice. I understand why this
> cannot work.
>
>
>> [...]
>> Note: to compute Exam 2 scores you will need to combine totals from both
>> Folder A and Folder B.  This suggested approach also assumes that a
>> given student was only assigned to either Exam 1 or Exam 2.
>
> Seems this is the problem. Some of them already took part at the first exam.
>
>
> I try to explain what happend:
>
> Exam 1:
> Two weeks ago, Folder A, CODE 1111 and 2222, 120 students, randomly
> assigend one of the two assigments (some with CODE 1111, some with CODE
> 2222), already graded. Fine. Done.
>
> Exam 2:
> - Plan:
> Today, Folder B, CODE 3333 and 4444, 120 students (mostly the same as
> in exam 1!), randomly assigend one of the two assigments (some with
> CODE 3333, some with CODE 4444). Later on: grade.
> - What actually happend:
> One random half got assigned the assigment with CODE 3333 (that's
> fine), but the other half got assigend with the assigment from exam 1
> with CODE 2222.
>
> Please be aware of that some (statistically one forth) of the latter
> students already did the exam 1 / folder A.
>
> The best solution we could think of would be to grade the data for the
> latter case as a new assigment which needs to be created now. This
> appears not to be possible.
>
> So, I guess Stuarts solution is not possible. Any chance?
>
> "Half-Manual" grading, as Ray suggests, might be possible. We don't
> need the students to see the grades online though having the data in
> LON-CAPA would be good, e.g. for build-in statistics and so.
>
> Thanks
> Stefan Bisitz
>
>
> Am 21.02.2013 18:00 schrieb Raymond Batchelor:
>> I am also unsure about what *exactly* happened.
>> What I do believe, is that the exam questions generated for any
> particular CODE are also dependent upon the exact course and sequence
> from which it was generated.
>>
>> So, it seems easier, to me, to move students rather than questions.
>>
>> Thus, my solution in a similar situation (since the students have
> already answered the questions) might be to enroll these students in
> both courses from which their exam questions were generated. One could
> set these students as enrolled "in the past", so as to distinguish them
> from current students and prevent them from seeing the "process".
>> Unfortunately, it sounds to me like the switched questions were only
> *some* of the questions from a particular sequence, rather than an
> entire sequence.
>>
>> Of course if there are only 4 different exam versions, it might just
> be simpler to grab the key answers for those versions and grade the
> students outside LON-CAPA in a spreadsheet or database (which is what I
> like to do anyway).  Of course this will not satisfy you if you were
> expecting to open up those questions for the students in LON-CAPA
> afterward.
>>
>> Perhaps someone who is intimate with the programming of this can
> suggest how you might make one course-sequence mimic a different
> course-sequence.
>>
>> Not me .... though I am intrigued as to what the best solution might be.
>>
>> We had something like this happen once, but it was an entire exam
> taken from a previous course.  We fortunately did not plan to open up
> those questions to the students online, ever.  So, we just enrolled the
> students in the original course, graded them and output the scores from
> Chart, for inclusion elsewhere.
>>
>> Good luck with this.
>>
>> Ray
>>
>>
>
>
> Am 21.02.2013 17:51 schrieb Stuart Raeburn:
>> Hi,
>>
>>> I am not sure about the way how the CODEs and randomization are
>>> created.
>>
>> When a CODE has been specified, the random seed to be used is generated
>> from a digest of the CODE, the courseID, and the identifier for the
>> unique resource instance (known as the 'symb').
>>
>> Whenever bubblesheet grading is used to grade an assignment the CODE
>> used during the grading pass is stored in the student's record for that
>> assignment.  Subsequently, whenever that resource is rendered for that
>> student (e.g., student viewing answers etc.), the CODE will be retrieved
>> and used to re-generate the random seed for that particular instance of
>> the resource.
>>
>> If I understand correctly your description of the situation you are
>> facing, a student taking exam 2 received a printed exam of (let's say)
>> three pages, containing the following components:
>>
>> Page  Origin of questions  CODE used in printout (and shown in header line)
>> 1     Folder B             1345
>> 2     Folder A             2262
>> 3     Folder B             1345
>>
>> where page 2 was a page that also occurred in exam 1, and the student
>> bubbled in a single CODE for this exam -- 1345 -- i.e., the CODE shown
>> on the first page of the exam.
>>
>>> My idea:
>>> - Copy the course folder of the first exam
>>
>> I don't see this working. The copied folder will contain different
>> symbs, so the randomseed will be different for a given CODE, and the
>> randomization could therefore be different from that which applied when
>> page 2 was originally printed for exam 1 (but mistakenly included as
>> page 2 of exam 2).
>>
>> The solution I would adopt would be to:
>>
>> 1. Create two raw bubblesheet results files, by separating the student
>> responses into those for included items from Folder A, and those from
>> Folder B.  StudentIDs, names etc. will be duplicated in the two raw data
>> files.
>>
>> 2. Upload the first of the derived raw data files to the course via the
>> bubblesheet grading menu.
>>
>> 3. Hide the resources in Folder B, which were missing from the printed
>> exam 2 students received.
>>
>> 4. Grade the Folder B exam using the first derived bubblesheet file, now
>> containing only bubbles for the resources from Folder B, with the
>> checkbox checked for "Skip hidden resources when grading".
>>
>> 5. Replace the CODE in each line of the other derived bubblesheet raw
>> data file (i.e., change it from 1345 to 2262)
>>
>> 6. Upload the second derived bubblesheet file, containing only bubbles
>> for the resources from Folder A, via the bubblesheet grading menu.
>>
>> 7. Hide the resources in Folder A, which did not appear in the printed
>> exam 2 students received.
>>
>> 8. Grade the Folder A exam using the second derived bubblesheet file,
>> now containing only bubbles for the resources from Folder A, with the
>> checkbox checked for "Skip hidden resources when grading".
>>
>> Note: to compute Exam 2 scores you will need to combine totals from both
>> Folder A and Folder B.  This suggested approach also assumes that a
>> given student was only assigned to either Exam 1 or Exam 2.
>>
>> Stuart Raeburn
>> LON-CAPA Academic Consortium