[LON-CAPA-users] Bubblesheet Grading: Use same CODE for a copy of a course folder?

Tue Feb 26 17:21:06 EST 2013

Hi,

Considering Stuarts and Rays comments and explanations, I decided to choose another way:

1) Normal grading of the exam 2 with CODE 3333 for folder B.

2) Grading of exam 2 with CODE 2222 which actually was another exam 1 by using folder A again but with new user accounts. These are similar but different account names and are assigned a similar but different student's id.

This way, we don't re-grade and we keep simple access to all statistics what is preferred. The additional accounts are of course a bit disturbing. However, we needed to use special accounts anyway, so I don't care too much about even some more.

Thanks again for your quick help,
Stefan Bisitz

On 2013-02-22 01:38:22, Stuart Raeburn wrote:
> Hi,
> 
> >> Note: to compute Exam 2 scores you will need to combine totals from both
> >> Folder A and Folder B.  This suggested approach also assumes that a
> >> given student was only assigned to either Exam 1 or Exam 2.
> >
> > Seems this is the problem. Some of them already took part at the first exam.
> >
> >
> > So, I guess Stuarts solution is not possible. Any chance?
> >
> 
> My suggested solution could still be used.
> 
> For the students who completed the assignment from folder A with CODE  
> 2222 in both exam 1 (two weeks ago) and exam 2 today, you could make a  
> third bubblesheet raw data file, derived from the raw data file for  
> exam 1, containing only those students assigned folder A with CODE  
> 2222 for both exams, and bubbles for only those particular questions.
> 
> Make a record of the current scores for those students for exam 1,  
> before completing step 8 from my previous post to this thread:
> 
> >> 8. Grade the Folder A exam using the second derived bubblesheet file,
> >> now containing only bubbles for the resources from Folder A, with the
> >> checkbox checked for "Skip hidden resources when grading".
> 
> Add two additional steps:
> 
> 9. Record new scores for students for Folder A questions.  These will  
> be their exam 2 scores.
> 
> 10. Grade the Folder A exam yet again using the third derived  
> bubblesheet file,
> (for exam 1) now containing only bubbles for the resources from Folder  
> A (and students who received CODE 2222 for both exams).
> 
> The net result will be that the submission record for Folder A for the  
> group of students assigned CODE 2222 for both exam 1 and exam 2 will  
> contain three entries:
> 
> (i) Exam 1 bubbles - graded according to CODE of 2222 (from two weeks ago)
> (ii) Exam 2 bubbles - graded according to CODE of 2222 (today)
> (iii) Exam 1 bubbles - graded according to CODE of 2222 (today --  
> repeat of (i))
> 
> Each student's score shown for folder A will be based on the last  
> submission, i.e., this would be for exam 1.
> 
> Submission history would be viewable by each student via "Previous  
> Tries" if you choose to set an answer date.
> 
> Stuart Raeburn
> LON-CAPA Academic Consortium
> 
> 
> Quoting Stefan Bisitz <st.bisitz at ostfalia.de>:
> 
> > Thanks for your help so far.
> >
> > I try to follow your suggestions - still fighting with some other major
> > issues in the background, so I'd like to apologize if I'm not capable
> > to fully follow all the details.
> >
> >
> > One important hint:
> >> The copied folder will contain different
> >> symbs, so the randomseed will be different for a given CODE, and the
> >> randomization could therefore be different [...]
> >
> > So, we cannot use this way. Would have been nice. I understand why this
> > cannot work.
> >
> >
> >> [...]
> >> Note: to compute Exam 2 scores you will need to combine totals from both
> >> Folder A and Folder B.  This suggested approach also assumes that a
> >> given student was only assigned to either Exam 1 or Exam 2.
> >
> > Seems this is the problem. Some of them already took part at the first exam.
> >
> >
> > I try to explain what happend:
> >
> > Exam 1:
> > Two weeks ago, Folder A, CODE 1111 and 2222, 120 students, randomly
> > assigend one of the two assigments (some with CODE 1111, some with CODE
> > 2222), already graded. Fine. Done.
> >
> > Exam 2:
> > - Plan:
> > Today, Folder B, CODE 3333 and 4444, 120 students (mostly the same as
> > in exam 1!), randomly assigend one of the two assigments (some with
> > CODE 3333, some with CODE 4444). Later on: grade.
> > - What actually happend:
> > One random half got assigned the assigment with CODE 3333 (that's
> > fine), but the other half got assigend with the assigment from exam 1
> > with CODE 2222.
> >
> > Please be aware of that some (statistically one forth) of the latter
> > students already did the exam 1 / folder A.
> >
> > The best solution we could think of would be to grade the data for the
> > latter case as a new assigment which needs to be created now. This
> > appears not to be possible.
> >
> > So, I guess Stuarts solution is not possible. Any chance?
> >
> > "Half-Manual" grading, as Ray suggests, might be possible. We don't
> > need the students to see the grades online though having the data in
> > LON-CAPA would be good, e.g. for build-in statistics and so.
> >
> > Thanks
> > Stefan Bisitz
> >
> >
> > Am 21.02.2013 18:00 schrieb Raymond Batchelor:
> >> I am also unsure about what *exactly* happened.
> >> What I do believe, is that the exam questions generated for any
> > particular CODE are also dependent upon the exact course and sequence
> > from which it was generated.
> >>
> >> So, it seems easier, to me, to move students rather than questions.
> >>
> >> Thus, my solution in a similar situation (since the students have
> > already answered the questions) might be to enroll these students in
> > both courses from which their exam questions were generated. One could
> > set these students as enrolled "in the past", so as to distinguish them
> > from current students and prevent them from seeing the "process".
> >> Unfortunately, it sounds to me like the switched questions were only
> > *some* of the questions from a particular sequence, rather than an
> > entire sequence.
> >>
> >> Of course if there are only 4 different exam versions, it might just
> > be simpler to grab the key answers for those versions and grade the
> > students outside LON-CAPA in a spreadsheet or database (which is what I
> > like to do anyway).  Of course this will not satisfy you if you were
> > expecting to open up those questions for the students in LON-CAPA
> > afterward.
> >>
> >> Perhaps someone who is intimate with the programming of this can
> > suggest how you might make one course-sequence mimic a different
> > course-sequence.
> >>
> >> Not me .... though I am intrigued as to what the best solution might be.
> >>
> >> We had something like this happen once, but it was an entire exam
> > taken from a previous course.  We fortunately did not plan to open up
> > those questions to the students online, ever.  So, we just enrolled the
> > students in the original course, graded them and output the scores from
> > Chart, for inclusion elsewhere.
> >>
> >> Good luck with this.
> >>
> >> Ray
> >>
> >>
> >
> >
> > Am 21.02.2013 17:51 schrieb Stuart Raeburn:
> >> Hi,
> >>
> >>> I am not sure about the way how the CODEs and randomization are
> >>> created.
> >>
> >> When a CODE has been specified, the random seed to be used is generated
> >> from a digest of the CODE, the courseID, and the identifier for the
> >> unique resource instance (known as the 'symb').
> >>
> >> Whenever bubblesheet grading is used to grade an assignment the CODE
> >> used during the grading pass is stored in the student's record for that
> >> assignment.  Subsequently, whenever that resource is rendered for that
> >> student (e.g., student viewing answers etc.), the CODE will be retrieved
> >> and used to re-generate the random seed for that particular instance of
> >> the resource.
> >>
> >> If I understand correctly your description of the situation you are
> >> facing, a student taking exam 2 received a printed exam of (let's say)
> >> three pages, containing the following components:
> >>
> >> Page  Origin of questions  CODE used in printout (and shown in header line)
> >> 1     Folder B             1345
> >> 2     Folder A             2262
> >> 3     Folder B             1345
> >>
> >> where page 2 was a page that also occurred in exam 1, and the student
> >> bubbled in a single CODE for this exam -- 1345 -- i.e., the CODE shown
> >> on the first page of the exam.
> >>
> >>> My idea:
> >>> - Copy the course folder of the first exam
> >>
> >> I don't see this working. The copied folder will contain different
> >> symbs, so the randomseed will be different for a given CODE, and the
> >> randomization could therefore be different from that which applied when
> >> page 2 was originally printed for exam 1 (but mistakenly included as
> >> page 2 of exam 2).
> >>
> >> The solution I would adopt would be to:
> >>
> >> 1. Create two raw bubblesheet results files, by separating the student
> >> responses into those for included items from Folder A, and those from
> >> Folder B.  StudentIDs, names etc. will be duplicated in the two raw data
> >> files.
> >>
> >> 2. Upload the first of the derived raw data files to the course via the
> >> bubblesheet grading menu.
> >>
> >> 3. Hide the resources in Folder B, which were missing from the printed
> >> exam 2 students received.
> >>
> >> 4. Grade the Folder B exam using the first derived bubblesheet file, now
> >> containing only bubbles for the resources from Folder B, with the
> >> checkbox checked for "Skip hidden resources when grading".
> >>
> >> 5. Replace the CODE in each line of the other derived bubblesheet raw
> >> data file (i.e., change it from 1345 to 2262)
> >>
> >> 6. Upload the second derived bubblesheet file, containing only bubbles
> >> for the resources from Folder A, via the bubblesheet grading menu.
> >>
> >> 7. Hide the resources in Folder A, which did not appear in the printed
> >> exam 2 students received.
> >>
> >> 8. Grade the Folder A exam using the second derived bubblesheet file,
> >> now containing only bubbles for the resources from Folder A, with the
> >> checkbox checked for "Skip hidden resources when grading".
> >>
> >> Note: to compute Exam 2 scores you will need to combine totals from both
> >> Folder A and Folder B.  This suggested approach also assumes that a
> >> given student was only assigned to either Exam 1 or Exam 2.
> >>
> >> Stuart Raeburn
> >> LON-CAPA Academic Consortium
> 
> _______________________________________________
> LON-CAPA-users mailing list
> LON-CAPA-users at mail.lon-capa.org
> http://mail.lon-capa.org/mailman/listinfo/lon-capa-users