[LON-CAPA-users] Online Exam Questions

Jay Sullivan lon-capa-users@mail.lon-capa.org
Fri, 13 Jul 2007 20:07:42 -0400


------=_Part_4249_13920647.1184371662049
Content-Type: text/plain; charset=ISO-8859-1; format=flowed
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I've been using proctored quizzing and testing for a couple of semesters
now. I'm no expert just chiming in on a couple of things that I learned as
part of this evolving process:

1) Unless you want them to get hints you probably want to increase the
number of tries before hints appears to a large value.

2) You should give them at least two tries on every problem. The thinking is
that if a student makes a mistake entering what they think the answer is,
they have a chance to correct it without needing intervention from the CC. I
have problem status turned off too so they don't know if it's right or wrong
until later.**

I'm very interested in hearing responses to your question about restricting
access to other LONCAPA resources during the exam. This is the most
cumbersome part I have to deal with deploying an online quiz or exam. It
would be nice if there were a parameter to either explicitly restrict all
other resources or have chronological control over hiding/unhiding folders,
etc.

Just my $10^-2
Jay

**One interesting thing about this is that in student view the color scheme
in "Navigate Contents" for problems which have been answered and those
answered using up 2 tries is different. It took me some time to figure out
what was going on here. You may get students asking about this.


On 7/13/07, Todd Ruskell <truskell@mines.edu> wrote:
>
> We're gearing up for online exams, and I have a few questions.  First,
> what we've done so far:
>
> 1) I know I can restrict access by IP address, and we have, I think, set
> that up properly.
>
> 2) We have turned off discussion for the exam resources, by using the
> "end discussion time", and "hide closed discussion" parameters.
>
> 3) We've had our IT people set up completely locked-down computer logins
> so students can't fire up unwanted programs, etc.
>
> 4) We've established a time limit on the resources in the folder.
>
> 5) We've turned off "show problem status"
>
> 6) The folder is currently hidden, and we will unhide it just before the
> exam starts.
>
> Now the questions:
> 1) Right now, we are planning to hide all resources except the online
> exam just before the exam starts.  Is there an easier way to restrict
> student's access to all the other already existing resources in a course
> during an exam?
>
> 2) We have a couple of conceptual problems that ask several questions,
> each of which must be answered via a drop-down box.  As a regular
> problem, these are "all or nothing", in that credit is only given if the
> answers to all questions are correct.  As a printed bubble test, each
> question is a separate problem, which is graded correct/incorrect
> individually.  As an online exam, however, it appears that the awarding
> of points goes back to the "regular problem" mode.  I'm sure I can
> program the spreadsheet to make those problems award points individually
> for each question, but I'm wondering if there's an easier way.
>
> 3) Are there any other exam security kinds of things I might want to
> think about?
>
> Thanks,
>
> Todd
>
>
> --
> Dr. Todd Ruskell
> Senior Lecturer, Department of Physics       Office:  Meyer Hall 326
> Colorado School of Mines                     Phone: 303-384-2080
> 1523 Illinois Street                         Fax: 303-273-3919
> Golden, CO 80401
> _______________________________________________
> LON-CAPA-users mailing list
> LON-CAPA-users@mail.lon-capa.org
> http://mail.lon-capa.org/mailman/listinfo/lon-capa-users
>

------=_Part_4249_13920647.1184371662049
Content-Type: text/html; charset=ISO-8859-1
Content-Transfer-Encoding: 7bit
Content-Disposition: inline

I&#39;ve been using proctored quizzing and testing for a couple of semesters now. I&#39;m no expert just chiming in on a couple of things that I learned as part of this evolving process:<br><br>1) Unless you want them to get hints you probably want to increase the number of tries before hints appears to a large value.
<br><br>2) You should give them at least two tries on every problem. The thinking is that if a student makes a mistake entering what they think the answer is, they have a chance to correct it without needing intervention from the CC. I have problem status turned off too so they don&#39;t know if it&#39;s right or wrong until later.**
<br><br>I&#39;m very interested in hearing responses to your question about restricting access to other LONCAPA resources during the exam. This is the most cumbersome part I have to deal with deploying an online quiz or exam. It would be nice if there were a parameter to either explicitly restrict all other resources or have chronological control over hiding/unhiding folders, etc.
<br><br>Just my $10^-2<br>Jay<br><br>**One interesting thing about this is that in student view the color scheme in &quot;Navigate Contents&quot; for problems which have been answered and those answered using up 2 tries is different. It took me some time to figure out what was going on here. You may get students asking about this.
<br><br><br><div><span class="gmail_quote">On 7/13/07, <b class="gmail_sendername">Todd Ruskell</b> &lt;<a href="mailto:truskell@mines.edu">truskell@mines.edu</a>&gt; wrote:</span><blockquote class="gmail_quote" style="border-left: 1px solid rgb(204, 204, 204); margin: 0pt 0pt 0pt 0.8ex; padding-left: 1ex;">
We&#39;re gearing up for online exams, and I have a few questions.&nbsp;&nbsp;First,<br>what we&#39;ve done so far:<br><br>1) I know I can restrict access by IP address, and we have, I think, set<br>that up properly.<br><br>2) We have turned off discussion for the exam resources, by using the
<br>&quot;end discussion time&quot;, and &quot;hide closed discussion&quot; parameters.<br><br>3) We&#39;ve had our IT people set up completely locked-down computer logins<br>so students can&#39;t fire up unwanted programs, etc.
<br><br>4) We&#39;ve established a time limit on the resources in the folder.<br><br>5) We&#39;ve turned off &quot;show problem status&quot;<br><br>6) The folder is currently hidden, and we will unhide it just before the<br>
exam starts.<br><br>Now the questions:<br>1) Right now, we are planning to hide all resources except the online<br>exam just before the exam starts.&nbsp;&nbsp;Is there an easier way to restrict<br>student&#39;s access to all the other already existing resources in a course
<br>during an exam?<br><br>2) We have a couple of conceptual problems that ask several questions,<br>each of which must be answered via a drop-down box.&nbsp;&nbsp;As a regular<br>problem, these are &quot;all or nothing&quot;, in that credit is only given if the
<br>answers to all questions are correct.&nbsp;&nbsp;As a printed bubble test, each<br>question is a separate problem, which is graded correct/incorrect<br>individually.&nbsp;&nbsp;As an online exam, however, it appears that the awarding<br>
of points goes back to the &quot;regular problem&quot; mode.&nbsp;&nbsp;I&#39;m sure I can<br>program the spreadsheet to make those problems award points individually<br>for each question, but I&#39;m wondering if there&#39;s an easier way.
<br><br>3) Are there any other exam security kinds of things I might want to<br>think about?<br><br>Thanks,<br><br>Todd<br><br><br>--<br>Dr. Todd Ruskell<br>Senior Lecturer, Department of Physics&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Office:&nbsp;&nbsp;Meyer Hall 326
<br>Colorado School of Mines&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Phone: 303-384-2080<br>1523 Illinois Street&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp;&nbsp; Fax: 303-273-3919<br>Golden, CO 80401<br>_______________________________________________<br>LON-CAPA-users mailing list
<br><a href="mailto:LON-CAPA-users@mail.lon-capa.org">LON-CAPA-users@mail.lon-capa.org</a><br><a href="http://mail.lon-capa.org/mailman/listinfo/lon-capa-users">http://mail.lon-capa.org/mailman/listinfo/lon-capa-users</a>
<br></blockquote></div><br>

------=_Part_4249_13920647.1184371662049--