[LON-CAPA-cvs] cvs: modules /gerd/concept description.tex trajectoryjpg.jpg

www lon-capa-cvs@mail.lon-capa.org
Thu, 08 Jul 2004 01:25:33 -0000


This is a MIME encoded message

--www1089249933
Content-Type: text/plain

www		Wed Jul  7 21:25:33 2004 EDT

  Added files:                 
    /modules/gerd/concept	trajectoryjpg.jpg 

  Modified files:              
    /modules/gerd/concept	description.tex 
  Log:
  Work on intro and references
  
  
--www1089249933
Content-Type: text/plain
Content-Disposition: attachment; filename="www-20040707212533.txt"

Index: modules/gerd/concept/description.tex
diff -u modules/gerd/concept/description.tex:1.4 modules/gerd/concept/description.tex:1.5
--- modules/gerd/concept/description.tex:1.4	Sat Jul  3 14:57:10 2004
+++ modules/gerd/concept/description.tex	Wed Jul  7 21:25:33 2004
@@ -53,12 +53,21 @@
 \end{quote}
 
 \subsection{"Thinking like a Physicist"}
-Most physicists would agree that part of "being a physicist" is to "think like a physicist," which manifests itself most strongly in the cognitive and metacognitive skills involved in problem solving~\cite{redish} --- part of the self-image of many physicists is to be expert problem solvers, even outside their own discipline.
-
-As a result, an unfortunately only too common approach to teaching students how to "think like a physicist" is to have
-them solve a lot of problems. It does not take much real-world evidence (such as the student comment above) to refute this reverse conclusion, yet for many teachers, it takes "hard" proof, such as having their students complete the Force-Concept-Inventory~\cite{fci}, to bring about change~\cite{mazur} --- after all, most likely the naive approach actually worked for them.
-
-Expert and novice approaches to problem solving in physics have been studied extensively (e.g.~\cite{chi,larkin}), with one of the most apparent differences being that experts are characterizing problems according to deep structure and physical concepts (e.g., "energy conservation"-problem), while novices tend to characterize them according to surface features (e.g., "sliding-block-on-incline"-problem) or applicable formulas (e.g., "$E=\frac12mv^2+mgh$"-problem"). Redish~\cite{redish} somewhat bleakly  describes a novice approach to learning physics as follows:
+Most physicists would agree that part of "being a physicist" is to "think like a physicist" \cite{heuvelen}, which manifests itself most prominently in the cognitive and metacognitive skills involved in problem solving~\cite{redish} --- part of the self-image of many physicists is to be expert problem solvers, even outside their own discipline \cite{fuller}:
+\[\mbox{Think like a Physicist}\ \Rightarrow\ \mbox{Solve Problems}\]
+Yet, while basic logic tells us that the reverse statement, i.e., 
+\[\mbox{Think like a Physicist}\ \Leftarrow\ \mbox{Solve Problems}\]
+does not necessarily have to be true,
+an unfortunately only too common approach to teaching physics is to have students solve a lot of problems. 
+
+It is broadly accepted that frequent formative assessment and feedback are a key component of the learning process \cite{bransford}, but {\it what} the students are learning is not necessarily what educators are expecting them to learn \cite{pellegrino}. This disconnect frequently goes undetected if the summative assessment tools are similar to the formative assessment tools \cite{lin}. In most physics courses, these are standard problems along the lines of "A ball starts with an initial velocity of \ldots. \ldots What is the \ldots?". Deploying alternative conceptual assessment tools such as the Force Concept Inventory \cite{fci} can reveal large discrepancies between different summative assessment types (e.g,~\cite{steinberg,mazur}).
+
+Expert and novice approaches to problem solving in physics have been studied extensively (e.g.~\cite{chi,larkin}). Two of the most apparent differences are that
+\begin{enumerate}
+\item experts are initially characterizing problems according to deep structure and physical concepts (e.g., "energy conservation"-problem), while novices tend to characterize them according to surface features (e.g., "sliding-block-on-incline"-problem) or applicable formulas (e.g., "$E=\frac12mv^2+mgh$"-problem")
+\item novices then continue to employ a formula-centered problem solving method \cite{heuvelen}, frequently refered to as "plug-and-chug."
+\end{enumerate}
+Redish~\cite{redish} somewhat bleakly  describes a novice approach to learning physics as follows:
 \begin{itemize}
 \item Write down every equation or law the teacher puts on the board that is also in the book.
 \item Memorize these, together with the list of formulas at the end of each chapter.
@@ -66,7 +75,26 @@
 \item Pass the exam by selecting the correct formula for the problems on the exam.
 \item Erase all information from your brain after the exam to make room for the next set of materials.
 \end{itemize}
-Unfortunately, the above mechanism actually works to pass courses. One cannot really blame learners for shortcircuiting physics "learning" this way, since the cognitive and metacognitive skills which physicists value so much higher than factual knowledge or formulas are hardly ever made explicit in the curriculum, in fact, they are "hidden"\cite{redish}.
+
+One cannot really blame learners for shortcircuiting physics "learning" this way, since the cognitive and metacognitive skills, which physicists value so much higher than factual knowledge or formulas, are hardly ever made explicit, neither in instruction, nor in formative or summative assessment \cite{lin,reif,mazur96}; in fact, they are mostly altogether "hidden" \cite{redish} from all aspects of a course, and students are affirmed in their novice expectations \cite{hammer} of what it is to "do physics."
+\subsection{The Problem with Problems}
+{\bf This project focusses on formative assessment in introductory physics education, and how formative assessment can be used to help learners re-evaluate their epistemologies and develop expert-like problem solving skills.} The challenge is to move students away from treating physics as a set of unrelated factoids and formulas, and away from focussing on memorizing and using formulas without interpretation or sense-making \cite{hammer}.
+
+Alternative formative assessment as a classroom tool, where students are forced to verbally  express their views and teach each other, rather than calculate answers \cite{mazur}, is starting to be accepted as an effective teaching practice in more and more courses. Formative assessment outside the classroom, on the other hand, is frequently limited by logistics, particularly in large enrollment courses, where timely feedback is often impossible without the use of computerized systems (e.g.~\cite{thoennessen,kashy00}). {\bf This project will focus on online homework as formative assessment tool.}
+
+The assumption of this project is that "the problem with problems" (a phrase borrowed from \cite{mazur96}) is that
+\begin{quote}
+Hypothesis 1a: Standard textbook problems affirm non-expertlike epistemologies and encourage non-expertlike problem-solving strategies
+\end{quote}
+and that by the reverse token --- within the limitations of online computer-evaluated problems ---
+\begin{quote}
+Hypothesis 1b: There are classes of online formative assessment computer-evaluated problems which make learners confront their non-expertlike epistemologies and encourage expertlike problem-solving strategies\end{quote}
+
+Online homework systems by the very nature of computers lend themselves to standard calculation-oriented textbook problems, and are extensively used in this way. Yet, the "plug-and-chug" approach is the most prominent symptom of novice-like problem-solving strategy, and calculation-oriented problems may encourage just that. As a result, there is a frequent call for "conceptual" online problems, where both instructors and students seem to define "conceptual" simply by the absence of numbers and formulas. But does depriving students of numbers and formulas indeed make them work on a conceptual level?
+
+The project will study the use and abuse of mathematics in formative assessment.
+
+
 
 \subsection{Transfer between mathematical formulations and physical situations}
 Being able to plug-and-chug and perform basic algebraic manipulations ("$V=RI\ \Rightarrow\ R=V/I"$) has little do with the understanding of mathematics, it is a skill. Students who are lacking this skill are kept from advancing in physics on a very basic level, and remedial instruction is in order. Other students simply have problems operating their pocket calculators.
@@ -78,15 +106,10 @@
 
 If it is then the formulas which are tempting the students to shortcircuit their learning or distract them from it, some physics teachers have turned to almost altogether depriving their students of them. They are developing "conceptual" materials, where {\bf "conceptual" is frequently defined as the absence of formulas}. 
 
-A somewhat extreme example is "Conceptual Physics" by Paul Hewitt~\cite{hewitt}, see Fig.~\ref{textbooks} and Table~\ref{alternatetext}, a more moderate example are the famous {\it Feynman Lectures on Physics}~\cite{feynmanLectures}, which have a much lower "formula density" than most textbooks actually in use in undergraduate teaching (Blatt~\cite{blatt} was chosen as a random example representating the style of most any textbook currently used). 
-
-\begin{figure}\label{textbooks}
-\includegraphics[width=6.5in]{pages}
-\caption{Two textbook pages covering the same topic, {\it Principles of Physics} (Blatt~\cite{blatt}) left, {\it Conceptual Physics} (Hewitt~\cite{hewitt}) right}
-\end{figure}
+A somewhat extreme example is "Conceptual Physics" by Paul Hewitt~\cite{hewitt}, see Table~\ref{alternatetext}, a more moderate example are the famous {\it Feynman Lectures on Physics}~\cite{feynmanLectures}, which have a much lower "formula density" than most textbooks actually in use in undergraduate teaching (Blatt~\cite{blatt} was chosen as a random example representating the style of most any textbook currently used). 
 
 \begin{table}\label{alternatetext}
-\tiny
+\footnotesize
 \begin{tabular}{p{3in}|p{3in}}
 If $N$ coils of wire, wound in the same sense, are connected, as for example in a solenoid, the induced emf is given by
 \[\varepsilon=-N\frac{\Delta\Phi}{\Delta t}\]
@@ -104,16 +127,38 @@
 Or, in units form,
 \[\mbox{Amperes}=\frac{\mbox{volts}}{\mbox{ohms}}\]
 \end{tabular}
-\caption{Ohm's and Faraday's Law stated in two textbooks,  {\it Principles of Physics} (Blatt\cite{blatt}) left, {\it Conceptual Physics} (Hewitt\cite{hewitt}) right}
+\caption{Ohm's and Faraday's Law stated in two textbooks,  {\it Principles of Physics} (Blatt\cite{blatt}), left, and {\it Conceptual Physics} (Hewitt\cite{hewitt}), right}
 \end{table}
 
 It should be noted that Hewitt also argues that the mathematical language of physics often deters the average nonscience students~\cite{hewitt}, which is contradictory to the observation of students being very satisfied to it for plug-and-chug.
+\subsection{Intellectual Merit}Much effort and many resources have been invested into developing effective curricular material and assessment, especially in the interactive or online realm, yet very little research has been done on the impact of different representations and question types on student conceptual understanding.The outcomes of this study will provide a broader research base for STEM curriculum development efforts regarding the most effective use of learner feedback. The outcomes will also inform development efforts for online course and learning content management systems, as well as provide input for educational metadata, content exchange, and interoperability standard efforts.\subsection{Broader Impact/Diversity}Attrition in STEM courses is a national problem and may be particularly acute in large, introductory courses that are the staples of many undergraduate science programs, with 40 to 60\% of students leaving STEM disciplines [Committee99, Seymour97]. Much of this attrition has been attributed to inadequate curriculum design, pedagogy and assessment.It is broadly accepted that frequent formative assessment and feedback are a key component of the learning process \cite{bransford}. Shifting the focus from summative to formative assessment with feedback can move student motivation from an extrinsic reward to the intrinsic reward of developing understanding of the materials [Stipek96]. Intrinsic motivation and positive feedback promote the feelings of competence, confidence [Pascarella02, Clark98], and engagement that are crucial to retaining students in introductory STEM courses.  While improving student self-efficacy should have positive impacts on all student retention, Seymour and Hewitt [Seymour97] suggest that such changes should have a particularly strong impact on women and underrepresented groups who may feel that science excludes them. They report that even women with good academic records nonetheless lost confidence in judging their academic performances as "good enough" if they did not receive feedback through personal teacher-student relationships Ð these relationships were reported to be rare, possibly due to the disproportionate number of male teaching staff in STEM courses. Lack of confidence, paired with a perceived gender or race bias, can negatively influence performance [Steele97].A gender-differential benefit of using online formative assessment systems (particularly LON-CAPA) has been found in the past at both Michigan State and Central Michigan University, and was recently studied in more detail through an NSF planning grant [NSFPGE03]. While the final analysis of the data gathered during the last semester is still not completed, additional evidence was found that such technology helps women to more quickly close the initial gender gap in performance in the sciences. In the science courses we propose to focus on, we traditionally have approximately 50-60\% female students, so we anticipate being able to gather additional statistically significant data. The traditionally relatively low enrollment of ethnic minorities in the courses under consideration might unfortunately not yield statistically significant findings with regards to the improvement of STEM education for underrepresented groups.
+\section{Online Formative Assessment}
+\begin{figure}\label{trajectory}
+\includegraphics[width=6.5in]{trajectoryjpg}
+\caption{Web-rendering of the same LON-CAPA problem for two different students.}
+\end{figure}
+
+\begin{figure}\label{threemasses}
+\includegraphics[width=6.5in]{threemassesjpg}
+\caption{Web-rendering of the same LON-CAPA problem for two different students.}
+\end{figure}
+\section{Hypotheses}
 
 
-\begin{figure}\label{twoproblems}
+\section{Background and Environment}
+\subsection{PI Education and Appointments}
+Dr. Kortemeyer received his Diplom (ÒM.Sc.Ó) in physics in 1993 from the UniversitŠt Hannover, Germany (Advisor Prof. P. U. Sauer), and his Ph.D. in physics from Michigan State University in 1997 (Advisor Prof. W. Bauer).He has been working at Michigan State University since 1997. His first appointment has been as an Academic Specialist in the Division of Science and Mathematics Education (DSME), where he has been leading instructional technology development projects for the College of Natural Science, and is the director of the Learning{\it Online} Network with Computer-Assisted Personalized Approach (LON-CAPA) project, see section~\ref{loncapa}.  He also taught introductory physics in a completely online mode, as well as co-taught in a more traditional on-campus setting.
+
+Starting August 2004, Dr. Kortemeyer will be working in a tenure-track position as Assistant Professor of Physics Education. His appointment will be split 75/25\% between the Lyman Briggs School of Science (LBS) and DSME. He will also be holding an appointment as Adjunct Professor of Physics in the Department of Physics and Astronomy. His teaching responsibilities will include the introductory calculus-based physics sequence (lecture and lab) in LBS, as well as seminars in special topics. His research will be focused on postsecondary science teaching and learning, with a special emphasis on the use of technology.\subsection{Michigan State University}Michigan State University is one of the earliest land-grant institutions in the United States. MSU is committed to providing equal educational opportunity to all qualified applicants; at the undergraduate level, the university offers comprehensive programs in the liberal arts and sciences, and provides opportunities for students of varying interests, abilities, backgrounds, and expectations.  The total enrollment is approximately 44,000, 35,000 of which are undergraduates. 54 percent of the student population are women, 8.1 percent African American, 5.1 percent Asian/Pacific Islander, 2.8 percent Chicano/Other Hispanic, and 0.6 percent Native American. Of the freshman class, the average high school GPA is 3.58.\subsection{Lyman Briggs School of Science}The Lyman Briggs School (LBS) at Michigan State University is a residential learning community devoted to studying the natural sciences and their impact on society. All under one roof, LBS encompasses physics, chemistry, biology, and computer laboratories; classrooms; faculty, administrative, and academic support staff offices; student residences; a dining hall; and a convenience store. With approximately 1500 students, LBS offers the benefits of a small, liberal arts college with the resources of a large research university.\subsection{Division of Science and Mathematics Education}The Division of Science and Mathematics Education (DSME) was founded at Michigan State University in 1989, and is co-administered by the College of Natural Science and the College of Education. Academic specialists and faculty members with partial appointments in various departments and other colleges, graduate and undergraduate students, and professional and clerical staff work together in DSME to conduct a variety of research projects, as well as to offer courses, degree programs, and other activities in support of its mission.
+\subsection{Model System: The LearningOnline Network with CAPA}\label{loncapa}For several of the proposed project, the LearningOnline Network with Computer-Assisted Personalized Approach (LON-CAPA) will be the model system. Dr. Kortemeyer is the director of the LON-CAPA project. LON-CAPA is an open-source freeware distributed learning content management, course management, and assessment system. LON-CAPA is the model system of the current NSF-ITR grant Investigation of a Model for Online Resource Creation and Sharing in Educational Settings (\#0085921, \$2,055,000, September 15, 2000 through July 31, 2005).\subsubsection{Shared Distributed Content Repository}Within the ITR project, LON-CAPA evolved into a mature system, which spans 35 institutions of secondary and postsecondary education, serves over 23,000 learners every semester, and holds over 60,000 online learning resources, mostly in the STEM areas.LON-CAPA is designed around the concept of easy sharing and re-use of learning resources. The ITR research showed that this is only possible by integrating all layers of the infrastructure to give instructors a seamless user experience: pure library systems, such as NSDL, do not offer instructors the ability to in one system:\begin{enumerate}
+\item locate existing content\item generate and publish new content\item enforce secure digital rights management
+\item assemble (sequence) content\item deploy the assembled content in a complete course management system\item have continual assessment of the learning content quality, both subjective and objective\end{enumerate}In addition, the system has to be highly scalable, and avoid single points of failure.In LON-CAPA, the underlying distributed content repository spans all servers in a given cluster. Navigation through selected resources is provided by an internal sequencing tool, which allows assembling, re-using, and re-purposing content at different levels of granularity (pages, lessons, modules, chapters, etc). LON-CAPA provides highly customizable access control on resources, and has a built-in key mechanism to charge for content access. The shared content pool of LON-CAPA currently contains over 60,000 learning resources, including more than 18,000 personalized homework problems.The network provides constant assessment of the resource quality through objective and subjective dynamic metadata. Selection of a learning resource by instructors at other institutions while constructing a learning module does both establish a de-facto peer-review mechanism and provide additional context information for each resource. In addition, access statistics are being kept, and learners can put evaluation information on each resources. A large fraction of these resources are also available through the gateway to the National Science Digital Library. In addition, the problem supplements to a number of commercial textbooks are available in LON-CAPA format.Disciplines include astronomy, biology, business, chemistry, civil engineering, computer science, family and child ecology, geology, human food and nutrition, human medicine, mathematics, medical technology, physics, and psychology.LON-CAPA supports multilingual content resources, and its user interface has been localized in Arabic, Farsi, French, German, Japanese, Portuguese, Russian, and Turkish. \subsubsection{Formative and Summative Assessment}LON-CAPA started in 1992 as a system to give personalized homework to students in introductory physics courses.  ÒPersonalized" means that each student sees a slightly different computer-generated problem: different numbers in numerical problems, different choices in multiple choice-type problems, different graphs, images, simulation parameters, etc, Fig.~\ref{twoproblems}.\begin{figure}\label{twoproblems}
 \includegraphics[width=6.5in]{atwood}
 \caption{Web-rendering of the same LON-CAPA problem for two different students.}
-\end{figure}
+\end{figure}Students can thus discuss the problems and collaborate on finding solutions, but not simply exchange the answers. 
+\subsubsection{Course Management}Over the years, the system added a learning content management system and standard course management features, such as communications, gradebook, etc., which are comparable to commercial course management systems, such as BlackBoard, WebCT, or ANGEL. See http://www.lon-capa.org/features.html and http://www.edutools.info/course/compare/ for an overview of features, and comparisons to other systems.In addition to standard features, the LON-CAPA delivery and course management layer is designed around STEM education, for example:
+\begin{itemize}\item support for mathematical typesetting throughout (\LaTeX\ inside of XML) Ð formulas are rendered on-the-fly, and can be algorithmically modified through the use of variables inside formulas.\item integrated GNUplot support, such that graphs can be rendered on-the-fly, and allowing additional layered labeling of graphs and images\item support for multi-dimensional symbolic math answers\item full support of physical units\end{itemize}
+\subsubsection{Open-Source Freeware}LON-CAPAÕs core development group is located at Michigan State University, and in addition to faculty members, has a staff of three fulltime programmers, two user support staff, one technician, one graduate student, and one project coordinator. LON-CAPA is open-source (GNU General Public License) freeware, there are no licensing costs associated. The LON-CAPA group offers training and support, as well as hosting.
 
 
 \begin{figure}\label{conceptproblems}
@@ -121,6 +166,10 @@
 \caption{Traditional and "conceptual" LON-CAPA physics problem.}
 \end{figure}
 
+
+\section{Results from Prior NSF Support}
+Gerd Kortemeyer is PI on the current NSF-ITR grant Investigation of a Model for Online Resource Creation and Sharing in Educational Settings (\#0085921, \$2,055,000, September 15, 2000 through July 31, 2005), which uses LON-CAPA as its model system. The project is designed to address questions of resource pooling and sharing across content areas. The investigators are incubating a multi-institutional collaboration and bring together stakeholders to address content issues such as reuse, customization, online community building, quality, and effectiveness. The project currently has more than 30 participating institutions, and continues to study the formation of its online collaborative community, including workshops, conferences, support, evaluation, and dissemination. The project maintains a gateway server to the National STEM Digital Library, and the LON-CAPA shared resource pool is searchable and accessible from http://nsdl.org/. Gerd Kortemeyer is Co-PIs on the current NSF-CCLI-ASA grant Diagnostic Question Clusters: Development and Testing in Introductory Geology and Biology (\#0243126, \$491,606, September 15, 2003 through August 31, 2006) to develop diagnostic questions for college students in both biology and geology. In the ASA project, a pool of peer-reviewed, diagnostic question clusters to assess students' understanding will be developed, including tools for analysis, peer review, and online publication of these question clusters.
+
 % references
 \newpage
 
@@ -128,11 +177,25 @@
 \begin{thebibliography}{99}
 \bibitem{feynmanCharacter} Richard Feynman, {\it The Character of Physical Law}, The MIT Press, ISBN 0 262 56003 8 (1967)
 \bibitem{student} Student online discussion contribution, "Introductory Physics for Scientists and Engineers," phy183, Michigan State University (2004)
+\bibitem{heuvelen} Alan Van Heuvelen, {\it Learning to think like a physicist: A review of research-based instructional strategies}, Am. J. Phys. {\bf 59}(10), 891-897 (1991)
 \bibitem{redish} Edward F. (Joe) Redish, {\it Teaching Physics}, Wiley, ISBN 0-471-39378-9 (2003)
+\bibitem{fuller} Robert G. Fuller, {\it Solving physics problems --- how do we do it?}, Phys. Today {\bf  35}(9), 43-47 (1982)
+\bibitem{bransford} John D. Bransford, Ann L. Brown, and Rodney R. Cocking (editors), {\it How people learn (expanded edition)}, National Research Council, ISBN 0-309-07036-8 (2000)
+\bibitem{pellegrino} James. W. Pellegrino, Naomi Chudowsky, and Robert Glaser (editors), {\it Knowing what students know}, National Academy Press, ISBN 0-309-07272-7 (2001)
+\bibitem{lin} Herbert Lin, {\it Learning physics vs. passing courses}, Phys. Teach. {\bf 20}, 151-157 (1982)
 \bibitem{fci} D. Hestenes, M. Wells, and G. Swackhamer, {\it Force Concept Inventory}, Phys. Teach. {\bf 30}, 141-158 (1992)
+\bibitem{steinberg} Richard Steinberg, {\it Performance on Multiple-Choice Diagnostics and Complementary Exam Problems}, Phys. Teach {\bf 35}(3), 150-155.
 \bibitem{mazur} Eric Mazur, {\it Peer Instruction}, Prentice Hall, ISBN 0-13-565441-b (1997)
 \bibitem{chi} Michelene T. H. Chi, Paul J. Feltovich, Robert Glaser, {\it Categorization and Representation of Physics Problems by Experts and Novices}, Cognitive Science, Vol 5, p121-152 (1981)
 \bibitem{larkin} J. Larkin, J. McDermott, D. P. Simon, and H. A. Simon,  {\it Expert and novice performance in solving physics problems}, Science {\bf 208} 1335-1342 (1980)
+\bibitem{reif} Frederick Reif, {\it Teaching problem solving --- A scientific approach}, Phys. Teach. {\bf 19}, 310-316 (1981)
+\bibitem{mazur96} Eric Mazur, {\it The Problem with Problems}, Optics and Photonics News {\bf 6}, 59-60 (1996)
+\bibitem{hammer} David Hammer, {\it More than misconceptions: Multiple perspectives on student knowledge and reasoning, and an appropriate role for education research}, Am. J. Phys. {\bf 64}, 1316-1325 (1996)
+\bibitem{thoennessen} M. Thoennessen and M. J. Harrison, {\it Computer-Assisted Assignments in a Large Physics Class}, Comp. Educ. {\bf 27}, 141 (1996)
+\bibitem{kashy00} E. Kashy, M. Thoennessen Y. Tsai, N. E. Davis, and G. Albertelli II, {\it Melding Network Technology with Traditional Teaching: Enhanced Achievement in a 500-Student Course}, Chapter in {\it Interactive Learning: Vignettes from America's Most Wired Campuses}, 
+David G. Brown (editor), Anker Publishing Company, Boston, 51, ISBN 1-882982-29-0 (2000)
+
+
 \bibitem{torigoe} Eugene Torigoe, {\it Student Difficulties with Equations in Physics}, ISAAPT Spring Meeting, Urbana, IL, (April 2004)\bibitem{clement} J. Clement, J. Lochhead, and G. S. Monk, {\it Translation difficulties in learning mathematics}, Amer. Math. Mon. {\bf 88}, 286 (1981)
 \bibitem{hewitt} Paul G. Hewitt, {\it Conceptual Physics}, Little, Brown, ISBN 0 673 39541 3
 \bibitem{feynmanLectures} Richard Feynman, Robert B. Leighton, and Matthew L. Sands, {\it The Feynman Lectures on Physics}, Addison-Wesley, ISBN 0-201-5100(3,4,5)-(0,9,0) (1963-65)

--www1089249933--