MERLOT Evaluation Standards for Mathematics
The following information is provided for users and authors of MERLOT-Mathematics to help them better understand the criteria used to evaluate items in the database and the Editorial Reviews. This information is also used to provide new reviewers the background necessary to quickly participate in the MERLOT Editorial Review process.
GENERAL CATEGORIES:
The three general categories for evaluation to be used within MERLOT-Mathematics:
- Quality of Content
- Effectiveness as a Teaching-Learning Tool
- Ease of Use
These three categories are interdependent to some degree, but separate ratings are given for each. The "Effectiveness" rating is given with respect to a specific use of the material (e.g., Lecture/Demo, Tutorial, Homework Assignment).
The goal for MERLOT-Mathematics Editorial Reviews is to provide information for users on the best material in the Mathematics Database. MERLOT reviewers have rated all material with Editorial Reviews as quality material, useful for instructors teaching these topics.
QUALITY OF CONTENT:
- Is the material factually correct?
- Is the textual material accurate and precise?
- Does the material follow standard mathematical notation and conventions?
- Does the material present important mathematical concepts?
- Is the content part of the core curriculum in mathematics?
- Is the content difficult to teach and/or learn?
- Is the content a pre-requisite for more advanced material?
- Does the material help develop conceptual understanding of mathematics?
- Is the material thought provoking as opposed to being a "cookbook" of methods?
- Does the material explore connections among various mathematical concepts?
- Does the material make effective use of graphics and multimedia?
- Are the graphics attractive?
- Do the graphics/media effectively illustrate mathematical concepts?
- Is the material flexible?
- Can the material be used to explore a range of different mathematical situations?
- Is there control over the initial state of the system?
- Is there control over the important parameters in a problem?
- Is the material modular so that it can be used in different ways?
EFFECTIVENESS AS A TEACHING-LEARNING TOOL: (Use Stated)
- Does the material improve faculty and students’ abilities to teach and learn?
- Does the material effectively demonstrate mathematical concepts?
- Is the material engaging, interactive, and/or entertaining?
- Does the material encourage students to generalize concepts or make predictions?
- Can the material be readily integrated into the mathematics curriculum?
- Does the material fit into standard presentations of mathematics?
- Can the material be used with standard textbooks or problems?
- Can the material be used in a variety of ways?
- Are there uses that the material is particularly well suited for? (e.g., lecture/demo, group projects, homework assignments, independent study or tutorials)
- Are there uses that the material is particularly poorly suited for? (e.g., lecture/demo, group projects, homework assignments, independent study or tutorials)
- Are the teaching-learning goals for the material easy to identify?
- Assessment.
- Are assessment tools included?
- Are assignments easily written?
EASE OF USE:
- Is the general layout of the material consistent and intuitive?
- Is the design attractive and inviting for students to use?
- Do buttons, sliders, and other elements have obvious uses and work well?
- Are input and output elements easy to understand, operate, and read?
- Does the material provide effective feedback?
- Is information displayed in a manner with which students will be familiar?
- Is information displayed in a graphical manner?
- Is feedback immediate, while users are interacting with the material?
- Is the material easy to navigate?
- What is the expected learning curve for students and faculty?
- Will students become lost or confused while using the material?
- Can the material be used by students with different levels of experience with computers and/or the web?
- Is the material documented and does it have useful instructions?
- Does the material include explanations, equations, or derivations?
- Are documentation and instructions available and easy to understand?
- Is there interactive or case-sensitive help?
- Is technical support necessary for either instructors or students?
- Have the authors described any technical problems with the material?