| Lines 12-18 were replaced by lines 12-18 |
| - |8|Is there a difference in course grades between sections? (e.g. Different sections could be taught by different TAs, at different times, etc)|Correlation between section and individual assessment (or assessment items)/course grades (or between TA and section grades)|Registrar demographic data\\Faculty uploaded assessments and rubric for each year, tagged by topic\\Faculty uploaded spreadsheet with: Student exam scores; Student grades on individual assessment items|Log-in as myself, check-off my courses that I am interested in analyzing|Demographic data\\Exam scores from multiple sections\\Individual assessment items from multiple sections\\Student scores on individual assessment items from multiple sections |
| - |9|How do my students compare with students from another school on topic x?|Correlation between institution and grade on topic x.|Registrar demographic data\\Faculty uploaded assessments and rubrics, tagged by topic\\Faculty uploaded spreadsheet with: Student exam scores; Student grades on individual assessment items\\Metadata linking course to a particular type/sized institution|Log-in as myself, check off my courses that I am interested in analyzing\\Select my assessment items from topic x\\Search database for additional school to analyze that are similar in Carnegie categorization, similar in course size, all schools\\Search these assessments for items on topic x|Demographic data\\Individual assessment items on topic x.\\Exam on topic x.\\Student scores on individual assessment items and/or exam on topic x. |
| - |10| For accreditation, I would like to show that our students have learned y.|Comparison of student performance at T0 and T1.|Registrar demographic data\\Faculty uploaded assessments and rubric, tagged with topic and Bloom’s data\\Faculty uploaded spreadsheet with: Student exam scores for each year; Student grades on individual assessment items for each year|Log-in as myself, check off my courses that I am interested in analyzing\\Select my assessment items from topic x|Demographic data\\Assessments or assessment items on y.\\ Rubric for assessments or assessment items on y.\\ Student response data for assessments or assessment items.\\Student scores for assessments or assessment items on y. |
| - |11| What levels of understanding are typically targeted by assessments in introductory (or upper) level biology courses at my institution/at institutions similar to mine/at all institutions?|Proportion of lower-level Bloom’s items to higher-level Bloom’s items\\Histogram of data| Faculty uploaded assessments, tagged by Bloom’s data\\Metadata form tagging course level, institution information (size, type)|Search for all assessment items in courses at the 100-level|Bloom’s data for individual assessment items in introductory courses at a particular institution(s)/across institutions |
| - |12| What misconceptions do students generally hold about topic d?|Qualitative analysis of student responses and scores to parse out misconceptions| Registrar demographic data\\Faculty uploaded assessments tagged with topic and Bloom’s data| Search for all assessment items on topic d|Demographic data\\Assessment items on topic d (if multiple choice, must include the foils)\\Rubric for assessment items on topic d\\Student responses\\Student scores |
| - |13| What is the impact of course size on the assessments used?|Correlation between course size and Bloom’s taxonomy level| Registrar demographic data\\Faculty uploaded assessments tagged with topic and Bloom’s data\\Metadata form indicating course size|Search for courses of a particular size|Demographic data\\Course size\\Institution size or Carnegie Classification\\Majors or non-majors course\\Bloom’s taxonomy level |
| - |14| Are low performers in my course also struggling in other courses?|Correlation between course grade or individual assessment grade and university GPA, major GPA| Registrar demographic data\\Registrar GPA data\\Faculty uploaded spreadsheet with student course grades| Log-in as myself, check off my courses that I am interested in analyzing| Demographic data\\Course or assessment grades by students\\University GPA\\Major GPA |
| + |8|Is there a difference in course grades between sections? (e.g. Different sections could be taught by different TAs, at different times, etc)|Correlation between section and individual assessment (or assessment items)/course grades (or between TA and section grades)|Registrar demographic data\\Faculty uploaded assessments and rubric for each year, tagged by topic\\Faculty uploaded spreadsheet with: Student exam scores; Student grades on individual assessment items|Log-in as myself, check-off my courses that I am interested in analyzing |
| + |9|How do my students compare with students from another school on topic x?|Correlation between institution and grade on topic x.|Registrar demographic data\\Faculty uploaded assessments and rubrics, tagged by topic\\Faculty uploaded spreadsheet with: Student exam scores; Student grades on individual assessment items\\Metadata linking course to a particular type/sized institution|Log-in as myself, check off my courses that I am interested in analyzing\\Select my assessment items from topic x\\Search database for additional school to analyze that are similar in Carnegie categorization, similar in course size, all schools\\Search these assessments for items on topic x |
| + |10| For accreditation, I would like to show that our students have learned y.|Comparison of student performance at T0 and T1.|Registrar demographic data\\Faculty uploaded assessments and rubric, tagged with topic and Bloom’s data\\Faculty uploaded spreadsheet with: Student exam scores for each year; Student grades on individual assessment items for each year|Log-in as myself, check off my courses that I am interested in analyzing\\Select my assessment items from topic x |
| + |11| What levels of understanding are typically targeted by assessments in introductory (or upper) level biology courses at my institution/at institutions similar to mine/at all institutions?|Proportion of lower-level Bloom’s items to higher-level Bloom’s items\\Histogram of data| Faculty uploaded assessments, tagged by Bloom’s data\\Metadata form tagging course level, institution information (size, type)|Search for all assessment items in courses at the 100-level |
| + |12| What misconceptions do students generally hold about topic d?|Qualitative analysis of student responses and scores to parse out misconceptions| Registrar demographic data\\Faculty uploaded assessments tagged with topic and Bloom’s data| Search for all assessment items on topic d |
| + |13| What is the impact of course size on the assessments used?|Correlation between course size and Bloom’s taxonomy level| Registrar demographic data\\Faculty uploaded assessments tagged with topic and Bloom’s data\\Metadata form indicating course size|Search for courses of a particular size |
| + |14| Are low performers in my course also struggling in other courses?|Correlation between course grade or individual assessment grade and university GPA, major GPA| Registrar demographic data\\Registrar GPA data\\Faculty uploaded spreadsheet with student course grades| Log-in as myself, check off my courses that I am interested in analyzing |
