| Line 37 was replaced by line 37 |
| - |April 13, 2007|I would like to import data directly from my course management software (e.g. Angel, Blackboard, WebCT, etc)|outside current scope| | | | | |x|Nice |
| + |April 13, 2007|I would like to import data directly from my course management software (e.g. Angel, Blackboard, WebCT, etc)|outside current scope| | | | | |x|Should |
| Lines 48-85 were replaced by lines 48-86 |
| - |June 19, 2007|I would like demographic data returned.|yes - will support| | | |x| | |
| - |June 19, 2007|I would like to see what concepts are considered difficult across disciplines. Are we going to compute dynamic meta data such as the difficulty of an item that would change based on the data from the students? Difficulty and other performance metrics should be dynamic, rather than asking faculty to upload them.|pending - will we provide simple analysis?|x| |x| |x| |
| - |July 3, 2007\\November 6, 2007|I have additional data/metadata I would like to upload. -or- I made a mistake. Where can I do that?|n/a|x|x|x|x| |
| - |July 3, 2007|Assessment items will be tagged according to an ontology, not by categories.|yes|x| |x| |x| |
| - |July 31, 2007|I would like to upload my scientific reasoning instrument.\\Questions do not fit a discipline-based ontology\\This instrument is administered at multiple institutions.|yes|x|x|x| |x |
| - |August 30, 2007|Each student, class, course, institution, faculty member must have a unique identifier.|yes - will support| | | | |x|x |
| - |August 30, 2007|Faculty members must be able to indicate pages on an exam that are blank, devoted to a figure, picture or formula|yes - completed?| | | | | |x |
| - |August 30, 2007|Who can access the database? (registered users, anyone? What level of data is returned?)|pending|x|x| | | |
| - |August 30, 2007|The database must handle multiple instructors for a class -and- visiting instructors (i.e. faculty who are not officially on staff at an institution)|no| | | |x|x| |
| - |September 11, 2007|Database must deal with multiple sections of a single course.|yes| | | |x|x| |
| - |October 9, 2007|Data is returned completely anonymized/partially anonymized/not anonymized.|pending| | | |x| |x |
| - |October 9, 2007|I would like to track a cohort of students over time.|yes - will support| | | |x|x| |
| - |November 6, 2007|Demographic data will be stored with individual assessments. Students will not have global identifiers.|pending - in contrast to immediate question above| | | |x|x| |
| - |November 6, 2007|Query returns must be constrained so as not to return a limited dataset that could result in the identification of a student.|yes - will support| | | |x|x| |
| - |November 6, 2007|I would like to find assessment items tagged as 'good' - search quality tags by a professional society.|yes - will support|x| |x| |x| |
| - |November 6, 2007|I have no idea how to classify my assessment items.|no| |x| |
| - |November 27, 2007|User will be able to search nbii thesaurus and with a mouse click, add that concept tag to their assessment item(s).|yes?|x| |x| | |
| - |November 27, 2007|Database will use the NBII Biocomplexity thesaurus as the Biology ontology.|yes|x| |x| | |
| - |November 27, 2007|Ontology for a discipline must not be rigid - additions must be possible.|yes?|x| |x| | |x |
| - |December 4, 2007|I would like data returned in a simple, rectangular format.|pending| | | | | |x |
| - |December 4, 2007|I would like data returned in some other format (what might those be?)|pending| | | | | |x |
| - |December 4, 2007|I would like to query all R1 institutions, based on the Carnegie classification system.|pending| | | | |x| |
| - |December 4, 2007|I would like a simple analysis of change over time returned with the data.|pending| | | |x|x| |
| - |December 4, 2007|I would like my search history saved. Are we saving the query syntax or are we expecting to be able to reproduce the exact dataset? Can probably reproduce the dataset if the date that the data were uploaded is stored in the database and can be made part of the query.|pending| | | | |x|x |
| - |December 4, 2007|I would like the details of my query returned with the results.|pending| | | | | |x |
| - |January 10, 2008|Instead of answering a litany of questions, I will upload my course syllabus.|pending| | | |x| |x |
| - |January 10, 2008|I would like my syllabus to be anonymized when uploaded.|pending| | | |x| | |
| - |February 4, 2008\\MU-L\\JLM|Will the syllabus be query-able? Doesn't seem likely. Need to revisit minimum metadata standards.|pending| |
| - |KBS|I would like to filter out low-level Bloom questions, multiple choice questions, essay questions, etc.|pending| x| | | |x| |
| - |KBS|I would like to find other faculty who are similar to me in teaching approach/assessment items/Bloom's level/etc.|pending| | |x|x|x| |
| - |KBS|I would like to upload a published assessment (e.g. Concept Inventory).|pending|x|x|x| | |
| - |KBS|Database must store unconventional assessments (models, pictures, diagrams, etc).|yes - will support|x| | | | |x |
| - |KBS|All data or a standard subset of data and metadata should be reported for each assessment item.|minimum metadata - pending| | | | |x|x |
| - |Purdue|I am an administrator and would like to use the database.|pending| |
| - |Purdue|Administrator: would like to compare faculty based on:\\-student scores\\-average Bloom level per exam\\-average number of students taught a semester\\-course level taught|n/a| | |x|x|x| |
| - |February 4, 2008\\MU-L\\JLM|Administrator would like to show their program has met specific accreditation standards.|n/a| | |x|x|x| |
| - |February 4, 2008\\MU-L|Must be able to use different content metadata by discipline. While we can use the NBII thesaurus for biology, we need to have an API that can be used to define other metadata for other disciplines.|yes - will support| | |x| | |x |
| - |February 4, 2008|How will assessment items be returned? Will users pick out one question at a time, or will they check off those questions they are interested in downloading? What format will questions be returned - xml, QTI, etc?|pending|x| | |x| |
| + |June 19, 2007|I would like demographic data returned.|yes - will support| | | |x| | |Must |
| + |June 19, 2007|I would like to see what concepts are considered difficult across disciplines. Are we going to compute dynamic meta data such as the difficulty of an item that would change based on the data from the students? Difficulty and other performance metrics should be dynamic, rather than asking faculty to upload them.|pending - will we provide simple analysis?|x| |x| |x| |Nice |
| + |July 3, 2007\\November 6, 2007|I have additional data/metadata I would like to upload. -or- I made a mistake. Where can I do that?|n/a|x|x|x|x| | |Nice |
| + |July 3, 2007|Assessment items will be tagged according to an ontology, not by categories.|yes|x| |x| |x| |Must |
| + |July 31, 2007|I would like to upload my scientific reasoning instrument.\\Questions do not fit a discipline-based ontology\\This instrument is administered at multiple institutions.|yes|x|x|x| |x| |Must |
| + |August 30, 2007|Each student, class, course, institution, faculty member must have a unique identifier.|yes - will support| | | | |x|x|Must |
| + |August 30, 2007|Faculty members must be able to indicate pages on an exam that are blank, devoted to a figure, picture or formula|yes - completed?| | | | | |x|Must |
| + |August 30, 2007|Who can access the database? (registered users, anyone? What level of data is returned?)|pending|x|x| | | | |Should |
| + |August 30, 2007|The database must handle multiple instructors for a class -and- visiting instructors (i.e. faculty who are not officially on staff at an institution)|no| | | |x|x| |Should |
| + |September 11, 2007|Database must deal with multiple sections of a single course.|yes| | | |x|x| |Must |
| + |October 9, 2007|Data is returned completely anonymized/partially anonymized/not anonymized.|yes - completely anonymized| | | |x| |x|Must |
| + |October 9, 2007|I would like to track a cohort of students over time.|yes - will support| | | |x|x| |Must |
| + |November 6, 2007|Demographic data will be stored with individual assessments. Students will not have global identifiers.|no - see question above| | | |x|x| |
| + |November 6, 2007|Query returns must be constrained so as not to return a limited dataset that could result in the identification of a student.|yes - will support| | | |x|x| |Must |
| + |November 6, 2007|I would like to find assessment items tagged as 'good' - search quality tags by a professional society.|yes - will support|x| |x| |x| |Should |
| + |November 6, 2007|I have no idea how to classify my assessment items.|no| |x| | | | |Must - user documentation |
| + |November 27, 2007|User will be able to search nbii thesaurus and with a mouse click, add that concept tag to their assessment item(s).|yes?|x| |x| | | |Should |
| + |November 27, 2007|Database will use the NBII Biocomplexity thesaurus as the Biology ontology.|yes|x| |x| | | |Must |
| + |November 27, 2007|Ontology for a discipline must not be rigid - additions must be possible.|yes?|x| |x| | |x|Must |
| + |December 4, 2007|I would like data returned in a simple, rectangular format.|pending| | | | | |x|Must |
| + |December 4, 2007|I would like data returned in some other format (what might those be?)|pending| | | | | |x|Must? |
| + |December 4, 2007|I would like to query all R1 institutions, based on the Carnegie classification system.|pending| | | | |x| |Should |
| + |December 4, 2007|I would like a simple analysis of change over time returned with the data.|pending| | | |x|x| |Nice |
| + |December 4, 2007|I would like my search history saved. Are we saving the query syntax or are we expecting to be able to reproduce the exact dataset? Can probably reproduce the dataset if the date that the data were uploaded is stored in the database and can be made part of the query.|pending| | | | |x|x|Should |
| + |December 4, 2007|I would like the details of my query returned with the results.|pending| | | | | |x|Should |
| + |January 10, 2008|Instead of answering a litany of questions, I will upload my course syllabus.|pending| | | |x| |x|Must |
| + |January 10, 2008|I would like my syllabus to be anonymized when uploaded.|pending| | | |x| | |Nice |
| + February 7, 2008|User uploading data takes responsibility for anonymizing their syllabus.|yes - will support| |x| | | | |Must |
| + |February 4, 2008\\MU-L\\JLM|Will the syllabus be query-able? Doesn't seem likely. Need to revisit minimum metadata standards.|pending| | | | | | |Nice |
| + |KBS|I would like to filter out low-level Bloom questions, multiple choice questions, essay questions, etc.|pending| x| | | |x| |Should |
| + |KBS|I would like to find other faculty who are similar to me in teaching approach/assessment items/Bloom's level/etc.|pending| | |x|x|x| |Should |
| + |KBS|I would like to upload a published assessment (e.g. Concept Inventory).|pending|x|x|x| | |Must |
| + |KBS|Database must store unconventional assessments (models, pictures, diagrams, etc).|yes - will support|x| | | | |x|Must |
| + |KBS|All data or a standard subset of data and metadata should be reported for each assessment item.|minimum metadata - pending| | | | |x|x|Must |
| + |Purdue|I am an administrator and would like to use the database.|pending| | | | | | |Nice |
| + |Purdue|Administrator: would like to compare faculty based on:\\-student scores\\-average Bloom level per exam\\-average number of students taught a semester\\-course level taught|n/a| | |x|x|x| |Nice |
| + |February 4, 2008\\MU-L\\JLM|Administrator would like to show their program has met specific accreditation standards.|n/a| | |x|x|x| |Should |
| + |February 4, 2008\\MU-L|Must be able to use different content metadata by discipline. While we can use the NBII thesaurus for biology, we need to have an API that can be used to define other metadata for other disciplines.|yes - will support| | |x| | |x|Must |
| + |February 4, 2008|How will assessment items be returned? Will users pick out one question at a time, or will they check off those questions they are interested in downloading? What format will questions be returned - xml, QTI, etc?|pending|x| | |x| | |Must |
