FIRST

2009-06-10T13:49:55Z

uid=momsenj,o=MSU changed this page on Wed Jun 10 06:49:55 PDT 2009:

Lines 2-3 were replaced by lines 2-3

- #develop faculty expertise in assessing student learning; and,

- #evaluate innovations based on analyses of these data. \\

+ #developing faculty expertise in assessing student learning; and,

+ #evaluating innovations based on analyses of these data. \\

Dissemination

2009-01-07T19:11:18Z

uid=momsenj,o=MSU changed this page on Wed Jan 07 11:11:18 PST 2009:

Line 41 was replaced by line 41

- |July 31, 2008|Ellie Poley, Bridger Hamilton, Gabe Larriuz|

Use_case

2008-09-19T00:29:23Z

uid=leinfelder,o=NCEAS changed this page on Thu Sep 18 17:29:23 PDT 2008:

 Lines 5-41 were replaced by lines 5-41
-- ||No.||Meeting Date||Use Case Description||Decision Made?||dBase as Test Bank||User training/\\documentation||Content metadata||Course Metadata||Query related||System Requirement||Must/Should/Nice to have
-- |1|April 13, 2007\\September 18, 2007\\June 19, 2007|[Tagging assessment items|Use Case 3]: with Blooms data, concept categories, learning objective, some other taxonomy\\tag in multiple ways\\tag with multiple raters|yes - will support| | |x| | | |Must
-- |2|July 3, 2007|[Assessment items will be tagged according to a domain specific ontology|Use Case 4]\\Biology ontology: NBII Biocomplexity Thesaurus\\Ontologies must not be rigid -- must allow for additions.|yes - will support|x| |x| |x| |Must
-- |3|February 4, 2007\\MU-L\\JLM|[Rubrics|Use Case 5]: database must support multiple rubrics for an assessment item\\multiple scores for an assessment item\\multiple raters of an assessment item|yes - will support|x| |x| | | |Must
-- |4|April 13, 2007|[Data storage|Use Case 11]: Must store raw response data for assessment items\\point values for assessment items and assessments (i.e., entire exams)\\student grade on assessment item|yes - will support| | |x| | | |Must
-- |5|December 4, 2007|[Data return format|Use Case 6]: rectangular|yes - will support| | | | | |x|Must
-- |6|February 4, 2008|[Return of assessment items|Use Case 12]: We will use a shopping cart model for users to choose assessment items\\Returned questions will be in QTI format; faculty can use other software to translate to exam|pending|x| | |x| | |Must
-- |7|May 18, 2007\\October 9, 2007|[Data upload|Use Case 13]: non-MC exams and student responses.\\Student responses are a scanned image -or- electronic.|yes - will support| | | | | | |Must
-- |8|February 7, 2008|[Security|Use Case 7]: Faculty who upload data must agree that any identifying information in student responses has been removed\\any identifying information in their syllabus that they do not wish to be published in the dBase has been removed.|yes - will support -- how?| | | | | |x|Must
-- |9|April 13, 2007\\May 4, 2007|[Security|Use Case 7]: Student ids will be hashed with a unique identifier\\Faculty and university ids could also be hashed.\\data is returned completely anonymous\\queries are constrained so as to not return a limited dataset that could identify a student.|yes - will support| | | | |x|x|Must
-- |10|July 3, 2007\\November 6, 2007|I have [additional data/metadata|Use Case 14] I would like to upload. Where can I do that?|yes - will support|x|x|x|x| | |Must
-- |11|February 18, 2008\\MU-L\\JLM|[Editing environment|Use Case 15] for data: how can faculty fix errors in data they have uploaded?|yes - will support| | | | | |x|Must
-- |12|April 13, 2007\\September 18, 2007\\KBS|[Minimum metadata requirements|Use Case 8]|yes - will support\\have been defined| | | | | |x|Must
-- |13|May 4, 2007|I would like to [import student response data|Use Case 16] directly from my excel workbook|yes - will support| | | | | |x|Must
-- |14|June 19, 2007|[Demographic data|Use Case 9] will be available for all queries.\\Faculty uploaded demographic data must be tagged with the date they were current.|yes - will support| | | |x| | |Must
-- |15|August 30, 2007|The database must handle [multiple instructors|Use Case 17] for a class.|no| | | |x|x| |Must
-- |16|August 30, 2007|Faculty members must be able to indicate pages on an exam that are blank, devoted to a figure, picture or formula|yes - completed?| | | | | |x|Must
-- |17|September 11, 2007|Database will treat [sections of a course as separate courses|Use Case 18].\\How can we alleviate work for a faculty member uploading the same assessment for 60 sections of a very large course?|yes| | | |x|x| |Must
-- |18|October 9, 2007|[Query: track students over time.|Use Case 10]|yes - will support| | | |x|x| |Must
-- |19|May 18, 2007\\June 19, 2007|Metadata query: Query for common misconceptions|yes - will support|x| |x| | | |Must
-- |20|July 31, 2007|[Non-traditional assessments|Use Case 19]: Scientific reasoning instruments, concept inventories, published assessment\\Assessment items will not fit a discipline-based ontology|yes|x|x|x| |x| |Must
-- |21|June 12, 2007|I would like to [query across data levels|Use Case 20] (i.e. query for particular assessment items at an institution over time and courses|yes - will support| | |x|x|x| |Must
-- |22|August 30, 2007|There will be two levels of data access: Private (visible only to the individual who uploaded the data) and Public (visible to all registered users)|yes - will support|x|x| | | | |Should
-- |23|November 6, 2007|Multiple taxonomies: the database will support multiple taxonomies. All taxonomies will be viewable by all registered users; however, some taxonomies can only be implemented by specific individuals (e.g., professional society tags of 'good' assessment items)|yes - will support|x| |x| |x| |Should
-- |24|December 4, 2007|Query: Search database on a paticular type of institution, based on the Carnegie classification system.|pending| | | | |x| |Should
-- |25|December 4, 2007|Save search history syntax in order to repeat search at some point in the future.\\Alternatively, return search syntax with query results.|pending| | | | |x|x|Should
-- |26|KBS|I would like to filter out low-level Bloom questions, multiple choice questions, essay questions, etc.|pending| x| | | |x| |Should
-- |27|KBS|Fostering collaboration: Faculty contact information will be available for all faculty who opt to provide such information.|yes - will support| | |x|x|x| |Should
-- |28|KBS|Unconventional assessment items: database will store the item\\Student response data (excel, word files, etc) will also be stored.|yes - will support|x| | | | |x|Nice
-- |29|November 6, 2007|I have no idea how to classify my assessment items.|no| |x| | | | |Nice
-- |30|May 18, 2007|Query: Find questions based on format (clicker, mc, short answer, etc)\\Find questions that include a particular format element (graph, image, model)|pending -- can this information be gleaned from the parsing software?|x| |x| |x| |Nice
-- |31|June 19, 2007|Query: What concepts are considered difficult across disciplines.  Will the database compute dynamic metadata such as the difficulty of an item? Such data  would change based on the data from the students.  Difficulty and other performance metrics should be dynamic, rather than asking faculty to upload them.|pending - will we provide simple analysis?|x| |x| |x| |Nice
-- |32|December 4, 2007|Data analysis: simple analysis of change over time returned with the data.|pending| | | |x|x| |Nice
-- |33|January 10, 2008|Syllabus: Will not be query-able and will only be anonymous if the faculty uploading removes identifying information.|yes - will support| | | |x| | |Nice
-- |34|Purdue|Who can access data across courses/faculty members? Adiminstrator use to demonstrate compliance of accreditation standards.|pending| | | | | | |Nice
-- |35|November 27, 2007|User will be able to search nbii thesaurus and with a mouse click, add that concept tag to their assessment item(s).|yes?|x| |x| | | |Nice
-- |36|April 13, 2007|I would like to import data directly from my course management software (e.g. Angel, Blackboard, WebCT, etc)|outside current scope| | | | | |x|Nice
++ ||No.||Status||Meeting Date||Use Case Description||Decision Made?||dBase as Test Bank||User training/\\documentation||Content metadata||Course Metadata||Query related||System Requirement||Must/Should/Nice to have
++ |1|partial|April 13, 2007\\September 18, 2007\\June 19, 2007|[Tagging assessment items|Use Case 3]: with Blooms data, concept categories, learning objective, some other taxonomy\\tag in multiple ways\\tag with multiple raters|yes - will support| | |x| | | |Must
++ |2|partial|July 3, 2007|[Assessment items will be tagged according to a domain specific ontology|Use Case 4]\\Biology ontology: NBII Biocomplexity Thesaurus\\Ontologies must not be rigid -- must allow for additions.|yes - will support|x| |x| |x| |Must
++ |3|drop|February 4, 2007\\MU-L\\JLM|[Rubrics|Use Case 5]: database must support multiple rubrics for an assessment item\\multiple scores for an assessment item\\multiple raters of an assessment item|yes - will support|x| |x| | | |Must
++ |4|partial|April 13, 2007|[Data storage|Use Case 11]: Must store raw response data for assessment items\\point values for assessment items and assessments (i.e., entire exams)\\student grade on assessment item|yes - will support| | |x| | | |Must
++ |5|complete|December 4, 2007|[Data return format|Use Case 6]: rectangular|yes - will support| | | | | |x|Must
++ |6|incomplete|February 4, 2008|[Return of assessment items|Use Case 12]: We will use a shopping cart model for users to choose assessment items\\Returned questions will be in QTI format; faculty can use other software to translate to exam|pending|x| | |x| | |Must
++ |7|incomplete|May 18, 2007\\October 9, 2007|[Data upload|Use Case 13]: non-MC exams and student responses.\\Student responses are a scanned image -or- electronic.|yes - will support| | | | | | |Must
++ |8|complete|February 7, 2008|[Security|Use Case 7]: Faculty who upload data must agree that any identifying information in student responses has been removed\\any identifying information in their syllabus that they do not wish to be published in the dBase has been removed.|yes - will support -- how?| | | | | |x|Must
++ |9|complete|April 13, 2007\\May 4, 2007|[Security|Use Case 7]: Student ids will be hashed with a unique identifier\\Faculty and university ids could also be hashed.\\data is returned completely anonymous\\queries are constrained so as to not return a limited dataset that could identify a student.|yes - will support| | | | |x|x|Must
++ |10|partial|July 3, 2007\\November 6, 2007|I have [additional data/metadata|Use Case 14] I would like to upload. Where can I do that?|yes - will support|x|x|x|x| | |Must
++ |11|verify|February 18, 2008\\MU-L\\JLM|[Editing environment|Use Case 15] for data: how can faculty fix errors in data they have uploaded?|yes - will support| | | | | |x|Must
++ |12|complete|April 13, 2007\\September 18, 2007\\KBS|[Minimum metadata requirements|Use Case 8]|yes - will support\\have been defined| | | | | |x|Must
++ |13|complete|May 4, 2007|I would like to [import student response data|Use Case 16] directly from my excel workbook|yes - will support| | | | | |x|Must
++ |14|incomplete|June 19, 2007|[Demographic data|Use Case 9] will be available for all queries.\\Faculty uploaded demographic data must be tagged with the date they were current.|yes - will support| | | |x| | |Must
++ |15|complete|August 30, 2007|The database must handle [multiple instructors|Use Case 17] for a class.|no| | | |x|x| |Must
++ |16|complete|August 30, 2007|Faculty members must be able to indicate pages on an exam that are blank, devoted to a figure, picture or formula|yes - completed?| | | | | |x|Must
++ |17|complete|September 11, 2007|Database will treat [sections of a course as separate courses|Use Case 18].\\How can we alleviate work for a faculty member uploading the same assessment for 60 sections of a very large course?|yes| | | |x|x| |Must
++ |18|complete|October 9, 2007|[Query: track students over time.|Use Case 10]|yes - will support| | | |x|x| |Must
++ |19|drop|May 18, 2007\\June 19, 2007|Metadata query: Query for common misconceptions|yes - will support|x| |x| | | |Must
++ |20|complete|July 31, 2007|[Non-traditional assessments|Use Case 19]: Scientific reasoning instruments, concept inventories, published assessment\\Assessment items will not fit a discipline-based ontology|yes|x|x|x| |x| |Must
++ |21|partial|June 12, 2007|I would like to [query across data levels|Use Case 20] (i.e. query for particular assessment items at an institution over time and courses|yes - will support| | |x|x|x| |Must
++ |22|partial|August 30, 2007|There will be two levels of data access: Private (visible only to the individual who uploaded the data) and Public (visible to all registered users)|yes - will support|x|x| | | | |Should
++ |23|-|November 6, 2007|Multiple taxonomies: the database will support multiple taxonomies. All taxonomies will be viewable by all registered users; however, some taxonomies can only be implemented by specific individuals (e.g., professional society tags of 'good' assessment items)|yes - will support|x| |x| |x| |Should
++ |24|-|December 4, 2007|Query: Search database on a paticular type of institution, based on the Carnegie classification system.|pending| | | | |x| |Should
++ |25|-|December 4, 2007|Save search history syntax in order to repeat search at some point in the future.\\Alternatively, return search syntax with query results.|pending| | | | |x|x|Should
++ |26|-|KBS|I would like to filter out low-level Bloom questions, multiple choice questions, essay questions, etc.|pending| x| | | |x| |Should
++ |27|-|KBS|Fostering collaboration: Faculty contact information will be available for all faculty who opt to provide such information.|yes - will support| | |x|x|x| |Should
++ |28|-|KBS|Unconventional assessment items: database will store the item\\Student response data (excel, word files, etc) will also be stored.|yes - will support|x| | | | |x|Nice
++ |29|-|November 6, 2007|I have no idea how to classify my assessment items.|no| |x| | | | |Nice
++ |30|-|May 18, 2007|Query: Find questions based on format (clicker, mc, short answer, etc)\\Find questions that include a particular format element (graph, image, model)|pending -- can this information be gleaned from the parsing software?|x| |x| |x| |Nice
++ |31|-|June 19, 2007|Query: What concepts are considered difficult across disciplines.  Will the database compute dynamic metadata such as the difficulty of an item? Such data  would change based on the data from the students.  Difficulty and other performance metrics should be dynamic, rather than asking faculty to upload them.|pending - will we provide simple analysis?|x| |x| |x| |Nice
++ |32|-|December 4, 2007|Data analysis: simple analysis of change over time returned with the data.|pending| | | |x|x| |Nice
++ |33|-|January 10, 2008|Syllabus: Will not be query-able and will only be anonymous if the faculty uploading removes identifying information.|yes - will support| | | |x| | |Nice
++ |34|-|Purdue|Who can access data across courses/faculty members? Adiminstrator use to demonstrate compliance of accreditation standards.|pending| | | | | | |Nice
++ |35|-|November 27, 2007|User will be able to search nbii thesaurus and with a mouse click, add that concept tag to their assessment item(s).|yes?|x| |x| | | |Nice
++ |36|-|April 13, 2007|I would like to import data directly from my course management software (e.g. Angel, Blackboard, WebCT, etc)|outside current scope| | | | | |x|Nice

Links

2008-08-28T14:44:06Z

uid=momsenj,o=MSU changed this page on Thu Aug 28 07:44:06 PDT 2008:

Line 5 was replaced by line 5

- * [Multiple-Institution Database for Investigating Engineering Longitudinal Development (MIDFIELD)at Purdue|https://engineering.purdue.edu/MIDFIELD/]

+ * [Multiple-Institution Database for Investigating Engineering Longitudinal Development (MIDFIELD) at Purdue|https://engineering.purdue.edu/MIDFIELD/]

People

2008-08-28T14:41:26Z

uid=momsenj,o=MSU changed this page on Thu Aug 28 07:41:26 PDT 2008:

Removed line 14

- All members of the FIRST Assessment Database Development team are involved in metadata development.

Line 16 was replaced by line 15

- !!Metadata Advisory Committee

+ !!Advisory Committee

BetaTesting

2008-08-28T14:40:56Z

uid=momsenj,o=MSU changed this page on Thu Aug 28 07:40:56 PDT 2008:

Line 9 was replaced by line 9

- #Using the database when completed.

+ #Using the database when completed

LeftMenu

2008-07-28T13:14:12Z

uid=momsenj,o=MSU changed this page on Mon Jul 28 06:14:12 PDT 2008:

At line 7 added 1 line.

+ *[Beta Testing|Beta Testing]

Downloads/morphoFirst-1.0alpha2.zip

2008-07-21T16:15:42Z

uid=leinfelder,o=NCEAS created this attachment on Mon Jul 21 09:15:42 PDT 2008

Downloads/morphoFirst-1.0alpha2.tar.gz

2008-07-21T16:13:06Z

uid=leinfelder,o=NCEAS created this attachment on Mon Jul 21 09:13:06 PDT 2008

IRB

2008-06-30T13:42:52Z

uid=momsenj,o=MSU changed this page on Mon Jun 30 06:42:52 PDT 2008:

Line 10 was replaced by line 10

- [Creative Commons|http://creativecommons.org/]

+ [Creative Commons|http://learn.creativecommons.org/]

Metadata

2008-06-26T18:25:04Z

uid=momsenj,o=MSU changed this page on Thu Jun 26 11:25:04 PDT 2008:

Removed line 5

- *Table of contents from Biology text (link to on-line version)

DatabaseDesign

2008-06-26T18:24:40Z

uid=momsenj,o=MSU changed this page on Thu Jun 26 11:24:40 PDT 2008:

At line 12 added 1 line.

+ [systems.png]

Removed line 14

DatabaseDesign/systems.png

2008-06-26T18:24:19Z

uid=momsenj,o=MSU uploaded a new version of this attachment on Thu Jun 26 11:24:19 PDT 2008

DatabaseDesign/sample_output.png

2008-06-26T18:23:05Z

uid=momsenj,o=MSU created this attachment on Thu Jun 26 11:23:05 PDT 2008

CopyrightNotes

2008-06-26T17:36:57Z

uid=momsenj,o=MSU changed this page on Thu Jun 26 10:36:57 PDT 2008:

Lines 1-2 were replaced by lines 1-2

- !Copyright issues and the FIRST Assessment Database\\

- Meeting between Jenni Momsen and Amy Blair, Copyright Librarian at MSU

+ !!Copyright issues and the FIRST Assessment Database\\

+ !Meeting between Jenni Momsen and Amy Blair, Copyright Librarian at MSU

FIRST-Wiki