Test Your Students, Not Your Patience

Maik Meusel & Carlos Chida
University of Zurich

CellPrint[TextCell[Framed[Column[{Style["     Abstract",Italic,22,LightGray,FontFamily->"Helvetica Neue"],"",Style["      In this hands-on presentation we show how the Wolfram Language can be used to create computer based exams for higher education, and how they are distributed to students using the Wolfram Cloud. By means of individualization, randomization, and automated grading our assessment solution has various advantages compared to traditional paper and pencil exams: Not only that testing becomes much more efficient, the quality, accuracy, and fairness of exams is improved as well.",18,LightGray,FontFamily->"Helvetica Light"],"",Style["      Despite of sharing our experience with a first use case we want to discuss the potential of using Wolfram Technologies for assessment processes at universities. ",18,LightGray,FontFamily->"Helvetica Light"],"",Style["      Keywords: Higher Education, Wolfram Cloud",18,Black,FontFamily->"Helvetica Light"]},Alignment->Left],FrameMargins->{{10,40},{30,20}}],"Output",CellMargins->{{100,30},{20,10}}]]

Join the Conversation #WolframTechConf

Automated Testing & Grading with Mathematica

_Let students code or use tools to solve problems in the exams & tests   
_Prevent cheating by randomization & individualization of questions
_Identification & security: email and matriculation number authentication
_Automatic grading & reporting
_Give them individual feedback and let them compare to their peers

CellPrint@ExpressionCell[Row@{Button[Style["2013 EXAM",FontSize->25,FontColor->GrayLevel[1]],SystemOpen["Desktop/WTC2015_Materials/EM2013FE.Miftakhova_Alena.nb"],Appearance->None,Background->RGBColor[{Rational[37,51],Rational[2,85],Rational[4,85]}],Evaluator->Automatic,FrameMargins->{{17,17},{12,12}},Method->"Preemptive"],"  ",
Button[Style["2013 EXAM REPORT",FontSize->25,FontColor->GrayLevel[1]],SystemOpen["Desktop/WTC2015_Materials/EM2013_FinalGrades.nb"],Appearance->None,Background->RGBColor[{Rational[37,51],Rational[2,85],Rational[4,85]}],Evaluator->Automatic,FrameMargins->{{17,17},{12,12}},Method->"Preemptive"],"\n",
Button[Style["2015 ASSIGNMENT",FontSize->25,FontColor->GrayLevel[1]],SystemOpen["Desktop/WTC2015_Materials/EMBA3015_A3_Group20.nb"],Appearance->None,Background->RGBColor[{Rational[37,51],Rational[2,85],Rational[4,85]}],Evaluator->Automatic,FrameMargins->{{17,17},{12,12}},Method->"Preemptive"],"  ",
Button[Style["2015 ASSIGNMENT REPORT",FontSize->25,FontColor->GrayLevel[1]],SystemOpen["Desktop/WTC2015_Materials/EMBA2015_ReportA.2_JonasIten.pdf"],Appearance->None,Background->RGBColor[{Rational[37,51],Rational[2,85],Rational[4,85]}],Evaluator->Automatic,FrameMargins->{{17,17},{12,12}},Method->"Preemptive"],"\n"
},"Output",CellMargins->{{60,30},{20,10}}]

TAKE AWAYS

CellPrint[TextCell[Framed[Column[{

Row[{Style["   _",25,RGBColor[{185,12,6}/255],FontFamily->"Helvetica"],Style["Huge improvements of efficiency and accuracy",24,Black,FontFamily->"Helvetica"]},ImageSize->{700,27}],

Row[{Style["   _",25,RGBColor[{185,12,6}/255],FontFamily->"Helvetica"],Style["Robustness of files remains problematic!",24,Black,FontFamily->"Helvetica"]},ImageSize->{700,27}],

Row[{Style["   _",25,RGBColor[{185,12,6}/255],FontFamily->"Helvetica"],Style["File distribution causes troubles and additional efforts",24,Black,FontFamily->"Helvetica"]},ImageSize->{700,27}],

Row[{Style["   _",25,RGBColor[{185,12,6}/255],FontFamily->"Helvetica"],Style["Still potential to reduce admin efforts and achieve \n     higher level of integration",24,Black,FontFamily->"Helvetica"]},ImageSize->{700,55}]

}],Background->LightGray,FrameMargins->{{10,40},{30,20}},FrameStyle->LightGray],"Output",CellMargins->{{60,30},{20,10}}]]

Assessment in the Cloud

_Integrate assessment, reporting & courseware on a single platform
_Make testing independent of student computer‘s performance and licenses 
_Keep all individual data secure and separated

CellPrint@ExpressionCell[Row@{Button[Style["MATHEMATICA AUTHORING TOOL",FontSize->25,FontColor->GrayLevel[1]],SystemOpen["https://applied.services/abma2015/cases/"],Appearance->None,Background->RGBColor[{Rational[37,51],Rational[2,85],Rational[4,85]}],Evaluator->Automatic,FrameMargins->{{17,17},{12,12}},Method->"Preemptive"],"  ",
Button[Style["SYLVA",FontSize->25,FontColor->GrayLevel[1]],SystemOpen["http://localhost:3000/"],Appearance->None,Background->RGBColor[{Rational[37,51],Rational[2,85],Rational[4,85]}],Evaluator->Automatic,FrameMargins->{{17,17},{12,12}},Method->"Preemptive"]
},"Output",CellMargins->{{60,30},{20,10}}]

TAKE AWAYS

CellPrint[TextCell[Framed[Column[{

Row[{Style["   _",25,RGBColor[{185,12,6}/255],FontFamily->"Helvetica"],Style["We need a PrivateCloud!",24,Black,FontFamily->"Helvetica"]},ImageSize->{700,27}],

Row[{Style["   _",25,RGBColor[{185,12,6}/255],FontFamily->"Helvetica"],Style["High potential for scaling",24,Black,FontFamily->"Helvetica"]},ImageSize->{700,27}],

Row[{Style["   _",25,RGBColor[{185,12,6}/255],FontFamily->"Helvetica"],Style["Opportunity to get more insights on user behaviour",24,Black,FontFamily->"Helvetica"]},ImageSize->{700,27}]

}],Background->LightGray,FrameMargins->{{10,40},{30,20}},FrameStyle->LightGray],"Output",CellMargins->{{60,30},{20,10}}]]

Next Steps

_Get exam insights and live grading/suggestions
_Add more question formats and intelligent testing
_Improve UI performance and CloudObject appearance

THANKS FOR YOUR ATTENTION! 


Let‘s get in touch
maik.meusel@business.uzh.ch
carlos.chida@business.uzh.ch