SURVEY:SUMMARY:BUILD_DIFFICULTY[not_applicable, reasonable_effort, code_problematic or string] reasonable_effort
SURVEY:SUMMARY:CLASSIFICATION[practical,theoretical,hardware] practical
SURVEY:SUMMARY:CORRECT_CODE_LOCATION[string]
SURVEY:SUMMARY:PUBLISHED_CODE[not_applicable, yes, no] yes
SURVEY:SUMMARY:SAME_VERSION[not_applicable, yes, no_but_available, no_and_not_available] yes
SURVEY:SUMMARY:STUDY_FOUND_CORRECT_CODE[not_applicable, yes, no] yes
SURVEY:AUTHOR1:BUILD_COMMENT[string] install VirtualBox correctly (twice the student failed to run our virtual image with VirtualBox)
SURVEY:AUTHOR1:BUILD_DIFFICULTY[not_applicable, reasonable_effort, code_problematic or string] reasonable_effort
SURVEY:AUTHOR1:BUILD_DIFFICULTY_COMMENT[string]
SURVEY:AUTHOR1:CLASSIFICATION[practical,theoretical,hardware] practical
SURVEY:AUTHOR1:CLASSIFICATION_COMMENT[string]
SURVEY:AUTHOR1:CORRECT_CODE_LOCATION[string]
SURVEY:AUTHOR1:PUBLIC_COMMENT[string] We want to make clear that the first "build failure" status was not something specific to the research results of our CCS'12 paper but happened due to a difference in version of the installed VirtualBox. The error clearly explained what the student had to (i.e., adding an extra command line parameter).
Our software artefact has been online since the beginning of our research (back in 2010) and has been used and tested by a numerous amount of users on very different occasions (demo's, business events, academic conference, research project defences, ...) and has never failed to showcase for what is was built/designed.
SURVEY:AUTHOR1:PUBLISHED_CODE[not_applicable, yes, no] yes
SURVEY:AUTHOR1:SAME_VERSION[not_applicable, yes, no_but_available, no_and_not_available] yes
SURVEY:AUTHOR1:SAME_VERSION_COMMENT[string]
SURVEY:AUTHOR1:STUDY_FOUND_CORRECT_CODE[not_applicable, yes, no] yes