bibtex title venue authors type page count classification code location build results author comment response update data path build path survey path
BasinBK12 Dynamic enforcement of abstract separation of duty constraints TISSEC '15 David A. Basin, Samuel J. Burri, Gunter Karjoth Journal 30 BC EM_no - http://reproducibility.cs.arizona.edu/data/tissec15_BasinBK12_data.txt - -
RoemerBSS12 Return-Oriented Programming: Systems, Languages, and Applications TISSEC '15 Ryan Roemer, Erik Buchanan, Hovav Shacham, Stefan Savage Journal 34 BC EM_no - http://reproducibility.cs.arizona.edu/data/tissec15_RoemerBSS12_data.txt - http://reproducibility.cs.arizona.edu/data/tissec15_RoemerBSS12_survey.txt
MittalB12 Information Leaks in Structured Peer-to-Peer Anonymous Communication Systems TISSEC '15 Prateek Mittal, Nikita Borisov Journal 12 NC - - http://reproducibility.cs.arizona.edu/data/tissec15_MittalB12_data.txt - -
YavuzNR12 BAF and FI-BAF: Efficient and Publicly Verifiable Cryptographic Schemes for Secure Logging in Resource-Constrained Systems TISSEC '15 Attila Altay Yavuz, Peng Ning, Michael K. Reiter Journal 28 NC - - http://reproducibility.cs.arizona.edu/data/tissec15_YavuzNR12_data.txt - -
GiladH12 LOT: A Defense Against IP Spoofing and Flooding Attacks TISSEC '15 Yossi Gilad, Amir Herzberg Journal 30 BC Article OK_Author Your `validation process' is, frankly, absurd and therefore provides useless results.
In our case
the version we posted had unnecessary dependency (file) in makefile, all you had to do is follow the error message and remove it and all would work fine- or ask us by mail
you did neither.
Besides, you only checked that projects compile; what exactly does it mean that the project compiles? to really check reproducibility you must validate it by running and comparing results and functionality. Your `test` would pass a an "hello, world!" program... absurd. You wasted more time for us in understanding your useless `evaluation` and writing such response as this, than you invested in evaluating our project. A waste of time.; http://reproducibility.cs.arizona.edu/data/tissec15_GiladH12_data.txt http://reproducibility.cs.arizona.edu/data/tissec15_GiladH12_build.txt http://reproducibility.cs.arizona.edu/data/tissec15_GiladH12_survey.txt
BhargavanFCZ12 Verified Cryptographic Implementations for TLS TISSEC '15 Karthikeyan Bhargavan, Cedric Fournet, Ricardo Corin, Eugen Zalinescu Journal 32 BC EM_yes OK_Author http://reproducibility.cs.arizona.edu/data/tissec15_BhargavanFCZ12_data.txt http://reproducibility.cs.arizona.edu/data/tissec15_BhargavanFCZ12_build.txt http://reproducibility.cs.arizona.edu/data/tissec15_BhargavanFCZ12_survey.txt
DannerDKL12 Effectiveness and detection of denial-of-service attacks in tor TISSEC '15 Norman Danner, Sam DeFabbia-Kane, Danny Krizanc, Marc Liberatore Journal 25 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/tissec15_DannerDKL12_data.txt http://reproducibility.cs.arizona.edu/data/tissec15_DannerDKL12_build.txt http://reproducibility.cs.arizona.edu/data/tissec15_DannerDKL12_survey.txt
FeigenbaumJS12 Probabilistic analysis of onion routing in a black-box model TISSEC '15 Joan Feigenbaum, Aaron Johnson, Paul F. Syverson Journal 28 NC - - http://reproducibility.cs.arizona.edu/data/tissec15_FeigenbaumJS12_data.txt - http://reproducibility.cs.arizona.edu/data/tissec15_FeigenbaumJS12_survey.txt
KhouryT12 Corrective Enforcement: A New Paradigm of Security Policy Enforcement by Monitors TISSEC '15 Raphael Khoury, Nadia Tawbi Journal 27 NC - - http://reproducibility.cs.arizona.edu/data/tissec15_KhouryT12_data.txt - -
DanevCMB12 Towards Practical Identification of HF RFID Devices TISSEC '15 Boris Danev, Srdjan Capkun, Ramya Jayaram Masti, Thomas S. Benjamin Journal 24 HW - - We originally classified this paper as NC. In the survey response, the authors said the paper is HW. Therefore, we have changed the classification to HW. ; http://reproducibility.cs.arizona.edu/data/tissec15_DanevCMB12_data.txt - http://reproducibility.cs.arizona.edu/data/tissec15_DanevCMB12_survey.txt
CamenischG12 Efficient Attributes for Anonymous Credentials TISSEC '15 Jan Camenisch, Thomas Gross Journal 30 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/tissec15_CamenischG12_data.txt http://reproducibility.cs.arizona.edu/data/tissec15_CamenischG12_build.txt http://reproducibility.cs.arizona.edu/data/tissec15_CamenischG12_survey.txt
BrennanAG12 Adversarial stylometry: Circumventing authorship recognition to preserve privacy and anonymity TISSEC '15 Michael Brennan, Sadia Afroz, Rachel Greenstadt Journal 22 NC - - http://reproducibility.cs.arizona.edu/data/tissec15_BrennanAG12_data.txt - http://reproducibility.cs.arizona.edu/data/tissec15_BrennanAG12_survey.txt
AbadiP12 On Protection by Layout Randomization TISSEC '15 Martin Abadi, Gordon D. Plotkin Journal 29 NC - - http://reproducibility.cs.arizona.edu/data/tissec15_AbadiP12_data.txt - http://reproducibility.cs.arizona.edu/data/tissec15_AbadiP12_survey.txt
ClearyCPG13 Fast asymmetric thread synchronization TACO '9 David Gregg, Jimmy Cleary, Owen Callanan, Mark Purcell Journal 22 BC EM_0 - http://reproducibility.cs.arizona.edu/data/taco9_ClearyCPG13_data.txt - -
YangWXW12 Comparability Graph Coloring for Optimizing Utilization of Software-Managed Stream Register Files for Stream Processors TACO '9 Li Wang, Xuejun Yang, Jingling Xue, Qingbo Wu Journal 30 BC EM_0 - http://reproducibility.cs.arizona.edu/data/taco9_YangWXW12_data.txt - -
CuiXWYFF12 Extendable pattern-oriented optimization directives TACO '9 Jingling Xue, Huimin Cui, Lei Wang, Yang Yang, Xiaobing Feng, Dongrui Fan Journal 37 BC EM_no - We will make it publicly available soon, and the link will be http://www.carch.ac.cn/~huimin/main.html; http://reproducibility.cs.arizona.edu/data/taco9_CuiXWYFF12_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_CuiXWYFF12_survey.txt
TartaraC13 Continuous learning of compiler heuristics TACO '9 Michele Tartara, Stefano Crespi Reghizzi Journal 25 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/taco9_TartaraC13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_TartaraC13_build.txt -
YiapanisRBL13 Optimizing software runtime systems for speculative parallelization TACO '9 Paraskevas Yiapanis, Demian RosasHam, Gavin Brown, Mikel Lujan Journal 27 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_YiapanisRBL13_data.txt - -
CuiYXF13 Layout-oblivious compiler optimization for matrix computations TACO '9 Huimin Cui, Qing Li, Jingling Xue, Xiaobing Feng Journal 20 BC EM_yes Fails http://reproducibility.cs.arizona.edu/data/taco9_CuiYXF13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_CuiYXF13_build.txt -
LuqueMCV13 Fair CPU time accounting in CMP{\&}plus;SMT processors TACO '9 Carlos Luque, Miquel Moreto, Francisco J. Cazorla, Mateo Valero Journal 25 HW - - http://reproducibility.cs.arizona.edu/data/taco9_LuqueMCV13_data.txt - -
DuZCMM13 Delta-compressed caching for overcoming the write bandwidth limitation of hybrid main memory TACO '9 Yu Du, Miao Zhou, Bruce Childers, Rami Melhem, Daniel Mosse Journal 20 HW - - http://reproducibility.cs.arizona.edu/data/taco9_DuZCMM13_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_DuZCMM13_survey.txt
VerdoolaegeJCGTC13 Polyhedral parallel code generation for CUDA TACO '9 Juan Carlos Juega, Sven Verdoolaege, Albert Cohen, Jose Ignacio Gomez, Christian Tenllado, Francky Catthoor Journal 23 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/taco9_VerdoolaegeJCGTC13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_VerdoolaegeJCGTC13_build.txt -
LiMJ13 PS-TLB: Leveraging page classification information for fast,scalable and efficient translation for future CMPs TACO '9 Yong Li, Rami Melhem, Alex K. Jones Journal 21 HW - - http://reproducibility.cs.arizona.edu/data/taco9_LiMJ13_data.txt - -
LeeKLYP13 Dynamic code duplication with vulnerability awareness for soft error detection on VLIW architectures TACO '9 Jongwon Lee, Yohan Ko, Kyoungwoo Lee, Jonghee M. Youn, Yunheung Peak Journal 24 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_LeeKLYP13_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_LeeKLYP13_survey.txt
BelviranliBG13 A dynamic self-scheduling scheme for heterogeneous multiprocessor architectures TACO '9 Mehmet E. Belviranli, Laxmi N. Bhuyan, Rajiv Gupta Journal 20 BC EM_0 - http://reproducibility.cs.arizona.edu/data/taco9_BelviranliBG13_data.txt - -
YangXKMZ12 A unified optimizing compiler framework for different GPGPU architectures TACO '9 Yi Yang, Ping Xiang, Jingfei Kong, Mike Mantor, Huiyang Zhou Journal 33 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/taco9_YangXKMZ12_data.txt http://reproducibility.cs.arizona.edu/data/taco9_YangXKMZ12_build.txt -
AntaoS13 The CRNS framework and its application to programmable and reconfigurable cryptography TACO '9 Samuel Antao, Leonel Sousa Journal 25 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_AntaoS13_data.txt - -
GhandourAM12 Leveraging Strength-Based Dynamic Information Flow Analysis to Enhance Data Value Prediction TACO '9 Walid J. Ghandour, Haitham Akkary, Wes Masri Journal 33 EX - - http://reproducibility.cs.arizona.edu/data/taco9_GhandourAM12_data.txt - -
LiPZI12 Dynamic QoS management for chip multiprocessors TACO '9 Bin Li, Li Shiuan Peh, Li Zhao, Ravi Iyer Journal 29 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_LiPZI12_data.txt - -
ValeroSPLD12 Combining recency of information with selective random and a victim cache in last-level caches TACO '9 Alejandro Valero, Julio Sahuquillo, Salvador Petit, Pedro Lopez, Jose Duato Journal 20 HW - - http://reproducibility.cs.arizona.edu/data/taco9_ValeroSPLD12_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_ValeroSPLD12_survey.txt
MazloomMTAS12 Dataflow Tomography: Information Flow Tracking For Understanding and Visualizing Full Systems TACO '9 Bita Mazloom, Shashidhar Mysore, Mohit Tiwari, Banit Agrawal, Tim Sherwood Journal 26 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/taco9_MazloomMTAS12_data.txt http://reproducibility.cs.arizona.edu/data/taco9_MazloomMTAS12_build.txt -
ChenS13 Profile-guided floating- to fixed-point conversion for hybrid FPGA-processor applications TACO '9 Doris Chen, Deshanand Singh Journal 25 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_ChenS13_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_ChenS13_survey.txt
MajumdarCBCG12 A Massively Parallel, Energy Efficient Programmable Accelerator for Learning and Classification TACO '9 Abhinandan Majumdar, Shihari Cadambi, Michela Becchi, Srimat T. Chakradhar, Hans Peter graf Journal 30 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_MajumdarCBCG12_data.txt - -
AbadPG13 LIGERO: A light but efficient router conceived for cache-coherent chip multiprocessors TACO '9 Pablo Abad, Jose-Angel Gregorio, Valentin Puente Journal 21 HW - - http://reproducibility.cs.arizona.edu/data/taco9_AbadPG13_data.txt - -
DioufHCOP13 A decoupled local memory allocator TACO '9 Boubacar Diouf, Can Hantas, Albert Cohen, Ozcan Ozturk, Jens Palsberg Journal 22 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_DioufHCOP13_data.txt - -
XekalakisIC12 Mixed speculative multithreaded execution models TACO '9 Polychronis Xekalakis, Nikolas Ioannou, Marcelo Cintra Journal 26 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_XekalakisIC12_data.txt - -
RohouWY13 Vectorization technology to improve interpreter performance TACO '9 David Yuste, Erven Rohou, Kevin Williams Journal 22 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/taco9_RohouWY13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_RohouWY13_build.txt -
XiaoCCGHLRW13 Stream arbitration: Towards efficient bandwidth utilization for emerging on-chip interconnects TACO '9 Chunhua Xiao, MC Frank Chang, Jaon Cong, Michael Gill, Zhangqin Huang, Chunyue Liu, Glenn Reinman, Hao Wu Journal 27 HW - - http://reproducibility.cs.arizona.edu/data/taco9_XiaoCCGHLRW13_data.txt - -
YanJTF13 An integrated pseudo-associativity and relaxed-order approach to hardware transactional memory TACO '9 Zhichao Yan, Hong Jiang, Yujuan Tan, Dan Feng Journal 26 BC EM_0 - http://reproducibility.cs.arizona.edu/data/taco9_YanJTF13_data.txt - -
GeraciS12 A transpose-free in-place SIMD optimized FFT TACO '9 James R. Geraci, Sharon M. Sacco Journal 21 HW - - http://reproducibility.cs.arizona.edu/data/taco9_GeraciS12_data.txt - -
NugterenCC13 Algorithmic species: A classification of affine loop nests for parallel programming TACO '9 Cedric Nugteren, Pieter Custers, Henk Corporal Journal 25 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/taco9_NugterenCC13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_NugterenCC13_build.txt http://reproducibility.cs.arizona.edu/data/taco9_NugterenCC13_survey.txt
BaghdadiCVT13 Improved loop tiling based on the removal of spurious false dependences TACO '9 Riyadh Baghdadi, Albert Cohen, Sven Verdoolaege, Konrad Trifunovic Journal 26 BC EM_yes Fails http://reproducibility.cs.arizona.edu/data/taco9_BaghdadiCVT13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_BaghdadiCVT13_build.txt -
PuriniJ13 Finding good optimization sequences covering program space TACO '9 Suresh Purini, Lakshya Jain Journal 23 BC EM_yes OK_gt_30 We originally classified this paper as EM_no. We found that the authors had emailed us but we missed the email. We have changed the classification to EM_yes. ; http://reproducibility.cs.arizona.edu/data/taco9_PuriniJ13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_PuriniJ13_build.txt -
AndradeFD12 Static analysis of the worst-case memory performance for irregular codes with indirections TACO '9 Diego Andrade, Basilio B. Fraguela, Ramon Doallo Journal 32 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_AndradeFD12_data.txt - -
LutzFC13 PARTANS: An autotuning framework for stencil computation on multi-GPU systems TACO '9 Thibaut Lutz, Christian Fensch, Murray Cole Journal 24 HW - - http://reproducibility.cs.arizona.edu/data/taco9_LutzFC13_data.txt - -
ChenFHEFTW12 Deconstructing iterative optimization TACO '9 Yang Chen, Shuangde Fang, Yuanjie Huang, Lieven Eeckhout, Grigori Fursin, Olivier Temam, Chengyong Wu Journal 30 NC - - http://reproducibility.cs.arizona.edu/data/taco9_ChenFHEFTW12_data.txt - -
DolanMG13 Compiler support for lightweight context switching TACO '9 Servesh Muralidharan, Stephen Golan, David Gregg Journal 25 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/taco9_DolanMG13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_DolanMG13_build.txt -
GuhaHS12 Memory optimization of dynamic binary translators for embedded systems TACO '9 Apala Guha, Kin Hazelwood, Mary Lou Soffa Journal 29 HW - - We originally classified this paper as HW. In the survey response, authors say that the paper is BC. The code is meant to run on embedded systems. Therefore, we have kept the classification of HW. ; http://reproducibility.cs.arizona.edu/data/taco9_GuhaHS12_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_GuhaHS12_survey.txt
JangLER12 Automatic code overlay generation and partially redundant code fetch elimination TACO '9 Choonki Jang, Jaejin Lee, Bernhard Egger, Soojung Ryu Journal 32 HW - - http://reproducibility.cs.arizona.edu/data/taco9_JangLER12_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_JangLER12_survey.txt
FowersBWS13 A performance and energy comparison of convolution on GPUs,FPGAs, and multicore processors TACO '9 Jeremy Fowers, Greg Brown, John Wernsing, Greg Stitt Journal 21 HW - - Your study is inaccurate. Please fix it before publishing.; We originally classified this paper as NC. In the survey response, the authors said the paper is HW. Therefore, we have changed the classification to HW. ; http://reproducibility.cs.arizona.edu/data/taco9_FowersBWS13_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_FowersBWS13_survey.txt
CraeynestE13 Understanding fundamental design choices in single-ISA heterogeneous multicore architectures TACO '9 Lieven Eeckhout, Kenzo Van Craeynest Journal 23 NC - - http://reproducibility.cs.arizona.edu/data/taco9_CraeynestE13_data.txt - -
AlbericioIVL13 Exploiting reuse locality on inclusive shared last-level caches TACO '9 Jorge Alberticio, Pablo Ibanez, Victor Vinals, Jose Maria Llaberia Journal 19 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_AlbericioIVL13_data.txt - -
PusukuriGB13 ADAPT: A framework for coscheduling multithreaded programs TACO '9 Kishore Kumar Pusukuri, Rajix Gupta, Laxmi N. Bhuyan Journal 24 BC Article OK_Author Please read carefully the build notes.; http://reproducibility.cs.arizona.edu/data/taco9_PusukuriGB13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_PusukuriGB13_build.txt http://reproducibility.cs.arizona.edu/data/taco9_PusukuriGB13_survey.txt
KhanBRHCC13 A script-based autotuning compiler system to generate high-performance CUDA code TACO '9 Malik Khan, Protonu Basu, Gabe Rudy, Mary Hall, Chun Chen, Jacqueline Chame Journal 25 HW - - http://reproducibility.cs.arizona.edu/data/taco9_KhanBRHCC13_data.txt - -
NegiG13 SCIN-cache: Fast speculative versioning in multithreaded cores TACO '9 Anurag Negi, Ruben Titos-Gil Journal 26 HW - - http://reproducibility.cs.arizona.edu/data/taco9_NegiG13_data.txt - -
WimmerHVJDS13 Maxine: An approachable virtual machine for, and in, java TACO '9 Christian Wimmer, Michael Haupt, Michael L. VanDeVanter, Mick Jordan, Laurent Daynes, Douglas Simon Journal 24 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/taco9_WimmerHVJDS13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_WimmerHVJDS13_build.txt http://reproducibility.cs.arizona.edu/data/taco9_WimmerHVJDS13_survey.txt
AbbasiVG12 TACOMA: Server and workload management in internet data centers considering cooling-computing power trade-off and energy proportionality TACO '9 Zahra Abbasi, Georgios Varsamopoulos, Sandeep K.S. Gupta Journal 37 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_AbbasiVG12_data.txt - -
PopC13 OpenStream: Expressiveness and data-flow compilation of OpenMP streaming programs TACO '9 Antoniu Pop, Albert Cohen Journal 25 BC Article OK_Author http://reproducibility.cs.arizona.edu/data/taco9_PopC13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_PopC13_build.txt http://reproducibility.cs.arizona.edu/data/taco9_PopC13_survey.txt
ChrysosDPD13 HC-CART: A parallel system implementation of data mining classification and regression tree (CART) algorithm on a multi-FPGA system TACO '9 Grigorios Chrysos, Panagiotis Dagritzikos, Ioannis Papaefstathiou, Apostolos Dollas Journal 25 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_ChrysosDPD13_data.txt - -
AhnJKLS12 Improving System Energy Efficiency with Memory Rank Subsetting TACO '9 Jung Ho Ahn, Norman P. Jouppi, Christos Kozyrakis, Jacob Leverich, Robers S. Schreiber Journal 28 HW - - http://reproducibility.cs.arizona.edu/data/taco9_AhnJKLS12_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_AhnJKLS12_survey.txt
CuiWCS13 Lock-contention-aware scheduler: A scalable and energy-efficient method for addressing scalability collapse on multicore systems TACO '9 Yan Cui, Yingxin Wang, Yu Chen, Yuanchun Shi Journal 25 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/taco9_CuiWCS13_data.txt http://reproducibility.cs.arizona.edu/data/taco9_CuiWCS13_build.txt http://reproducibility.cs.arizona.edu/data/taco9_CuiWCS13_survey.txt
LankesWWH12 Benefits of selective packet discard in networks-on-chip TACO '9 Andreas Lanks, Thomas Wild, Stefan Wallentowitz, Andreas Herkersdorf Journal 21 HW - - http://reproducibility.cs.arizona.edu/data/taco9_LankesWWH12_data.txt - -
SeghirLM12 Integer affine transformations of parametric ;-polytopes and applications to loop nest optimization TACO '9 Vincent Loechner, Rachid Seghir, Benoit Meister Journal 27 BC Article Fails http://reproducibility.cs.arizona.edu/data/taco9_SeghirLM12_data.txt http://reproducibility.cs.arizona.edu/data/taco9_SeghirLM12_build.txt -
LeeKV12 When Prefetching Works, When It Doesn't, and Why TACO '9 Hyesoon Kim, Jaekyu Lee, Richard Vuduc Journal 29 HW - - We originally classified this paper as NC. In the survey response, the authors said the paper is HW. Therefore, we have changed the classification to HW. ; http://reproducibility.cs.arizona.edu/data/taco9_LeeKV12_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_LeeKV12_survey.txt
LewisTG12 Runtime energy consumption estimation for server workloads based on chaotic time-series approximation TACO '9 Adam Wave Lewis, NianFeng Tzeng, Soumik Ghosh Journal 26 BC EM_0 - http://reproducibility.cs.arizona.edu/data/taco9_LewisTG12_data.txt - -
CoelhoI13 API compilation for image hardware accelerators TACO '9 Fabien Coelho, Francois Irigoin Journal 25 BC EM_no - We originally classified this paper as Web and OK_leq_30. In the survey response, the authors said we only compiled part of the relevant code and that the remainder is not available. Therefore, we have changed the classification to EM_no. ; http://reproducibility.cs.arizona.edu/data/taco9_CoelhoI13_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_CoelhoI13_survey.txt
EyermanE12 Probabilistic modeling for job symbiosis scheduling on SMT processors TACO '9 Stijn Eyerman, Lieven Eeckhout Journal 27 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_EyermanE12_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_EyermanE12_survey.txt
BoisEE13 Per-thread cycle accounting in multicore processors TACO '9 Lieven Eeckhout, Kristof Du Bois, Stijn Eyerman Journal 22 EX - - http://reproducibility.cs.arizona.edu/data/taco9_BoisEE13_data.txt - -
SharafeddineJA12 Disjoint out-of-order execution processor TACO '9 Mageda Sharafeddine, Komal Jothi, Haitham Akkary Journal 32 BC EM_no - Your study on repeatability in computer science research is quite interesting. Looking forward to see how it will impact the publication process and culture of this area of engineering.; http://reproducibility.cs.arizona.edu/data/taco9_SharafeddineJA12_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_SharafeddineJA12_survey.txt
CoppensSM13 Feedback-driven binary code diversification TACO '9 Bart Coppens, Bjorn De Sutter, Hibas Maebe Journal 26 BC EM_no - http://reproducibility.cs.arizona.edu/data/taco9_CoppensSM13_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_CoppensSM13_survey.txt
LuoZ12 Dynamically dispatching speculative threads to improve sequential execution TACO '9 Yangchun Luo, Antonia Zhai Journal 31 HW - - http://reproducibility.cs.arizona.edu/data/taco9_LuoZ12_data.txt - -
GerardsK13 Optimal DPM and DVFS for frame-based real-time systems TACO '9 Marco E.T. Gerards, Jan Kuper Journal 23 NC - - http://reproducibility.cs.arizona.edu/data/taco9_GerardsK13_data.txt - http://reproducibility.cs.arizona.edu/data/taco9_GerardsK13_survey.txt
MattheakisP13 Significantly reducing MPI intercommunication latency and power overhead in both embedded and HPC systems TACO '9 Pavlos M. Mattheakis, Ioannis Papaefstathiou Journal 25 HW - - http://reproducibility.cs.arizona.edu/data/taco9_MattheakisP13_data.txt - -
YangRW12 Shared execution strategy for neighbor-based pattern mining requests over streaming windows TODS '37 Di Yang, Elke A Rundensteiner, Matthew O Ward Journal 44 BC EM_0 - http://reproducibility.cs.arizona.edu/data/tods37_YangRW12_data.txt - -
TassaG12 Secure distributed computation of anonymized views of shared databases TODS '37 Tamir Tassa, Ehud Gudes Journal 43 BC EM_no - http://reproducibility.cs.arizona.edu/data/tods37_TassaG12_data.txt - -
Nuray-TuranKM12 Exploiting Web querying for Web people search TODS '37 Dmitri V Kalashnikov, Rabia Nuray-Turan, Sharad Mehrotra Journal 41 EX - - http://reproducibility.cs.arizona.edu/data/tods37_Nuray-TuranKM12_data.txt - -
Graefe12 A survey of B-tree logging and recovery techniques TODS '37 Goetz Graefe Journal 35 NC - - We originally classified this paper as NC. In the survey response, the authors said the paper is BC. The paper describes a survey of current practices. Therefore, we have kept the classification of NC. ; http://reproducibility.cs.arizona.edu/data/tods37_Graefe12_data.txt - http://reproducibility.cs.arizona.edu/data/tods37_Graefe12_survey.txt
BarceloLLW12 Expressive Languages for Path Queries over Graph-Structured Data TODS '37 Leonid Libkin, Pablo Barcelo, Anthony W Lin, Peter T Wood Journal 46 NC - - http://reproducibility.cs.arizona.edu/data/tods37_BarceloLLW12_data.txt - -
LiuC12 Differentiating search results on structured data TODS '37 Ziyang Liu, Yi Chen Journal 30 BC EM_0 - http://reproducibility.cs.arizona.edu/data/tods37_LiuC12_data.txt - -
LemireKG12 Reordering rows for better compression: Beyond the lexicographic order TODS '37 Daniel Lemire, Owen Kaser, Eduardo Gutarra Journal 29 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/tods37_LemireKG12_data.txt http://reproducibility.cs.arizona.edu/data/tods37_LemireKG12_build.txt http://reproducibility.cs.arizona.edu/data/tods37_LemireKG12_survey.txt
Nuray-TuranKMY12 Attribute and object selection queries on objects with probabilistic attributes TODS '37 Dmitri V Kalashnikov, Rabia Nuray-Turan, Sharad Mehrotra, Yaming Yu Journal 41 EX - - http://reproducibility.cs.arizona.edu/data/tods37_Nuray-TuranKMY12_data.txt - -
ShengT12 Worst-Case I/O-Efficient Skyline Algorithms TODS '37 Cheng Sheng, Yufei Tao Journal 22 NC - - http://reproducibility.cs.arizona.edu/data/tods37_ShengT12_data.txt - -
XieDSZZ12 Finding Alternative Shortest Paths in Spatial Networks TODS '37 Kexin Xie, Ke Deng, Shuo Shang, Xiaofang Zhou, Kai Zheng Journal 31 BC EM_0 - http://reproducibility.cs.arizona.edu/data/tods37_XieDSZZ12_data.txt - -
DamaggioDV12 Artifact systems with data dependencies and arithmetic TODS '37 Alin Deutsch, Elio Damaggio, Victor Vianu Journal 36 NC - - http://reproducibility.cs.arizona.edu/data/tods37_DamaggioDV12_data.txt - -
WangY12 Revisiting answering tree pattern queries using views TODS '37 Junhu Wang, Jeffrey Xu Yu Journal 34 BC EM_no - http://reproducibility.cs.arizona.edu/data/tods37_WangY12_data.txt - -
ZhangLZCZ12 Stochastic skylines TODS '37 Wenjie Zhang, Xuemin Lin, Ying Zhang, Muhammad Aamir Cheema, Qing Zhang Journal 34 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/tods37_ZhangLZCZ12_data.txt http://reproducibility.cs.arizona.edu/data/tods37_ZhangLZCZ12_build.txt -
DavidLT12 Efficient reasoning about data trees via integer linear programming TODS '37 Leonid Libkin, Claire David, Tony Tan Journal 28 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/tods37_DavidLT12_data.txt http://reproducibility.cs.arizona.edu/data/tods37_DavidLT12_build.txt -
CongFKLL12 Partial Evaluation for Distributed XPath Query Processing and Beyond TODS '37 Gao Cong, Wenfei Fan, Anastasios Kementsietsidis, Jianzhong Li, Xianmin Liu Journal 43 BC EM_no - http://reproducibility.cs.arizona.edu/data/tods37_CongFKLL12_data.txt - -
MartinenghiT12 Proximity measures for rank join TODS '37 Davide Martinenghi, Marco Tagliasacchi Journal 46 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/tods37_MartinenghiT12_data.txt http://reproducibility.cs.arizona.edu/data/tods37_MartinenghiT12_build.txt http://reproducibility.cs.arizona.edu/data/tods37_MartinenghiT12_survey.txt
GraefeKK12 Foster b-trees TODS '37 Harumi Kuno, Goetz Graefe, Hideaki Kimura Journal 29 BC EM_0 - http://reproducibility.cs.arizona.edu/data/tods37_GraefeKK12_data.txt - -
AmsterdamerDMT12 On Provenance Minimization TODS '37 Daniel Deutch, Yael Amsterdamer, Tova Milo, Val Tannen Journal 36 NC - - http://reproducibility.cs.arizona.edu/data/tods37_AmsterdamerDMT12_data.txt - http://reproducibility.cs.arizona.edu/data/tods37_AmsterdamerDMT12_survey.txt
Wijsen12 Certain conjunctive query answering in first-order logic TODS '37 Jef Wijsen Journal 35 NC - - http://reproducibility.cs.arizona.edu/data/tods37_Wijsen12_data.txt - -
ShengTL12 Exact and approximate algorithms for the most connected vertex problem TODS '37 Yufei Tao, Cheng Sheng, Jianzhong Li Journal 39 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/tods37_ShengTL12_data.txt http://reproducibility.cs.arizona.edu/data/tods37_ShengTL12_build.txt -
FanGW12 Determining the Currency of Data TODS '37 Wenfei Fan, Floris Geerts, Jef Wijsen Journal 46 NC - - http://reproducibility.cs.arizona.edu/data/tods37_FanGW12_data.txt - http://reproducibility.cs.arizona.edu/data/tods37_FanGW12_survey.txt
LiPT12 WHAM: A High-Throughput Sequence Alignment Method TODS '37 Yinan Li, Jignesh M Patel, Allison Terrell Journal 39 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/tods37_LiPT12_data.txt http://reproducibility.cs.arizona.edu/data/tods37_LiPT12_build.txt -
XiaZFCW12 Online subspace skyline query processing using the compressed skycube TODS '37 Cindy Chen, Tian Xia, Donghui Zhang, Zheng Fang, Jie Wang Journal 36 BC EM_0 - http://reproducibility.cs.arizona.edu/data/tods37_XiaZFCW12_data.txt - http://reproducibility.cs.arizona.edu/data/tods37_XiaZFCW12_survey.txt
HartmannL12 The implication problem of data dependencies over SQL table definitions: Axiomatic, algorithmic and logical characterizations TODS '37 Sebastian Link, Sven Hartmann Journal 40 NC - - http://reproducibility.cs.arizona.edu/data/tods37_HartmannL12_data.txt - http://reproducibility.cs.arizona.edu/data/tods37_HartmannL12_survey.txt
AbiteboulBV12 Comparing workflow specification languages: A matter of views TODS '37 Victor Vianu, Serge Abiteboul, Pierre Bourhis Journal 59 NC - - http://reproducibility.cs.arizona.edu/data/tods37_AbiteboulBV12_data.txt - -
ReS12 Understanding cardinality estimation using entropy maximization TODS '37 Christopher Re, Dan Suciu Journal 31 NC - - http://reproducibility.cs.arizona.edu/data/tods37_ReS12_data.txt - -
SchneiderCVY12 Cardinal directions between complex regions TODS '37 Markus Schneider, Tao Chen, Ganesh Viswanathan, Wenjie Yuan Journal 40 NC - - http://reproducibility.cs.arizona.edu/data/tods37_SchneiderCVY12_data.txt - -
LiMDMS12 SCALLA: A Platform for Scalable One-Pass Analytics Using MapReduce TODS '37 Boduo Li, Edward Mazur, Yanlei Diao, Andrew Mcgregor, Prashant Shenoy Journal 43 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/tods37_LiMDMS12_data.txt http://reproducibility.cs.arizona.edu/data/tods37_LiMDMS12_build.txt http://reproducibility.cs.arizona.edu/data/tods37_LiMDMS12_survey.txt
KimelfeldVW12 Maximizing Conjunctive Views in Deletion Propagation TODS '37 Benny Kimelfeld, Jan Vondrak, Ryan Williams Journal 37 NC - - http://reproducibility.cs.arizona.edu/data/tods37_KimelfeldVW12_data.txt - -
kim2012efficient Efficient patch-based auditing for web application vulnerabilities OSDI '12 Taesoo Kim, Ramesh Chandra, Nickolai Zeldovich Conference 14 EX - - http://reproducibility.cs.arizona.edu/data/osdi12_kim2012efficient_data.txt - -
li2012making Making geo-replicated systems fast as possible, consistent when necessary OSDI '12 Cheng Li, Daniel Porto, Allen Clement, Johannes Gehrke, Nuno Preguica, Rodrigo Rodrigues Conference 14 BC EM_no - http://reproducibility.cs.arizona.edu/data/osdi12_li2012making_data.txt - -
han2012megapipe Megapipe: a new programming interface for scalable network i/o OSDI '12 Sangjin Han, Scott Marshall, Byung-Gon Chun, Sylvia Ratnasamy Conference 14 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/osdi12_han2012megapipe_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_han2012megapipe_build.txt -
nightingale2012flat Flat datacenter storage OSDI '12 Edmund B Nightingale, Jeremy Elson, Jinliang Fan, Owen Hofmann, Jon Howell, Yutaka Suzue Conference 15 BC EM_no - Sharing code is unfortunately not possible due to corporate IP concerns.; http://reproducibility.cs.arizona.edu/data/osdi12_nightingale2012flat_data.txt - http://reproducibility.cs.arizona.edu/data/osdi12_nightingale2012flat_survey.txt
kyrola2012graphchi GraphChi: Large-scale graph computation on just a PC OSDI '12 Aapo Kyrola, Guy Blelloch, Carlos Guestrin Conference 16 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/osdi12_kyrola2012graphchi_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_kyrola2012graphchi_build.txt -
tang2012cleanos CleanOS: Limiting mobile data exposure with idle eviction OSDI '12 Yang Tang, Phillip Ames, Sravan Bhamidipati, Ashish Bijlani, Roxana Geambasu, Nikhil Sarda Conference 15 EX - - http://reproducibility.cs.arizona.edu/data/osdi12_tang2012cleanos_data.txt - -
jin2012automated Automated concurrency-bug fixing OSDI '12 Guoliang Jin, Wei Zhang, Dongdong Deng, Ben Liblit, Shan Lu Conference 16 EX - - http://reproducibility.cs.arizona.edu/data/osdi12_jin2012automated_data.txt - -
kotla2012pasture Pasture: secure offline data access using commodity trusted hardware OSDI '12 Tom Rodeheffer, Indrajit Roy, Patrick Stuedi, Benjamin Wester, Ramakrishna Kotla Conference 14 BC EM_no - http://reproducibility.cs.arizona.edu/data/osdi12_kotla2012pasture_data.txt - http://reproducibility.cs.arizona.edu/data/osdi12_kotla2012pasture_survey.txt
guo2012spotting Spotting code optimizations in data-parallel pipelines through PeriSCOPE OSDI '12 Zhenyu Guo, Xuepeng Fan, Rishan Chen, Jiaxing Zhang, Hucheng Zhou, Sean McDirmid, Chang Liu, Wei Lin, Jingren Zhou, Lidong Zhou Conference 13 BC EM_no - http://reproducibility.cs.arizona.edu/data/osdi12_guo2012spotting_data.txt - http://reproducibility.cs.arizona.edu/data/osdi12_guo2012spotting_survey.txt
belay2012dune Dune: safe user-level access to privileged CPU features OSDI '12 Adam Belay, Andrea Bittau, Ali Mashtizadeh, David Terei, David Mazieres, Christos Kozyrakis Conference 14 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/osdi12_belay2012dune_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_belay2012dune_build.txt http://reproducibility.cs.arizona.edu/data/osdi12_belay2012dune_survey.txt
ravindranath2012appinsight AppInsight: mobile app performance monitoring in the wild OSDI '12 Lenin Ravindranath, Jitendra Padhye, Sharad Agarwal, Ratul Mahajan, Ian Obermiller, Shahin Shayandeh Conference 14 BC EM_no - http://reproducibility.cs.arizona.edu/data/osdi12_ravindranath2012appinsight_data.txt - -
narayan2012djoin DJoin: differentially private join queries over distributed databases OSDI '12 Arjun Narayan, Andreas Haeberlen Conference 14 EX - - http://reproducibility.cs.arizona.edu/data/osdi12_narayan2012djoin_data.txt - -
dunn2012eternal Eternal sunshine of the spotless machine: Protecting privacy with ephemeral channels OSDI '12 Alan M Dunn, Michael Z Lee, Suman Jana, Sangman Kim, Mark Silberstein, Yuanzhong Xu, Vitaly Shmatikov, Emmett Witchel Conference 15 BC EM_no - We originally classified this paper as EM_no because did not receive code within our two month window after the initial request. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; Code now available at https://github.com/ut-osa/lacuna (notified via survey as of 9/22/2014) http://reproducibility.cs.arizona.edu/data/osdi12_dunn2012eternal_data.txt - http://reproducibility.cs.arizona.edu/data/osdi12_dunn2012eternal_survey.txt
renzelmann2012symdrive SymDrive: testing drivers without devices OSDI '12 Matthew J Renzelmann, Asim Kadav, Michael M Swift Conference 14 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/osdi12_renzelmann2012symdrive_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_renzelmann2012symdrive_build.txt http://reproducibility.cs.arizona.edu/data/osdi12_renzelmann2012symdrive_survey.txt
kapritsos2012all All about Eve: execute-verify replication for multi-core servers OSDI '12 Manos Kapritsos, Yang Wang, Vivien Quema, Allen Clement, Lorenzo Alvisi, Mike Dahlin Conference 14 EX - - http://reproducibility.cs.arizona.edu/data/osdi12_kapritsos2012all_data.txt - -
shue2012performance Performance isolation and fairness for multi-tenant cloud storage OSDI '12 David Shue, Michael J Freedman, Anees Shaikh Conference 14 EX - - http://reproducibility.cs.arizona.edu/data/osdi12_shue2012performance_data.txt - -
gordon2012comet COMET: code offload by migrating execution transparently OSDI '12 Mark S Gordon, D Anoushe Jamshidi, Scott Mahlke, Z Morley Mao, Xu Chen Conference 14 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/osdi12_gordon2012comet_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_gordon2012comet_build.txt -
yuan2012conservative Be conservative: enhancing failure diagnosis with proactive logging OSDI '12 Ding Yuan, Soyeon Park, Peng Huang, Yang Liu, Michael M Lee, Xiaoming Tang, Yuanyuan Zhou, Stefan Savage Conference 14 EX - - http://reproducibility.cs.arizona.edu/data/osdi12_yuan2012conservative_data.txt - -
attariyan2012x X-ray: automating root-cause diagnosis of performance anomalies in production software OSDI '12 Mona Attariyan, Michael Chow, Jason Flinn Conference 16 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/osdi12_attariyan2012x_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_attariyan2012x_build.txt http://reproducibility.cs.arizona.edu/data/osdi12_attariyan2012x_survey.txt
levis2012experiences Experiences from a decade of TinyOS development OSDI '12 Philip Levis Conference 14 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/osdi12_levis2012experiences_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_levis2012experiences_build.txt -
wang2012improving Improving integer security for systems with KINT OSDI '12 Xi Wang, Haogang Chen, Zhihao Jia, Nickolai Zeldovich, M Frans Kaashoek Conference 15 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/osdi12_wang2012improving_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_wang2012improving_build.txt -
corbett2012spanner Spanner: Googles globally-distributed database OSDI '12 Christopher Frost, JJ Furman, Sanjay Ghemawat, Andrey Gubarev, Christopher Heiser, Peter Hochschild, others, James C Corbett, Jeffrey Dean, Michael Epstein, Andrew Fikes Conference 14 BC EM_no - http://reproducibility.cs.arizona.edu/data/osdi12_corbett2012spanner_data.txt - -
wolinsky2012dissent Dissent in numbers: making strong anonymity scale OSDI '12 David Isaac Wolinsky, Henry Corrigan-Gibbs, Bryan Ford, Aaron Johnson Conference 14 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/osdi12_wolinsky2012dissent_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_wolinsky2012dissent_build.txt -
gonzalez2012powergraph PowerGraph: Distributed graph-parallel computation on natural graphs OSDI '12 J Gonzalez, Yucheng Low, Haijie Gu, Danny Bickson, Carlos Guestrin Conference 14 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/osdi12_gonzalez2012powergraph_data.txt http://reproducibility.cs.arizona.edu/data/osdi12_gonzalez2012powergraph_build.txt -
LuSLDWC12 Optimal top-k generation of attribute combinations based on ranked lists SIGMOD '12 Jiaheng Lu, Pierre Senellart, Chunbin Lin, Xiaoyong Du, Shan Wang, Xinxing Chen Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_LuSLDWC12_data.txt - -
RekatsinasDG12 Local structure and determinism in probabilistic databases SIGMOD '12 Theodoros Rekatsinas, Amol Deshpande, Lise Getoor Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_RekatsinasDG12_data.txt - -
MozafariZZ12 High-performance complex event processing over XML streams SIGMOD '12 Barzan Mozafari, Kai Zeng, Carlo Zaniolo Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_MozafariZZ12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_MozafariZZ12_build.txt -
WuLWZ12 Probase: a probabilistic taxonomy for text understanding SIGMOD '12 Wentao Wu, Hongsong Li, Haixun Wang, Kenny Q. Zhu Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_WuLWZ12_data.txt - -
ParameswaranGPPRW12 CrowdScreen: algorithms for filtering data with humans SIGMOD '12 Aditya Parameswaran, Hector Garcia-Molina, Hyunjung Park, Neoklis Polyzotis, Aditya Ramesh, Jennifer Widom Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/sigmod12_ParameswaranGPPRW12_data.txt - -
KwonBHR12 SkewTune: mitigating skew in mapreduce applications SIGMOD '12 YongChul Kwon, Magdalena Balazinska, Bill Howe, Jerome Rolia Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_KwonBHR12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_KwonBHR12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_KwonBHR12_survey.txt
FengKRR12 Towards a unified architecture for in-RDBMS analytics SIGMOD '12 Xixuan Feng, Arun Kumar, Benjamn Recht, Christopher Re Conference 12 BC Article OK_gt_30 From the build notes, it seems that you had a trouble to set up the Postgres environment. Code that runs dependently on another system is unfortunately hard to get built. I am glad you eventually got it. But having a cross-platform code release is not very realistic for research publication. Thus, we have also published a virtual machine with everything built in.; http://reproducibility.cs.arizona.edu/data/sigmod12_FengKRR12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_FengKRR12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_FengKRR12_survey.txt
MohanTSSC12 GUPT: privacy preserving data analysis made easy SIGMOD '12 Prashanth Mohan, Abhradeep Thakurta, Elaine Shi, Dawn Song, David E. Culler Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_MohanTSSC12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_MohanTSSC12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_MohanTSSC12_survey.txt
KatsifodimosMV12 Materialized view selection for XQuery workloads SIGMOD '12 Asterios Katsifodimos, Ioana Manolescu, Vasilis Vassalos Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_KatsifodimosMV12_data.txt - -
WangLF12 Can we beat the prefix filtering?: an adaptive framework for similarity join and search SIGMOD '12 Jiannan Wang, Guoliang Li, Jianhua Feng Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_WangLF12_data.txt - -
ConsensILP12 Divergent physical design tuning for replicated databases SIGMOD '12 Naruabi O. Consens, Kleoni Ioannidou, Jeff LeFevre, Neoklis Polyzotis Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_ConsensILP12_data.txt - -
ThomsonDWRSA12 Calvin: fast distributed transactions for partitioned database systems SIGMOD '12 Alexander Thomson, Thaddeus Diamond, Shu-Chun Weng, Kun Ren, Philip Shao, Daniel J. Abadi Conference 12 BC EM_no - A 30-minute verification that an author's code compiles, runs, and prints the expected output is interesting but is not a convincing test of scientific reproducibility.
A better test of reproducibility of a publication's results would be to independently implement and measure the algorithm or system described. This would be unlikely to replicate any bugs or systematic measurement errors, increasing the meaningfulness of a positive reproducibility result. Negative results would also be more likely to provide technical insight and foster scientific discussion.
Note that publishing code is also a rather thankless task. Likely outcomes include:
(a) Nobody will look at it and you will have wasted your time.
(b) Anyone who looks at it will see that it perfectly matches the paper's specification (except for being MUCH harder to read) and won't have learned anything.
(c) Someone will try to use it, run into some kind of trouble, and bother you with annoying questions.
(d) Someone will catch some trivial bug, approximation, or limitation and use it to cast doubt on your results.
(e) Some professor will convince a naive first-year student to use your code as a starting point for their experiments and you will have contributed to that poor student's misery and anguish.; We originally classified this paper as EM_no. We did not receive code within our two month window after the initial request. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; Code now available at https://github.com/yaledb/calvin (notified via survey as of 9/22/2014) http://reproducibility.cs.arizona.edu/data/sigmod12_ThomsonDWRSA12_data.txt - http://reproducibility.cs.arizona.edu/data/sigmod12_ThomsonDWRSA12_survey.txt
YakoutGCC12 InfoGather: entity augmentation and attribute discovery by holistic matching with web tables SIGMOD '12 Mohamed Yakout, Kris Ganjam, Kaushik Chakrabarti, Surajit Chaudhuri Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_YakoutGCC12_data.txt - -
NanongkaiLSM12 Interactive regret minimization SIGMOD '12 Danupon Nanongkai, Ashwin Lall, Atish Das Sarma, Kazuhisa Makino Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_NanongkaiLSM12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_NanongkaiLSM12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_NanongkaiLSM12_survey.txt
HellingsFH12 Efficient external-memory bisimulation on DAGs SIGMOD '12 Jelle Hellings, George H.L. Fletcher, Herman Haverkort Conference 12 BC Article OK_Author http://reproducibility.cs.arizona.edu/data/sigmod12_HellingsFH12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_HellingsFH12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_HellingsFH12_survey.txt
GuoPG12 So who won?: dynamic max discovery with the crowd SIGMOD '12 Stephen Guo, Aditya Parameswaran, Hector Garcia-Molina Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/sigmod12_GuoPG12_data.txt - -
PavloCZ12 Skew-aware automatic database partitioning in shared-nothing,parallel OLTP systems SIGMOD '12 Andrew Pavlo, Carlo Curino, Stan Zdonik Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_PavloCZ12_data.txt - -
SinghNJ12 Skimmer: rapid scrolling of relational query results SIGMOD '12 Manish Singh, Arnab Nandi, Hosagrahar V. Jagadish Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_SinghNJ12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_SinghNJ12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_SinghNJ12_survey.txt
SidlauskasSJ12 Parallel main-memory indexing for moving-object query and update workloads SIGMOD '12 Darius Sidlauskas, Simonas Saltenis, Christian S. Jensen Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_SidlauskasSJ12_data.txt - -
AlagiannisBBIA12 NoDB: efficient query execution on raw data files SIGMOD '12 Ioannis Alagiannis, Renata Borovica, Miguel Branco, Stratos Idreos, Anastasia Ailamaki Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/sigmod12_AlagiannisBBIA12_data.txt - -
ThomsenYJ12 Effective caching of shortest paths for location-based services SIGMOD '12 Jeppe Rishede Thomsen, Man Lung Yiu, Christian S. Jensen Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_ThomsenYJ12_data.txt - -
XuKWCC12 A model-based approach to attributed graph clustering SIGMOD '12 Zhiqiang Xu, Yiping Ke, Yi Wang, Hong Cheng, James Cheng Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_XuKWCC12_data.txt - -
JinRXL12 A highway-centric labeling approach for answering distance queries on large sparse graphs SIGMOD '12 Ruoming Jin, Ning Ruan, Yang Xiang, Victor E. Lee Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_JinRXL12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_JinRXL12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_JinRXL12_survey.txt
MondalD12 Managing large dynamic graphs efficiently SIGMOD '12 Jayanta Mondal, Amol Deshpande Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/sigmod12_MondalD12_data.txt - http://reproducibility.cs.arizona.edu/data/sigmod12_MondalD12_survey.txt
HuXCY12 Authenticating location-based services without compromising location privacy SIGMOD '12 Haibo Hu, Jianliang Xu, Qian Chen, Ziwei Yang Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_HuXCY12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_HuXCY12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_HuXCY12_survey.txt
YuAY12 Processing a large number of continuous preference top-{\it k} queries SIGMOD '12 Albert Yu, Pankaj K. Agarwal, Jun Yang Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/sigmod12_YuAY12_data.txt - -
DingWJHW12 Optimizing index for taxonomy keyword search SIGMOD '12 Bolin Ding, Haixun Wang, Ruoming Jin, Jiawei Han, Zhongyuan Wang Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_DingWJHW12_data.txt - -
RamachandraS12 Holistic optimization by prefetching query results SIGMOD '12 Karthik Ramachandra, S Sudarshan Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/sigmod12_RamachandraS12_data.txt - http://reproducibility.cs.arizona.edu/data/sigmod12_RamachandraS12_survey.txt
YangYZK12 Towards effective partition management for large graphs SIGMOD '12 Shengqi Yang, Xifeng Yan, Bo Zong, Arijit Khan Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_YangYZK12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_YangYZK12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_YangYZK12_survey.txt
GotzNG12 MaskIt: privately releasing user context streams for personalized mobile applications SIGMOD '12 Michaela Gotz, Surman Nath, Johannes Gehrke Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_GotzNG12_data.txt - -
Zhang0D12 Aggregate suppression for enterprise search engines SIGMOD '12 Mingyang Zhang, Nan Zhang, Gautam das Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_Zhang0D12_data.txt - -
JinRDY12 SCARAB: scaling reachability computation on large graphs SIGMOD '12 Ruomin Jin, Ning Ruan, Saikat Dey, Jeffrey Yu Xu Conference 12 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/sigmod12_JinRDY12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_JinRDY12_build.txt -
FanLWW12 Query preserving graph compression SIGMOD '12 Wenfei Fan, Jianzhong Li, Xin Wang, Yinghui Wu Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_FanLWW12_data.txt - -
QianCJ12 Sample-driven schema mapping SIGMOD '12 Li Qian, Machael J. Cafarella, Hosagrahar V. Jagadish Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_QianCJ12_data.txt - -
LiG12 Online windowed subsequence matching over probabilistic sequences SIGMOD '12 Zheng Li, Tingjian ge Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/sigmod12_LiG12_data.txt - -
TeubnerWN12 Skeleton automata for FPGAs: reconfiguring without reconstructing SIGMOD '12 Jens Teubner, Louis Woods, Chongling Nie Conference 12 HW - - http://reproducibility.cs.arizona.edu/data/sigmod12_TeubnerWN12_data.txt - -
SarmaFGHLWXY12 Finding related tables SIGMOD '12 Anish Das Sarma, Lujun Fang, Nitin Gupta, Alon Halevy, Hongrae Lee, Fei Wu, Reynold Xin, Cong Yu Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_SarmaFGHLWXY12_data.txt - -
ZhouBL12 Advanced partitioning techniques for massively distributed computation SIGMOD '12 Jingren Zhou, Nicolas Bruno, Wei lin Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_ZhouBL12_data.txt - -
BegleyHC12 MCJoin: a memory-constrained join for column-store main-memory databases SIGMOD '12 Steven Begley, Zhen He, Yi-Ping Phoebe Chen Conference 12 BC EM_yes OK_leq_30 Updates to the source code of MCJoin will be made available on this webpage:
http://homepage.cs.latrobe.edu.au /zhe/ZhenHePublications.html; http://reproducibility.cs.arizona.edu/data/sigmod12_BegleyHC12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_BegleyHC12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_BegleyHC12_survey.txt
ZhuLZZY12 TreeSpan: efficiently computing similarity all-matching SIGMOD '12 Gaoping Zhu, Xuemin Lin, Ke Zhu, Wenjie Zhang, Jeffery Xu Yu Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/sigmod12_ZhuLZZY12_data.txt - -
GanFFN12 Locality-sensitive hashing scheme based on dynamic collision counting SIGMOD '12 Junhao Gan, Jianlin Feng, Qiong Fang, Wilfred Ng Conference 12 BC Web OK_Author In fact, our code is very easy to build. It is somewhat unfair to claim our code cannot be successfully built without asking for our assistance when you meet some problems during building our code.; http://reproducibility.cs.arizona.edu/data/sigmod12_GanFFN12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_GanFFN12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_GanFFN12_survey.txt
ChengKCC12 Efficient processing of distance queries in large graphs: a vertex cover approach SIGMOD '12 James Cheng, Shumo Chu, Yiping Ke, Carter Cheng Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_ChengKCC12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_ChengKCC12_build.txt -
FraternaliMT12 Top-k bounded diversification SIGMOD '12 Piero Fraternali, Davide Martinenghi, Marco Tagliasacchi Conference 12 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/sigmod12_FraternaliMT12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_FraternaliMT12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_FraternaliMT12_survey.txt
SearsR12 bLSM: a general purpose log structured merge tree SIGMOD '12 Russell Sears, Raghu Ramakrishnan Conference 12 BC Article OK_Author http://reproducibility.cs.arizona.edu/data/sigmod12_SearsR12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_SearsR12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_SearsR12_survey.txt
KanneE12 Declarative error management for robust data-intensive applications SIGMOD '12 Carl-Christian Kanne, Cuk Ercegovac Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/sigmod12_KanneE12_data.txt - -
GiatrakosDGSS12 Prediction-based geometric monitoring over distributed data streams SIGMOD '12 Nikos Giatrakos, Antonios Deliginnakis, Minos Garofalakis, Izchak Shafman, Assaf Schuster Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/sigmod12_GiatrakosDGSS12_data.txt http://reproducibility.cs.arizona.edu/data/sigmod12_GiatrakosDGSS12_build.txt http://reproducibility.cs.arizona.edu/data/sigmod12_GiatrakosDGSS12_survey.txt
GreathouseXLA12 A case for unlimited watchpoints ASPLOS '12 Joseph L. Greathouse, Hongyi Xin, Yixin Luo, Todd Austin Conference 13 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/asplos12_GreathouseXLA12_data.txt http://reproducibility.cs.arizona.edu/data/asplos12_GreathouseXLA12_build.txt http://reproducibility.cs.arizona.edu/data/asplos12_GreathouseXLA12_survey.txt
LymberopoulosRSMN12 PocketWeb: instant web browsing for mobile devices ASPLOS '12 Dimitrios Lymberopoulos, Oriana Riva, Karin Strauss, Akshay Mittal, Alexandros Ntoulas Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/asplos12_LymberopoulosRSMN12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_LymberopoulosRSMN12_survey.txt
PanneerselvamS12 Chameleon: operating system support for dynamic processors ASPLOS '12 Sankaralingam Panneerselvam, Michael M. Swift Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/asplos12_PanneerselvamS12_data.txt - -
LeeS12 Region scheduling: efficiently using the cache architectures via page-level affinity ASPLOS '12 Min Lee, Karsten Schwan Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/asplos12_LeeS12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_LeeS12_survey.txt
ChenFETW12 Iterative optimization for the data center ASPLOS '12 Yang Chen, Shuangde Fang, Lieven Eeckout, Olivier Temam, Chengyong Wu Conference 12 BC EM_no - Publishing or giving out code is easy. The hard part is to find enough resource to clean it up, make it portable, document it, and support it especially when the main goal of a project is not to build a widely used open source system but to demo ideas of a paper. Anyone with large system experience could imagine that there will be many system specfic hacks, shortcuts, and workarounds in the implementation of distributed system with many moving parts. For example, we may hard code a storage path or make some assumptions about access control configuration of the underlying systems. Such things will definitely not impact the validity of our results. And they can be smoothed out from the system given enough engineering resouce. Before that happen, we had to do substantial support work to help people deploy and run our system in the past several cases.; http://reproducibility.cs.arizona.edu/data/asplos12_ChenFETW12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_ChenFETW12_survey.txt
KadavS12 Understanding modern device drivers ASPLOS '12 Asim Kadav, Michael M. Swift Conference 12 BC EM_yes OK_Author We originally classified this paper as NC. In the survey response, the authors said the paper is BC. Therefore, we have reclassified it as BC, downloaded the code and attempted to build it. ; http://reproducibility.cs.arizona.edu/data/asplos12_KadavS12_data.txt http://reproducibility.cs.arizona.edu/data/asplos12_KadavS12_build.txt http://reproducibility.cs.arizona.edu/data/asplos12_KadavS12_survey.txt
AhmadCRV12 Tarazu: optimizing MapReduce on heterogeneous clusters ASPLOS '12 Faraz Ahmad, Srimat Chakradhar, Anand Raghunathan, T N. Vijaykumar Conference 14 EX - - http://reproducibility.cs.arizona.edu/data/asplos12_AhmadCRV12_data.txt - -
GovindanWSU12 Leveraging stored energy for handling power emergencies in aggressively provisioned datacenters ASPLOS '12 Sriram Govindan, Di Wang, Anand Sivasubramaniam, Bhuvan Urgaonkar Conference 12 HW - - I have categorized our ASPLOS'12 paper on battery based peak shaving as hardware since it requires certain hardware equipment (smart PDUs, battery/UPS units) for experimentally verifying the results.
In order to reproduce the battery based peak shaving results, you will need to connect each experimental server to an online UPS unit which should in turn be connected to one of the outlets on an intelligent PDU or power strip. Intelligent power strip allows us to remotely toggle power output to an outlet, allowing us to simulate a power outage to the corresponding battery unit. The UPS will start to source server power and the duration of battery sourcing can be controlled by toggling back power to this outlet.
The DVFS technique can be easily reproduced since most operating systems (Windows advanced power options, Linux CPU power governor) provide native support for changing the processor voltage/frequency.; http://reproducibility.cs.arizona.edu/data/asplos12_GovindanWSU12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_GovindanWSU12_survey.txt
DeVuystVT12 Execution migration in a heterogeneous-ISA chip multiprocessor ASPLOS '12 Matthew DeVuyst, Ashish Venkat, Dean M. Tullsen Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/asplos12_DeVuystVT12_data.txt - -
OlszewskiZKAA12 Aikido: accelerating shared data dynamic analyses ASPLOS '12 Marek Olszewski, Qin Zhao, David Koh, Jason Ansel, Saman Amarasinghe Conference 11 BC EM_no - We originally classified this paper as EM_no, because we received an email that said the code was not available. In the survey response, the authors said the paper has published code. We have kept the classification as EM_no. ; http://reproducibility.cs.arizona.edu/data/asplos12_OlszewskiZKAA12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_OlszewskiZKAA12_survey.txt
HariANR12 Relyzer: exploiting application-level fault equivalence to analyze application resiliency to transient faults ASPLOS '12 Siva Kumar Sastry Hari, Sarita V. Adve, Helia Naeimi, Pradeep Ramachandran Conference 12 BC EM_no - Our experimental setup needs several involved steps and not all of them are automated currently. It requires using several tools and systems that are not widely (or freely) available such as Wind River Simics, an UltraSPARC system for compiling and disassembling SPARC V9 binaries, and a cluster of machines to perform fault injection campaigns. This makes it complicated for us to package it for release; http://reproducibility.cs.arizona.edu/data/asplos12_HariANR12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_HariANR12_survey.txt
KasikciZC12 Data races vs. data race bugs: telling the difference with portend ASPLOS '12 Baris Kasikci, Cristian Zamfir, George Candea Conference 14 BC EM_no - http://reproducibility.cs.arizona.edu/data/asplos12_KasikciZC12_data.txt - -
CaulfieldMEDCS12 Providing safe, user space access to fast, solid state disks ASPLOS '12 Adrian M. Caulfield, Todoer I. Mollov, Lous Alex Eisner, Arup De, Joel Coburn, Steven Swanson Conference 13 BC EM_no - We would have liked to release the code publicly, and we have shared it with research groups have requested it. However, university policy makes public release difficult.; http://reproducibility.cs.arizona.edu/data/asplos12_CaulfieldMEDCS12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_CaulfieldMEDCS12_survey.txt
MartignoniMPSM12 Path-exploration lifting: hi-fi tests for lo-fi emulators ASPLOS '12 Lorenzo Martignoni, Stephen McCamant, Pongsin Poosankam, Dawn Song, Petros Maniatis Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/asplos12_MartignoniMPSM12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_MartignoniMPSM12_survey.txt
VolosTSL12 Applying transactional memory to concurrency bugs ASPLOS '12 Haris Volos, Andres Jaan Tack, Michael M. Swift, Shan Lu Conference 12 BC EM_yes OK_gt_30 We originally classified this papers as NC. In the survey response, the authors said that the paper is BC. Therefore, we have reclassified it as BC, downloaded the code and built it. ; http://reproducibility.cs.arizona.edu/data/asplos12_VolosTSL12_data.txt http://reproducibility.cs.arizona.edu/data/asplos12_VolosTSL12_build.txt http://reproducibility.cs.arizona.edu/data/asplos12_VolosTSL12_survey.txt
HongCSO12 Green-Marl: a DSL for easy and efficient graph analysis ASPLOS '12 Sungpack Hong, Hassan Chafi, Eric Sedlar, Kunle Olukotun Conference 14 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/asplos12_HongCSO12_data.txt http://reproducibility.cs.arizona.edu/data/asplos12_HongCSO12_build.txt http://reproducibility.cs.arizona.edu/data/asplos12_HongCSO12_survey.txt
GordonAHBLST12 ELI: bare-metal performance for I/O virtualization ASPLOS '12 Abel Gordon, Nadav Amit, Nadav HarEl, Muli Ben Yehuda, Alex Landau, Assaf Schuster, Dan Tsafrir Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/asplos12_GordonAHBLST12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_GordonAHBLST12_survey.txt
SimhaLC12 An update-aware storage system for low-locality update-intensive workloads ASPLOS '12 Dilip N Simha, Maohua Lu, Tzi-cker Chiueh Conference 12 BC EM_no - The work is somewhat easy to reproduce with the amount of information given in the paper. Since the code has been used commercially, it is a lengthy procedure to make it open source.; http://reproducibility.cs.arizona.edu/data/asplos12_SimhaLC12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_SimhaLC12_survey.txt
SzeferL12 Architectural support for hypervisor-secure virtualization ASPLOS '12 Jakub Szefer, Ruby B. Lee Conference 13 HW - - We originally classified this paper as BC and EM_no. In the survey response, the authors said the paper is HW. Therefore, we have reclassified it as HW. ; http://reproducibility.cs.arizona.edu/data/asplos12_SzeferL12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_SzeferL12_survey.txt
ChangMRSSB12 Totally green: evaluating and designing servers for lifecycle environmental impact ASPLOS '12 Jichuan Chang, Justin Meza, Parthasarathy Ranganathan, Amip Shah, Rocky Shih, Cullen Bash Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/asplos12_ChangMRSSB12_data.txt - -
NarayananH12 Whole-system persistence ASPLOS '12 Dushyanth Narayanan, Orion Hodson Conference 10 BC EM_no - http://reproducibility.cs.arizona.edu/data/asplos12_NarayananH12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_NarayananH12_survey.txt
ClementsKZ12 Scalable address spaces using RCU balanced trees ASPLOS '12 Austin T. Clements, M Frans Kaashoek, Zickolai Zeldovich Conference 12 BC Article OK_gt_30 In the first version of this study, we did not attempt kernel builds. In the final version, we did. ; http://reproducibility.cs.arizona.edu/data/asplos12_ClementsKZ12_data.txt http://reproducibility.cs.arizona.edu/data/asplos12_ClementsKZ12_build.txt http://reproducibility.cs.arizona.edu/data/asplos12_ClementsKZ12_survey.txt
LinNGR12 Efficient sequential consistency via conflict ordering ASPLOS '12 Changhui Lin, Vijay Nagarajan, Rajiv Gupta, Bharghava Rajaram Conference 13 EX - - http://reproducibility.cs.arizona.edu/data/asplos12_LinNGR12_data.txt - -
JoaoSMP12 Bottleneck identification and scheduling in multithreaded applications ASPLOS '12 Jose A. Joao, M Aater Suleman, Onur Mutlu, Yale N. Patt Conference 12 HW - - http://reproducibility.cs.arizona.edu/data/asplos12_JoaoSMP12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_JoaoSMP12_survey.txt
ParkSPCM12 SIMD defragmenter: efficient ILP realization on data-parallel architectures ASPLOS '12 Yongjun Park, Sangwon Seo, Hyunchul Park, Hyoun Kyu Cho, Scott Mahlke Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/asplos12_ParkSPCM12_data.txt - -
JaleelNSSE12 CRUISE: cache replacement and utility-aware scheduling ASPLOS '12 Aamer Jaleel, Hashem H. Najaf-abadi, Samantika Subramaniam, Simon C. Steely Jr, Joel Emer Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/asplos12_JaleelNSSE12_data.txt - -
KingDA12 Automatic generation of hardware/software interfaces ASPLOS '12 Myron King, Nirav Dave, Arvind Mithal Conference 12 BC EM_no - We originally classified this paper as EM_no. We did not receive code within our two month window after the initial request. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; Code now available at https://github.com/ruhler/smten (notified via survey as of 9/22/2014) http://reproducibility.cs.arizona.edu/data/asplos12_KingDA12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_KingDA12_survey.txt
LinWLZ12 Reflex: using low-power processors in smartphones without knowing them ASPLOS '12 Felix Xiaozhu Lin, Zhen Wang, Robert LiKamWa, Lin Zhong Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/asplos12_LinWLZ12_data.txt - -
HwangSS12 Cosmic rays don't strike twice: understanding the nature of DRAM errors and the implications for system design ASPLOS '12 Andy A. Hwang, Ioan Stefanovici, Bianca Schroeder Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/asplos12_HwangSS12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_HwangSS12_survey.txt
MeisnerW12 DreamWeaver: architectural support for deep sleep ASPLOS '12 David Meisner, Thomas F. Wenisch Conference 12 BC EM_yes OK_leq_30 Interesting effort. However, I am not surprised that only a minority of projects can be successfully built/run by another group; that demands a pretty high quality bar of the code (simply managing build environments is often a full-time job for professional software development) and I suspect most academic projects do not warrant curating code to that level of quality, as the code is often not reused after the end of the project.; http://reproducibility.cs.arizona.edu/data/asplos12_MeisnerW12_data.txt http://reproducibility.cs.arizona.edu/data/asplos12_MeisnerW12_build.txt http://reproducibility.cs.arizona.edu/data/asplos12_MeisnerW12_survey.txt
EsmaeilzadehSCB12 Architecture support for disciplined approximate programming ASPLOS '12 Hadi Esmaeilzadeh, Adrian Sampson, Luis Ceze, Doug Burger Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/asplos12_EsmaeilzadehSCB12_data.txt - -
OdairaN12 Continuous object access profiling and optimizations to overcome the memory wall and bloat ASPLOS '12 Rei Odaira, Toshio Nakatani Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/asplos12_OdairaN12_data.txt - -
FeinerBG12 Comprehensive kernel instrumentation via dynamic binary translation ASPLOS '12 Peter Feiner, Angela Demke Brown, Ashvin Goel Conference 12 BC EM_yes OK_gt_30 You didn't actually try to build it, but you gave it a pass! The comment about requiring a fresh installation of Ubuntu 12.10 was wrong, although this misunderstanding might have arisen from the instructions I emailed to you. An existing Ubuntu 12.10 installation was sufficient; more precisely, a system with a particular kernel version was required to build and run a kernel module. In any case, given that you sampled papers from systems conferences and didn't try to build a kernel module, I have doubts about the accuracy of your data and the soundness of your method. Then again, I only looked at my data point, so take my criticism with a grain of salt.; In the first version of this study, we did not attempt kernel builds. In the final version, we did. ; http://reproducibility.cs.arizona.edu/data/asplos12_FeinerBG12_data.txt http://reproducibility.cs.arizona.edu/data/asplos12_FeinerBG12_build.txt http://reproducibility.cs.arizona.edu/data/asplos12_FeinerBG12_survey.txt
VasicNMKB12 DejaVu: accelerating resource allocation in virtualized environments ASPLOS '12 Nedeljko Vasic, Dejan Novakovic, Svetozar Miucin, Dejan Kostic, Ricardo Bianchini Conference 13 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/asplos12_VasicNMKB12_data.txt http://reproducibility.cs.arizona.edu/data/asplos12_VasicNMKB12_build.txt http://reproducibility.cs.arizona.edu/data/asplos12_VasicNMKB12_survey.txt
RadojkovicCMVPCNV12 Optimal task assignment in multithreaded processors: a statistical approach ASPLOS '12 Petar Radojkovic, Vladimir Cakarevic, Miquel Moreto, Javier Verdu, Alex Pajuelo, Francisco J. Cazorla, Mario Nemirovsky, Mateo Valero Conference 14 BC EM_no - http://reproducibility.cs.arizona.edu/data/asplos12_RadojkovicCMVPCNV12_data.txt - -
CheritonFSSA12 HICAMP: architectural support for efficient concurrency-safe shared structured data access ASPLOS '12 David Cheriton, Amin Firoozshahian, Alex Solomatnikov, Jogn P. Stevenson, Omid Azizi Conference 13 HW - - http://reproducibility.cs.arizona.edu/data/asplos12_CheritonFSSA12_data.txt - http://reproducibility.cs.arizona.edu/data/asplos12_CheritonFSSA12_survey.txt
LogozzoB12 Modular and verified automatic program repair OOPSLA '12 Francesco Logozzo, Thomas Ball Conference 13 EX - - http://reproducibility.cs.arizona.edu/data/oopsla12_LogozzoB12_data.txt - -
SiddiquiK12 Scaling symbolic execution using ranged analysis OOPSLA '12 Junaid Haroon Siddiqui, Sarfraz Khurshid Conference 13 BC EM_no - http://reproducibility.cs.arizona.edu/data/oopsla12_SiddiquiK12_data.txt - -
KumarFBGT12 Work-stealing without the baggage OOPSLA '12 Vivek Kumar, Daniel Frampton, Stephen M. Blackburn, David Grove, Olivier Tardieu Conference 17 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_KumarFBGT12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KumarFBGT12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KumarFBGT12_survey.txt
LucasER12 Detecting problematic message sequences and frequencies in distributed systems OOPSLA '12 Charles Lucas, Sebastian G. Elbaum, David S. Rosenblum Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/oopsla12_LucasER12_data.txt - -
DubrauH12 Taming MATLAB OOPSLA '12 Anton Willy Dubrau, Laurie J. Hendren Conference 20 BC Article OK_leq_30 This work has been extended to add backends for Fortran and X10. Current versions are available as part of the Mclab system at https://github.com/Sable/mclab.; http://reproducibility.cs.arizona.edu/data/oopsla12_DubrauH12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_DubrauH12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_DubrauH12_survey.txt
Schultz12 Programming language abstractions for self-reconfigurable robots OOPSLA '12 Ulrik Pagh Schultz Poster 2 NC - - The paper describes a work-in-progress that did not in any way allude to being backed by code mature enough for public distribution.; http://reproducibility.cs.arizona.edu/data/oopsla12_Schultz12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_Schultz12_survey.txt
StricklandTFF12 Chaperones and impersonators: run-time support for reasonable interposition OOPSLA '12 T. Stephen Strickland, Sam Tobin-Hochstadt, Robert Bruce Findler, Matthew Flatt Conference 19 BC Article OK_gt_30 We originally classified this paper as OK_gt_30. In the survey response, the authors said that we did not attempt to build all the relevant code. Therefore, we attempted to build the remaining code. ; http://reproducibility.cs.arizona.edu/data/oopsla12_StricklandTFF12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_StricklandTFF12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_StricklandTFF12_survey.txt
Corral12 Using software quality standards to assure the quality of the mobile software product OOPSLA '12 Luis Corral Abstract 3 NC - - http://reproducibility.cs.arizona.edu/data/oopsla12_Corral12_data.txt - -
TardieuNPS12 Constrained kinds OOPSLA '12 Olivier Tardieu, Nathaniel Nystrom, Igor Peshansky, Vijay A. Saraswat Conference 20 NC - - Core calculus for generic, constrained types for OO languages -- needs to be mechanized (e.g. in Coq).; http://reproducibility.cs.arizona.edu/data/oopsla12_TardieuNPS12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_TardieuNPS12_survey.txt
KastnerOE12 A variability-aware module system OOPSLA '12 Christian Kastner, Klaus Ostermann, Sebastian Erdweg Conference 19 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_KastnerOE12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KastnerOE12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KastnerOE12_survey.txt
DattaSS12 Talk versus work: characteristics of developer collaboration on the jazz platform OOPSLA '12 Subhajit Datta, Renuka Sindhgatta, Bikram Sengupta Conference 13 NC - - http://reproducibility.cs.arizona.edu/data/oopsla12_DattaSS12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_DattaSS12_survey.txt
InoueHWN12 Adaptive multi-level compilation in a trace-based Java JIT compiler OOPSLA '12 Hiroshi Inoue, Hiroshige Hayashizaki, Peng Wu, Toshio Nakatani Conference 15 BC EM_no - http://reproducibility.cs.arizona.edu/data/oopsla12_InoueHWN12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_InoueHWN12_survey.txt
TsengT12 Software data-triggered threads OOPSLA '12 Hung-Wei Tseng, Dean M. Tullsen Conference 14 BC EM_no - Code now available at https://github.com/hungweitseng/DTT (notified via email as of 2/13/2015) http://reproducibility.cs.arizona.edu/data/oopsla12_TsengT12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_TsengT12_survey.txt
GordonPPBD12 Uniqueness and reference immutability for safe parallelism OOPSLA '12 Colin S. Gordon, Matthew J. Parkinson, Jared Parsons, Aleks Bromfield, Joe Duffy Conference 20 BC EM_no - Large percentage of the work associated to this paper is theoretical. The details of the soundness proof and formalisation is available in the technical report. The code is part of a confidential project that has not been disclosed by Microsoft. I hope that that project will be open-sourced.; http://reproducibility.cs.arizona.edu/data/oopsla12_GordonPPBD12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_GordonPPBD12_survey.txt
Effinger-DeanLCGB12 IFRit: interference-free regions for dynamic data-race detection OOPSLA '12 Laura Effinger-Dean, Brandon Lucia, Luis Ceze, Dan Grossman, Hans-Juergen Boehm Conference 17 BC EM_yes OK_gt_30
I do not like the way this study was conducted and found the follow-up work from Brown University more palatable, but I have not followed all the ripples from the initial "results" closely.; http://reproducibility.cs.arizona.edu/data/oopsla12_Effinger-DeanLCGB12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_Effinger-DeanLCGB12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_Effinger-DeanLCGB12_survey.txt
Soares12 Automated behavioral testing of refactoring engines OOPSLA '12 Gustavo Soares Soares Abstract 3 BC Web OK_leq_30 In the survey response, the authors said that the code we found was not correct and gave a link. The code we downloaded was from the same link that was given. Therefore, we have kept the original classification of code from Web. ; http://reproducibility.cs.arizona.edu/data/oopsla12_Soares12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_Soares12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_Soares12_survey.txt
SuenagaFI12 Type-based safe resource deallocation for shared-memory concurrency OOPSLA '12 Kohei Suenaga, Ryota Fukuda, Atsushi Igarashi Conference 20 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_SuenagaFI12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_SuenagaFI12_build.txt -
JoK12 Automatically enhancing locality for tree traversals with traversal splicing OOPSLA '12 Youngjoon Jo, Milind Kulkarni Conference 20 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_JoK12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_JoK12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_JoK12_survey.txt
KonatVKWV12 The spoofax name binding language OOPSLA '12 Gabriel D. P. Konat, Vlad A. Vergu, Lennart C. L. Kats, Guido Wachsmuth, Eelco Visser Poster 2 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_KonatVKWV12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KonatVKWV12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KonatVKWV12_survey.txt
ChughHJ12 Dependent types for JavaScript OOPSLA '12 Ravi Chugh, David Herman, Ranjit Jhala Conference 20 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_ChughHJ12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_ChughHJ12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_ChughHJ12_survey.txt
HuangMDE12 Reim {\&} ReImInfer: checking and inference of reference immutability and method purity OOPSLA '12 Wei Huang, Ana Milanova, Werner Dietl, Michael D. Ernst Conference 18 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_HuangMDE12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_HuangMDE12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_HuangMDE12_survey.txt
SreeramP12 Safe compiler-driven transaction checkpointing and recovery OOPSLA '12 Jaswanth Sreeram, Santosh Pande Conference 15 BC EM_no - http://reproducibility.cs.arizona.edu/data/oopsla12_SreeramP12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_SreeramP12_survey.txt
CamposE12 Applying aspect mining techniques to understand an existing program OOPSLA '12 Fernanda Campos, Yadran Eterovic Poster 2 BC EM_0 - http://reproducibility.cs.arizona.edu/data/oopsla12_CamposE12_data.txt - -
ImamS12 Integrating task parallelism with actors OOPSLA '12 Shams Mahmood Imam, Vivek Sarkar Conference 19 BC Article OK_leq_30 We are happy to share the benchmark code and scripts with individual academics so that they can run and verify the code at their end.
Instructions on building and compiling Habanero-Scala is available at http://habanero-scala.rice.edu/. The link is also available on the paper.; In the survey response, the authors classify the paper as not having code available. We downloaded their code using a link from the paper. Therefore, we have kept the classification of code from Article. ; http://reproducibility.cs.arizona.edu/data/oopsla12_ImamS12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_ImamS12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_ImamS12_survey.txt
GuBSS12 Reusing debugging knowledge via trace-based bug search OOPSLA '12 Zhongxian Gu, Earl T. Barr, Drew Schleck, Zhendong Su Conference 16 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_GuBSS12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_GuBSS12_build.txt -
BarowyCBM12 AutoMan: a platform for integrating human-based and digital computation OOPSLA '12 Daniel W. Barowy, Charlie Curtsinger, Emery D. Berger, Andrew McGregor Conference 16 BC Article OK_Author As with the last time you folks inspected our software, you appear to be using an old build. Since April 18, 2014 (nearly 5 months ago), our software has used Scala's SBT for our build system. Your notes indicate that you tried (and failed) to use the old Makefile-based build system.
If you're having trouble building, why not correspond with us? This is not commercial software; we are academics with limited resources so our testing is similarly limited. Most of these issues can probably be ironed out with a brief conversation.
If you're interested in the original version of AutoMan that was the subject of the paper, you can sidestep your build problems. We distribute a binary JAR here, which is the link that you used: http://plasma.cs.umass.edu/emery/automan; In the survey response, the authors said that the version of the code we attempted to compile was outdated. We attempted to compile the version that was available at the time. Our policy is to consider code available at the time of the study. Therefore, we have kept the original classification. ; http://reproducibility.cs.arizona.edu/data/oopsla12_BarowyCBM12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_BarowyCBM12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_BarowyCBM12_survey.txt
Xu12 Finding reusable data structures OOPSLA '12 Guoqing Xu Conference 17 BC EM_no - http://reproducibility.cs.arizona.edu/data/oopsla12_Xu12_data.txt - -
KangR12 Formal specification of a JavaScript module system OOPSLA '12 Seonghoon Kang, Sukyoung Ryu Conference 18 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_KangR12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KangR12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KangR12_survey.txt
Zhang0LZMY12 Refactoring android Java code for on-demand computation offloading OOPSLA '12 Ying Zhang, Gang Huang, Xuanzhe Liu, Wei Zhang, Hong Mei, Shunxiang Yang Conference 15 BC EM_no - http://reproducibility.cs.arizona.edu/data/oopsla12_Zhang0LZMY12_data.txt - -
SartorE12 Exploring multi-threaded Java application performance on multicore hardware OOPSLA '12 Jennifer B. Sartor, Lieven Eeckhout Conference 16 NC - - http://reproducibility.cs.arizona.edu/data/oopsla12_SartorE12_data.txt - -
PrountzosMP12 Elixir: a system for synthesizing concurrent graph programs OOPSLA '12 Dimitrios Prountzos, Roman Manevich, Keshav Pingali Conference 20 BC EM_no - http://reproducibility.cs.arizona.edu/data/oopsla12_PrountzosMP12_data.txt - -
Zarb12 Understanding communication within pair programming OOPSLA '12 Mark Zarb Abstract 3 NC - - http://reproducibility.cs.arizona.edu/data/oopsla12_Zarb12_data.txt - -
HaydenSDHF12 Kitsune: efficient, general-purpose dynamic software updating for C OOPSLA '12 Christopher M. Hayden, Edward K. Smith, Michail Denchev, Michael Hicks, Jeffrey S. Foster Conference 16 BC EM_no - The code, of the system and all of the example applications, is available and has been for the last year. It was not available at the time of publication at OOPSLA because we were exploring commercialization options and the University did not want us to release it.;When we were initially contacted, we were still working though University channels for permission to publish the code and informed the authors of this study when they contacted us. The code has since been published.; We originally classified this paper as EM_no. In an email response the authors said that the code was not available due to possible commercialization. Then, in the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; Code now available at https://github.com/kitsune-dsu (notified via survey as of 9/22/2014) http://reproducibility.cs.arizona.edu/data/oopsla12_HaydenSDHF12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_HaydenSDHF12_survey.txt
LiuSLG12 From clarity to efficiency for distributed algorithms OOPSLA '12 Yanhong A. Liu, Scott D. Stoller, Bo Lin, Michael Gorbovitski Conference 15 BC EM_yes OK_leq_30 New versions of DistAlgo are now available also on sourceforge (https://sourceforge.net/projects/distalgo/) in case you need. Thank you for your work.; http://reproducibility.cs.arizona.edu/data/oopsla12_LiuSLG12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_LiuSLG12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_LiuSLG12_survey.txt
BettsCDQT12 GPUVerify: a verifier for GPU kernels OOPSLA '12 Adam Betts, Nathan Chong, Alastair F. Donaldson, Shaz Qadeer, Paul Thomson Conference 19 BC Article OK_gt_30 I think it's fantastic that you have undertaken this comprehensive study.; http://reproducibility.cs.arizona.edu/data/oopsla12_BettsCDQT12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_BettsCDQT12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_BettsCDQT12_survey.txt
CousotCLB12 An abstract interpretation framework for refactoring with application to extract methods with contracts OOPSLA '12 Patrick Cousot, Radhia Cousot, Francesco Logozzo, Michael Barnett Conference 20 BC EM_no - The static analyzer cccheck is publicly available on Windows and is widely used (see DevLabs > Code Contract forum). The source code of the static analyzer cccheck is proprietary.; http://reproducibility.cs.arizona.edu/data/oopsla12_CousotCLB12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_CousotCLB12_survey.txt
MagillHSM12 Automating object transformations for dynamic software updating OOPSLA '12 Stephen Magill, Michael Hicks, Suriya Subramanian, Kathryn S. McKinley Conference 16 EX - - http://reproducibility.cs.arizona.edu/data/oopsla12_MagillHSM12_data.txt - -
St-AmourTF12 Optimization coaching: optimizers learn to communicate with programmers OOPSLA '12 Vincent St-Amour, Sam Tobin-Hochstadt, Matthias Felleisen Conference 16 BC Article OK_leq_30
A repeatability study takes more than clicking on links and running make scripts or the resulting executables. See for example Casey Klein et al at POPL 2012 for a repeatability study that went into depth. When we ran this study, we spent almost two years with one PhD student per case study.
-- Matthias Felleisen; We originally classified this paper as OK_lt_30. In the survey response, the authors said that we did not actually build the relevant code. Therefore, we attempted to build the relevant code. ; http://reproducibility.cs.arizona.edu/data/oopsla12_St-AmourTF12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_St-AmourTF12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_St-AmourTF12_survey.txt
RosuS12 Checking reachability using matching logic OOPSLA '12 Grigore Rosu, Andrei Stefanescu Conference 20 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_RosuS12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_RosuS12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_RosuS12_survey.txt
WaelC12 How to achieve scalable fork/join on many-core architectures? OOPSLA '12 Mattias De Wael, Tom Van Cutsem Poster 2 NC - - http://reproducibility.cs.arizona.edu/data/oopsla12_WaelC12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_WaelC12_survey.txt
ZhaoPYQWGOPMET12 The HipHop compiler for PHP OOPSLA '12 Guilherme Ottoni, Haiping Zhao, Iain Proctor, Minghui Yang, Xin Qi, Mark Williams, Qi Gao, Andrew Paroski, Scott MacVicar, Jason Evans, Stephen Tu Conference 11 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_ZhaoPYQWGOPMET12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_ZhaoPYQWGOPMET12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_ZhaoPYQWGOPMET12_survey.txt
Nishino12 Developing a new computer music programming language in the 'research through design' context OOPSLA '12 Hiroki Nishino Abstract 3 NC - - http://reproducibility.cs.arizona.edu/data/oopsla12_Nishino12_data.txt - -
HuangZ12 LEAN: simplifying concurrency bug reproduction via replay-supported execution reduction OOPSLA '12 Jeff Huang, Charles Zhang Conference 15 BC EM_no - http://reproducibility.cs.arizona.edu/data/oopsla12_HuangZ12_data.txt - -
MusluBHEN12 Speculative analysis of integrated development environment recommendations OOPSLA '12 Kivanc Muslu, Yuriy Brun, Reid Holmes, Michael D. Ernst, David Notkin Conference 14 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_MusluBHEN12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_MusluBHEN12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_MusluBHEN12_survey.txt
VoracekT12 JaDaRD: java data-race detector OOPSLA '12 Filip Voracek, Zdenek Tronicek Poster 2 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_VoracekT12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_VoracekT12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_VoracekT12_survey.txt
MishneSY12 Typestate-based semantic code search over partial programs OOPSLA '12 Alon Mishne, Sharon Shoham, Eran Yahav Conference 20 BC Article OK_leq_30 updated codebase:
https://github.com/tech-srl/prime; http://reproducibility.cs.arizona.edu/data/oopsla12_MishneSY12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_MishneSY12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_MishneSY12_survey.txt
HafizA12 The nature of order: from security patterns to a pattern language OOPSLA '12 Munawar Hafiz, Paul Adamczyk Poster 2 BC EM_yes OK_leq_30 Originally, we classified this paper as BC. We were given relevant code in an email exchange and we found an online implementation for the paper. In the survey, the authors say that the paper is NC. We have kept the original classification of BC. ; http://reproducibility.cs.arizona.edu/data/oopsla12_HafizA12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_HafizA12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_HafizA12_survey.txt
HuangZ12a Execution privatization for scheduler-oblivious concurrent programs OOPSLA '12 Jeff Huang, Charles Zhang Conference 16 EX - - http://reproducibility.cs.arizona.edu/data/oopsla12_HuangZ12a_data.txt - -
ParizekL12 Predicate abstraction of Java programs with collections OOPSLA '12 Pavel Parizek, Ondrej Lhotak Conference 20 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_ParizekL12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_ParizekL12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_ParizekL12_survey.txt
WangLZ012 Migration and execution of JavaScript applications between mobile devices and cloud OOPSLA '12 Xudong Wang, Xuanzhe Liu, Ying Zhang, Gang Huang Poster 2 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_WangLZ012_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_WangLZ012_build.txt -
TamayoABS12 Understanding the behavior of database operations under program control OOPSLA '12 Juan M. Tamayo, Alex Aiken, Nathan Grasso Bronson, Mooly Sagiv Conference 13 EX - - http://reproducibility.cs.arizona.edu/data/oopsla12_TamayoABS12_data.txt - -
CastanosEINNOW12 On the benefits and pitfalls of extending a statically typed language JIT compiler for dynamic scripting languages OOPSLA '12 Jose G. Castanos, David Edelsohn, Kazuaki Ishizaki, Priya Nagpurkar, Toshio Nakatani, Takeshi Ogasawara, Peng Wu Conference 18 EX - - http://reproducibility.cs.arizona.edu/data/oopsla12_CastanosEINNOW12_data.txt - -
MeawadRMV12 Eval begone!: semi-automated removal of eval from javascript programs OOPSLA '12 Fadi Meawad, Gregor Richards, Floreal Morandat, Jan Vitek Conference 14 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_MeawadRMV12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_MeawadRMV12_build.txt -
SchillerE12 Reducing the barriers to writing verified specifications OOPSLA '12 Todd W. Schiller, Michael D. Ernst Conference 17 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_SchillerE12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_SchillerE12_build.txt -
MullerC12 Towards a practical secure concurrent language OOPSLA '12 Stefan Muller, Stephen Chong Conference 18 BC EM_yes OK_Author We aimed in our paper to provide enough information to allow research groups to reproduce our results, i.e., to reimplement the concepts in our analysis. We believe that we accomplished this.
We made the code available as a courtesy on request, and were prepared to spend time and energy enabling interested researchers to replicate and extend our results, i.e., to use our code base. We did not aiming to provide a distribution of our code that works robustly out of the box. While we may aim to do this with future research projects, it was not an aim of the current work.; http://reproducibility.cs.arizona.edu/data/oopsla12_MullerC12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_MullerC12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_MullerC12_survey.txt
CohenZSL12 Energy types OOPSLA '12 Michael Cohen, Haitao Steve Zhu, Emgin Ezgi Senem, Yu David Liu Conference 19 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_CohenZSL12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_CohenZSL12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_CohenZSL12_survey.txt
Anderson12 Efficiently combining parallel software using fine-grained,language-level, hierarchical resource management policies OOPSLA '12 Zachary R. Anderson Conference 20 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_Anderson12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_Anderson12_build.txt -
Giarrusso12 Reifying and optimizing collection queries for modularity OOPSLA '12 Paolo G. Giarrusso Abstract 3 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_Giarrusso12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_Giarrusso12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_Giarrusso12_survey.txt
WuZSJGS12 Exploiting inter-sequence correlations for program behavior prediction OOPSLA '12 Bo Wu, Zhijia Zhao, Xipeng Shen, Yunlian Jiang, Yaoqing Gao, Raul Silvera Conference 15 NC - - http://reproducibility.cs.arizona.edu/data/oopsla12_WuZSJGS12_data.txt - -
KlingMCR12 Bolt: on-demand infinite loop escape in unmodified binaries OOPSLA '12 Michael Kling, Sasa Misailovic, Michael Carbin, Martin C. Rinard Conference 20 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_KlingMCR12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KlingMCR12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KlingMCR12_survey.txt
KaliberaMJV12 A black-box approach to understanding concurrency in DaCapo OOPSLA '12 Tomas Kalibera, Matthew Mole, Richard Jones, Jan Vitek Conference 20 BC Article OK_gt_30 Our work is useful for researchers working with jikesrvm, btrace etc. Researchers need to understand how to build/use these tools before they look at our work. We strongly suggest that your study applies at least the same standards of evaluation as those used by the ECOOP Artifact Evaluation process.; http://reproducibility.cs.arizona.edu/data/oopsla12_KaliberaMJV12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KaliberaMJV12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_KaliberaMJV12_survey.txt
KulkarniC12 Mitigating the compiler optimization phase-ordering problem using machine learning OOPSLA '12 Sameer Kulkarni, John Cavazos Conference 16 BC EM_no - http://reproducibility.cs.arizona.edu/data/oopsla12_KulkarniC12_data.txt - -
SolodkyyRS12 Open and efficient type switch for C++ OOPSLA '12 Yuriy Solodkyy, Gabriel Dos Reis, Bjarne Stroustrup Conference 20 BC Article OK_gt_30 The project continues to evolve on GitHub: https://github.com/solodon4/Mach7.
We also had a follow-up publication on the mentioned larger pattern-matching library at GPCE'13 (dl.acm.org/citation.cfm?doid=2517208.2517222) with Extended Abstract of it appearing in SPLASH'13 (dl.acm.org/citation.cfm?doid=2508075.2508098).; http://reproducibility.cs.arizona.edu/data/oopsla12_SolodkyyRS12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_SolodkyyRS12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_SolodkyyRS12_survey.txt
RicciS12 From actors to agent-oriented programming abstractions in simpAL OOPSLA '12 Alessandro Ricci, Andrea Santi Poster 2 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_RicciS12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_RicciS12_build.txt -
Tobin-HochstadtH12 Higher-order symbolic execution via contracts OOPSLA '12 Sam Tobin-Hochstadt, David Van Horn Conference 18 BC Article OK_gt_30 Updated and improved versions of this tool are available at https://github.com/philnguyen/soft-contract/ (full system) and http://dvanhorn.github.io/pcf/ (simple illustrative version).; http://reproducibility.cs.arizona.edu/data/oopsla12_Tobin-HochstadtH12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_Tobin-HochstadtH12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_Tobin-HochstadtH12_survey.txt
MayerHRTS12 An empirical study of the influence of static type systems on the usability of undocumented software OOPSLA '12 Clemens Mayer, Stefan Hanenberg, Romain Robbes, Eric Tanter, Andreas Stefik Conference 20 NC - - We originally classified this paper as NC. In the survey response, the authors said that the paper is BC. The paper is a behavioral study of programmers debugging code. By design, the code does not compile without modification. Therefore, we have kept the original classification of NC. ; http://reproducibility.cs.arizona.edu/data/oopsla12_MayerHRTS12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_MayerHRTS12_survey.txt
BocqD12 Molecule: using monadic and streaming I/O to compose process networks on the JVM OOPSLA '12 Sebastien Bocq, Koen Daenen Conference 20 BC EM_yes OK_leq_30 The latest version (v0.5.2) at https://github.com/molecule-labs/molecule/ can be cross-compiled to scala 2.9.3 and 2.10. It confirms the benefits of an embedded DSL. With almost zero effort, we adapted the code to support developers leveraging the evolution of Scala and still running the code on JVM1.6 or above.
When using the scala2.10 compiler option to target Java7, the byte code will make use of invokedynamic. This will probably speed up our code even more. (I haven't yet re-run the same benchmarks on the same hardware to be able to measure the difference.)
Now the documentation explains how to run the examples.; In the survey response, the authors said that we did not find the correct code. We used a link that was given both in an original email and in the survey. The link was missing from the our record. Therefore, we have added the link and kept the original classification of EM_yes. ; http://reproducibility.cs.arizona.edu/data/oopsla12_BocqD12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_BocqD12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_BocqD12_survey.txt
AusielloDFF12 k-Calling context profiling OOPSLA '12 Giorgio Ausiello, Camil Demetrescu, Irene Finocchi, Donatella Firmani Conference 11 BC EM_yes Fails http://reproducibility.cs.arizona.edu/data/oopsla12_AusielloDFF12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_AusielloDFF12_build.txt -
LeinoM12 Program extrapolation with jennisys OOPSLA '12 K. Rustan M. Leino, Aleksandar Milicevic Conference 20 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/oopsla12_LeinoM12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_LeinoM12_build.txt -
YuNPP12 Maple: a coverage-driven testing tool for multithreaded programs OOPSLA '12 Jie Yu, Satish Narayanasamy, Cristiano Pereira, Gilles Pokam Conference 18 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/oopsla12_YuNPP12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_YuNPP12_build.txt http://reproducibility.cs.arizona.edu/data/oopsla12_YuNPP12_survey.txt
BaoZZ12 White box sampling in uncertain data processing enabled by program analysis OOPSLA '12 Tao Bao, Yunhui Zheng, Xiangyu Zhang Conference 17 BC Article Fails http://reproducibility.cs.arizona.edu/data/oopsla12_BaoZZ12_data.txt http://reproducibility.cs.arizona.edu/data/oopsla12_BaoZZ12_build.txt -
TakikawaSDTF12 Gradual typing for first-class classes OOPSLA '12 Asumu Takikawa, T. Stephen Strickland, Christos Dimoulas, Sam Tobin-Hochstadt, Matthias Felleisen Conference 18 NC - - http://reproducibility.cs.arizona.edu/data/oopsla12_TakikawaSDTF12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_TakikawaSDTF12_survey.txt
AsaithambiJ12 Generic adaptable test cases for software product line testing: software product line OOPSLA '12 Suriya Priya R. Asaithambi, Stan Jarzabek Abstract 3 NC - - http://reproducibility.cs.arizona.edu/data/oopsla12_AsaithambiJ12_data.txt - http://reproducibility.cs.arizona.edu/data/oopsla12_AsaithambiJ12_survey.txt
RenganarayananKSR12 Parameterized loop tiling TOPLAS '34 Lakshminarayanan Renganarayanan, Daegon Kim, Michelle Mills Strout, Sanjay Rajopadhye Journal 41 BC Article Fails http://reproducibility.cs.arizona.edu/data/toplas34_RenganarayananKSR12_data.txt http://reproducibility.cs.arizona.edu/data/toplas34_RenganarayananKSR12_build.txt -
DolbyHMTVV12 A data-centric approach to synchronization TOPLAS '34 Frank Tip, Mandana Vaziri, Jan Vitek, Julian Dolby, Christian Hammer, Daniel Marino Journal 48 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/toplas34_DolbyHMTVV12_data.txt http://reproducibility.cs.arizona.edu/data/toplas34_DolbyHMTVV12_build.txt -
VerdoolaegeJB12 Equivalence checking of static affine programs using widening to handle recurrences TOPLAS '34 Sven Verdoolaege, Gerda Janssens, Maurice Bruynooghe Journal 35 EX - - http://reproducibility.cs.arizona.edu/data/toplas34_VerdoolaegeJB12_data.txt - -
Ben-AmramGM12 On the Termination of Integer Loops TOPLAS '34 Samir Genaim, Amir M. Ben-Amram, Abu Naser Masud Journal 24 NC - - http://reproducibility.cs.arizona.edu/data/toplas34_Ben-AmramGM12_data.txt - http://reproducibility.cs.arizona.edu/data/toplas34_Ben-AmramGM12_survey.txt
JoishaSBBC12 On a Technique for Transparently Empowering Classical Compiler Optimizations on Multithreaded Code TOPLAS '34 Pramod G. Joisha, Robert S. Schreiber, Prithviraj Banerjee, Hans-J. Boehm, Dhruva R. Chakrabarti Journal 42 EX - - http://reproducibility.cs.arizona.edu/data/toplas34_JoishaSBBC12_data.txt - -
0002AH12 Multivariate amortized resource analysis TOPLAS '34 Jan Hoffmann, Klaus Aehlig, Martin Hofmann Journal 62 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/toplas34_0002AH12_data.txt http://reproducibility.cs.arizona.edu/data/toplas34_0002AH12_build.txt http://reproducibility.cs.arizona.edu/data/toplas34_0002AH12_survey.txt
WuM12 ScalaExtrap: Trace-based communication extrapolation for SPMD programs TOPLAS '34 Xing Wu, Frank Mueller Journal 10 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/toplas34_WuM12_data.txt http://reproducibility.cs.arizona.edu/data/toplas34_WuM12_build.txt -
SmansJP12 Implicit dynamic frames TOPLAS '34 Jan Smans, Bart Jacobs, Frank Piessens Journal 58 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/toplas34_SmansJP12_data.txt http://reproducibility.cs.arizona.edu/data/toplas34_SmansJP12_build.txt -
CarboneHY12 Structured Communication-Centered Programming for Web Services TOPLAS '34 Marco Carbone, Kohei Honda, Nobuko Yoshida Journal 78 NC - - http://reproducibility.cs.arizona.edu/data/toplas34_CarboneHY12_data.txt - http://reproducibility.cs.arizona.edu/data/toplas34_CarboneHY12_survey.txt
BoudolLRS12 Reasoning about Web Applications: An Operational Semantics for HOP TOPLAS '34 Zhengqin luo, Tamara Rezk, Manuel Serrano, Gerard Boudol Journal 40 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/toplas34_BoudolLRS12_data.txt http://reproducibility.cs.arizona.edu/data/toplas34_BoudolLRS12_build.txt -
JongeKVS12 Natural and Flexible Error Recovery for Generated Modular Language Environments TOPLAS '34 Maartie De Jonge, Lennart C. L. Kats, Eelco Visser, Emma Soderberg Journal 50 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/toplas34_JongeKVS12_data.txt http://reproducibility.cs.arizona.edu/data/toplas34_JongeKVS12_build.txt -
BoddenLH12 Partially Evaluating Finite-State Runtime Monitors Ahead of Time TOPLAS '34 Patrick Lam, Eric Bodden, Laurie Hendren Journal 52 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/toplas34_BoddenLH12_data.txt http://reproducibility.cs.arizona.edu/data/toplas34_BoddenLH12_build.txt http://reproducibility.cs.arizona.edu/data/toplas34_BoddenLH12_survey.txt
BenderskyP12 Space overhead bounds for dynamic memory management with partial compaction TOPLAS '34 Anna Bendersky, Erez Petrank Journal 12 NC - - http://reproducibility.cs.arizona.edu/data/toplas34_BenderskyP12_data.txt - -
GantyM12 Algorithmic verification of asynchronous programs TOPLAS '34 Pierre Ganty, Rupak Majumdar Journal 48 NC - - http://reproducibility.cs.arizona.edu/data/toplas34_GantyM12_data.txt - http://reproducibility.cs.arizona.edu/data/toplas34_GantyM12_survey.txt
FengDY12 Bisimulation for Quantum Processes TOPLAS '34 Yuan Feng, Runyao Duan, Mingsheng Ying Journal 43 NC - - http://reproducibility.cs.arizona.edu/data/toplas34_FengDY12_data.txt - -
FraineES12 Essential AOP: The a calculus TOPLAS '34 Bruno De Fraine, Erik Ernst, Mario Sudholt Journal 43 BC Article OK_leq_30 Thanks for doing a repeatability study, we should have more of them!;The examples for our calculus are provided with the proof. There is no need for any extra effort for "executing" the examples. If proof and the examples build, the examples have typechecked correctly.; http://reproducibility.cs.arizona.edu/data/toplas34_FraineES12_data.txt http://reproducibility.cs.arizona.edu/data/toplas34_FraineES12_build.txt http://reproducibility.cs.arizona.edu/data/toplas34_FraineES12_survey.txt
DubachCRBF12 Compiling a high-level language for GPUs: (via language support for architectures and compilers) PLDI '12 Christophe Dubach, Perry Cheng, Rodric M. Rabbah, David F. Bacon, Stephen J. Fink Conference 11 EX - - http://reproducibility.cs.arizona.edu/data/pldi12_DubachCRBF12_data.txt - -
CarteyLM12 Synthesising graphics card programs from DSLs PLDI '12 Luke Cartey, Rune Lyngso, Oege de Moor Conference 11 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_CarteyLM12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_CarteyLM12_build.txt -
PetrovVSD12 Race detection for web applications PLDI '12 Boris Petrov, Martin T. Vechev, Manu Sridharan, Julian Dolby Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_PetrovVSD12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_PetrovVSD12_survey.txt
JohnsonKPZA12 Speculative separation for privatization and reductions PLDI '12 Nick P. Johnson, Hanjun Kim, Prakash Prabhu, Ayal Zaks, David I. August Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_JohnsonKPZA12_data.txt - -
MorrisettTTTG12 RockSalt: better, faster, stronger SFI for the x86 PLDI '12 Greg Morrisett, Gang Tan, Joseph Tassarotti, Jean-Baptiste Tristan, Edward Gan Conference 10 BC EM_yes OK_leq_30 Very worthwhile study. Thanks for doing this. I know you caught a lot of flak for the initial results, but I really appreciate the followup and care that you've taken.; We originally classified this paper as Em_yes. In the survey response, one author said that we didn't find the correct code and the other two said that we did. The link that we used matches links given in the survey. We have kept the original classification of EM_yes. ; http://reproducibility.cs.arizona.edu/data/pldi12_MorrisettTTTG12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_MorrisettTTTG12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_MorrisettTTTG12_survey.txt
SarkarMOBSMAW12 Synchronising C/C++ and POWER PLDI '12 Susmit Sarkar, Kayvan Memarian, Scott Owens, Mark Batty, Peter Sewell, Luc Maranget, Jade Alglave, Derek Williams Conference 11 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/pldi12_SarkarMOBSMAW12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_SarkarMOBSMAW12_build.txt -
SamadiHMLM12 Adaptive input-aware compilation for graphics engines PLDI '12 Mehrzad Samadi, Amir Hormati, Mojtaba Mehrara, Janghaeng Lee, Scott A. Mahlke Conference 10 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_SamadiHMLM12_data.txt - -
RamanZLA12 Parcae: a system for flexible parallel execution PLDI '12 Arun Raman, Ayal Zaks, Jae W. Lee, David I. August Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/pldi12_RamanZLA12_data.txt - -
RamanZSVY12 Scalable and precise dynamic datarace detection for structured parallelism PLDI '12 Raghavan Raman, Jisheng Zhao, Vivek Sarkar, Martin T. Vechev, Eran Yahav Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/pldi12_RamanZSVY12_data.txt - -
FischerME12 Engage: a deployment management system PLDI '12 Jeffrey Fischer, Rupak Majumdar, Shahram Esmaeilsabzali Conference 11 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/pldi12_FischerME12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_FischerME12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_FischerME12_survey.txt
RegehrCCEEY12 Test-case reduction for C compiler bugs PLDI '12 John Regehr, Yang Chen, Pascal Cuoq, Eric Eide, Chucky Ellison, Xuejun Yang Conference 11 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_RegehrCCEEY12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_RegehrCCEEY12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_RegehrCCEEY12_survey.txt
OhHLLY12 Design and implementation of sparse global analyses for C-like languages PLDI '12 Hakjoo Oh, Kihong Heo, Wonchan Lee, Woosuk Lee, Kwangkeun Yi Conference 10 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_OhHLLY12_data.txt - -
GrebenshchikovLPR12 Synthesizing software verifiers from proof rules PLDI '12 Sergey Grebenshchikov, Nuno P. Lopes, Corneliu Popeea, Andrey Rybalchenko Conference 12 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_GrebenshchikovLPR12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_GrebenshchikovLPR12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_GrebenshchikovLPR12_survey.txt
ChiwKRSS12 Diderot: a parallel DSL for image analysis and visualization PLDI '12 Charisee Chiw, Gordon Kindlmann, John Reppy, Lamont Samuels, Nick Seltzer Conference 10 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/pldi12_ChiwKRSS12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_ChiwKRSS12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_ChiwKRSS12_survey.txt
FengGN12 Effective parallelization of loops in the presence of I/O operations PLDI '12 Min Feng, Rajiv Gupta, Iulian Neamtiu Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_FengGN12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_FengGN12_survey.txt
LeeCFN12 Chimera: hybrid program analysis for determinism PLDI '12 Dongyoon Lee, Peter M. Chen, Jason Flinn, Satish Narayanasamy Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/pldi12_LeeCFN12_data.txt - -
CarbinKMR12 Proving acceptability properties of relaxed nondeterministic approximate programs PLDI '12 Michael Carbin, Deokhwan Kim, Sasa Misailovic, Martin C. Rinard Conference 12 BC Article OK_gt_30 We originally classified this paper as BC. In the survey response, the authors said that the paper is NC. The paper has a link to code for a proof checker. Therefore, we have kept the original classification of BC. ; http://reproducibility.cs.arizona.edu/data/pldi12_CarbinKMR12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_CarbinKMR12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_CarbinKMR12_survey.txt
TrippMFS12 JANUS: exploiting parallelism via hindsight PLDI '12 Omer Tripp, Roman Manevich, John Field, Mooly Sagiv Conference 11 EX - - http://reproducibility.cs.arizona.edu/data/pldi12_TrippMFS12_data.txt - -
AlbarghouthiKNR12 Parallelizing top-down interprocedural analyses PLDI '12 Aws Albarghouthi, Rahul Kumar, Aditya V. Nori, Sriram K. Rajamani Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_AlbarghouthiKNR12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_AlbarghouthiKNR12_survey.txt
CoppaDF12 Input-sensitive profiling PLDI '12 Emilio Coppa, Camil Demetrescu, Irene Finocchi Conference 10 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_CoppaDF12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_CoppaDF12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_CoppaDF12_survey.txt
HawkinsAFRS12 Concurrent data representation synthesis PLDI '12 Peter Hawkins, Alex Aiken, Kathleen Fisher, Martin C. Rinard, Mooly Sagiv Conference 11 EX - - http://reproducibility.cs.arizona.edu/data/pldi12_HawkinsAFRS12_data.txt - -
HolewinskiRRFPRS12 Dynamic trace-based analysis of vectorization potential of applications PLDI '12 Justin Holewinski, Ragavendar Ramamurthi, Mahesh Ravishankar, Naznin Fauzia, Louis-Noel Pouchet, Atanas Rountev, P. Sadayappan Conference 12 BC EM_yes OK_Author The build process failed because LLVM was not built from scratch. Please see the public release of the tool at hpcrl.cse.ohio-state.edu/wiki/index.php/DDGVec and the build instruction in file README; http://reproducibility.cs.arizona.edu/data/pldi12_HolewinskiRRFPRS12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_HolewinskiRRFPRS12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_HolewinskiRRFPRS12_survey.txt
LiuZJDK12 A compiler framework for extracting superword level parallelism PLDI '12 Jun Liu, Yuanrui Zhang, Ohyoung Jang, Wei Ding, Mahmut T. Kandemir Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_LiuZJDK12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_LiuZJDK12_survey.txt
PerelmanGBG12 Type-directed completion of partial expressions PLDI '12 Daniel Perelman, Sumit Gulwani, Thomas Ball, Dan Grossman Conference 11 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_PerelmanGBG12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_PerelmanGBG12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_PerelmanGBG12_survey.txt
OanceaR12 Logical inference techniques for loop parallelization PLDI '12 Cosmin E. Oancea, Lawrence Rauchwerger Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_OanceaR12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_OanceaR12_survey.txt
DilligDA12 Automated error diagnosis using abductive inference PLDI '12 Isil Dillig, Thomas Dillig, Alex Aiken Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_DilligDA12_data.txt - -
Turon12 Reagents: expressing and composing fine-grained concurrency PLDI '12 Aaron Turon Conference 12 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_Turon12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_Turon12_build.txt -
PradelG12 Fully automatic and precise detection of thread safety violations PLDI '12 Michael Pradel, Thomas R. Gross Conference 10 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_PradelG12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_PradelG12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_PradelG12_survey.txt
LeungGAGJL12 Verifying GPU kernels by test amplification PLDI '12 Alan Leung, Manish Gupta, Yuvraj Agarwal, Rajesh Gupta, Ranjit Jhala, Sorin Lerner Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_LeungGAGJL12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_LeungGAGJL12_survey.txt
KruijfSJ12 Static analysis and compiler design for idempotent processing PLDI '12 Marc de Kruijf, Karthikeyan Sankaralingam, Somesh Jha Conference 12 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_KruijfSJ12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_KruijfSJ12_build.txt -
JinSSSL12 Understanding and detecting real-world performance bugs PLDI '12 Guoliang Jin, Linhai Song, Xiaoming Shi, Joel Scherpelz, Shan Lu Conference 11 BC EM_yes OK_Author We originally classified this paper as EM_yes. The authors sent code in an email attachment. In the survey response, the authors said that we didn't download the correct code. We have kept the original classification of EM_yes. ; http://reproducibility.cs.arizona.edu/data/pldi12_JinSSSL12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_JinSSSL12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_JinSSSL12_survey.txt
GodefroidT12 Automated synthesis of symbolic instruction encodings from I/O samples PLDI '12 Patrice Godefroid, Ankur Taly Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_GodefroidT12_data.txt - -
NagarakatteBMM12 Multicore acceleration of priority-based schedulers for concurrency bug detection PLDI '12 Santosh Nagarakatte, Sebastian Burckhardt, Milo M. K. Martin, Madanlal Musuvathi Conference 12 BC EM_no - We originally classified this paper as EM_no. We did not receive code within our two month window after the initial request. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; http://reproducibility.cs.arizona.edu/data/pldi12_NagarakatteBMM12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_NagarakatteBMM12_survey.txt
KawaguchiRBJ12 Deterministic parallelism via liquid effects PLDI '12 Ming Kawaguchi, Patrick Maxim Rondon, Alexander Bakst, Ranjit Jhala Conference 10 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/pldi12_KawaguchiRBJ12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_KawaguchiRBJ12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_KawaguchiRBJ12_survey.txt
KuznetsovKBC12 Efficient state merging in symbolic execution PLDI '12 Volodymyr Kuznetsov, Johannes Kinder, Stefan Bucur, George Candea Conference 12 BC Article OK_gt_30 The implementation of the state merging algorithm described in our PLDI'12 paper is available as a self-contained archive with the source code and automated build scripts. For now, this code is not part of the Cloud9 distribution that the student built. Instead, it is available as a separate download, as explained on the Cloud9 website http://cloud9.epfl.ch/.
In addition to the source code, we also released the experimental data that we collected during our evaluation.
We provide support for the code on a dedicated mailing list (https://groups.google.com/forum/ #!forum/cloud9-dev). The list currently has nearly 50 members, many of whom successfully compiled the code and are using it for research.; In the survey response, the authors said that we built the wrong code. We built related but incorrect code from their website. Therefore, we have attempted to compile the correct code. ; http://reproducibility.cs.arizona.edu/data/pldi12_KuznetsovKBC12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_KuznetsovKBC12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_KuznetsovKBC12_survey.txt
OliveiraSCLY12 The implicit calculus: a new foundation for generic programming PLDI '12 Bruno C. d. S. Oliveira, Tom Schrijvers, Wontae Choi, Wonchan Lee, Kwangkeun Yi Conference 10 NC - - Originally, we classified this paper as BC and OK_gt_30. In the survey response, the authors said that the paper as NC and that the paper's correctness depends on the correctness of the proofs and that the code is only an add-on. Therefore, we have reclassified it as NC. ; http://reproducibility.cs.arizona.edu/data/pldi12_OliveiraSCLY12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_OliveiraSCLY12_survey.txt
ZaparanuksH12 Algorithmic profiling PLDI '12 Dmitrijs Zaparanuks, Matthias Hauswirth Conference 10 BC EM_no - We originally classified this paper as EM_no. We did not receive code within our two month window after the initial request. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; Code now available at http://sape.inf.usi.ch/sites/default/files/algoProf-0.9.zip (notified via survey as of 9/22/2014) http://reproducibility.cs.arizona.edu/data/pldi12_ZaparanuksH12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_ZaparanuksH12_survey.txt
GuerraouiKL12 Speculative linearizability PLDI '12 Rachid Guerraoui, Viktor Kuncak, Giuliano Losa Conference 12 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/pldi12_GuerraouiKL12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_GuerraouiKL12_build.txt -
HackettG12 Fast and precise hybrid type inference for JavaScript PLDI '12 Brian Hackett, Shu-yu Guo Conference 11 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/pldi12_HackettG12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_HackettG12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_HackettG12_survey.txt
Chen12 Polyhedra scanning revisited PLDI '12 Chun Chen Conference 10 BC EM_yes OK_gt_30 Initially, the build evaluation was done off a wrong link to the code,which is deprecated. Once we provided the right link to the software, the build was accomplished with reasonable effort.; http://reproducibility.cs.arizona.edu/data/pldi12_Chen12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_Chen12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_Chen12_survey.txt
BenzHH12 A dynamic program analysis to find floating-point accuracy problems PLDI '12 Florian Benz, Andreas Hildebrandt, Sebastian Hack Conference 10 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_BenzHH12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_BenzHH12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_BenzHH12_survey.txt
GazzilloG12 SuperC: parsing all of C by taming the preprocessor PLDI '12 Paul Gazzillo, Robert Grimm Conference 12 BC Article OK_gt_30 We originally ran the binary of this project and accepted this as compiling and running. This was against the intended policy of our study. In the survey response, the authors said that we didn't attempt to build from source. Therefore, we have attempted the build from source. ; http://reproducibility.cs.arizona.edu/data/pldi12_GazzilloG12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_GazzilloG12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_GazzilloG12_survey.txt
EomD12 Self-stabilizing Java PLDI '12 Yong Hun Eom, Brian Demsky Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/pldi12_EomD12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_EomD12_build.txt -
WuTHCY12 Sound and precise analysis of parallel programs through schedule specialization PLDI '12 Jingyue Wu, Yang Tang, Gang Hu, Heming Cui, Junfeng Yang Conference 12 BC EM_0 - We originally classified this paper as BC. In the survey, the authors say that the paper is NC. The paper describes a software framework that was built. Therefore, we have kept the classification as BC. ; http://reproducibility.cs.arizona.edu/data/pldi12_WuTHCY12_data.txt - http://reproducibility.cs.arizona.edu/data/pldi12_WuTHCY12_survey.txt
BaconCS12 And then there were none: a stall-free real-time garbage collector for reconfigurable hardware PLDI '12 David F. Bacon, Perry Cheng, Sunil Shukla Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/pldi12_BaconCS12_data.txt - -
ChenDA12 Type-directed automatic incrementalization PLDI '12 Yan Chen, Joshua Dunfield, Umut A. Acar Conference 12 BC EM_yes OK_leq_30 The source code is publicly available at www.mpi-sws.org/~chenyan/papers/pldi12-src.tgz; We originally classified this paper as EM_no. The authors had replied positively to our initial inquiry over email but we didn't follow up our request. In the survey response, the authors give a link to the code. Therefore, we have classified the paper as EM_yes, downloaded the code and made a build attempt. ; http://reproducibility.cs.arizona.edu/data/pldi12_ChenDA12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_ChenDA12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_ChenDA12_survey.txt
LiuNPVY12 Dynamic synthesis for relaxed memory models PLDI '12 Feng Liu, Nayden Nedev, Nedyalko Prisadnikov, Martin T. Vechev, Eran Yahav Conference 11 EX - - http://reproducibility.cs.arizona.edu/data/pldi12_LiuNPVY12_data.txt - -
ZhangAM12 Language-based control and mitigation of timing channels PLDI '12 Danfeng Zhang, Aslan Askarov, Andrew C. Myers Conference 11 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/pldi12_ZhangAM12_data.txt http://reproducibility.cs.arizona.edu/data/pldi12_ZhangAM12_build.txt http://reproducibility.cs.arizona.edu/data/pldi12_ZhangAM12_survey.txt
ChandraKSNZ11 Intrusion recovery for database-backed web applications SOSP '11 Ramesh Chandra, Taesoo Kim, Meelap Shah, Neha Narula, Nickolai Zeldovich Conference 14 EX - - http://reproducibility.cs.arizona.edu/data/sosp11_ChandraKSNZ11_data.txt - -
ChenSGK11 Design implications for enterprise storage systems via multi-dimensional trace analysis SOSP '11 Yanpei Chen, Kiran Srinivasan, Garth R. Goodson, Randy H. Katz Conference 14 BC EM_no - The code for this research was considered proprietary information.; http://reproducibility.cs.arizona.edu/data/sosp11_ChenSGK11_data.txt - http://reproducibility.cs.arizona.edu/data/sosp11_ChenSGK11_survey.txt
LimFAK11 SILT: a memory-efficient, high-performance key-value store SOSP '11 Hyeontaek Lim, Bin Fan, David G. Andersen, Michael Kaminsky Conference 13 BC Web OK_gt_30 We worked hard to make the code work and usable by others. From feedback we have received from other projects, we note that while building the software is straightforward, there are parameters that must be configured specifically to the hardware it's run on (in particular, the amount of memory and SSD used), if running the code on hardware different from that we used. *Performance* repeatability is more tricky than just re-running the code, unfortunately.; http://reproducibility.cs.arizona.edu/data/sosp11_LimFAK11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_LimFAK11_build.txt http://reproducibility.cs.arizona.edu/data/sosp11_LimFAK11_survey.txt
RossbachCSRW11 PTask: operating system abstractions to manage GPUs as compute devices SOSP '11 Christopher J. Rossbach, Jon Currey, Mark Silberstein, Baishakhi Ray, Emmett Witchel Conference 16 EX - - http://reproducibility.cs.arizona.edu/data/sosp11_RossbachCSRW11_data.txt - -
HarterDVAA11 A file is not a file: understanding the I/O behavior of Apple desktop applications SOSP '11 Tyler Harter, Chris Dragga, Michael Vaughn, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau Conference 13 BC Article OK_leq_30 Originally this paper was classified as not EM_no. The paper uses the same code as tocs30 HarterDVAA12 and the build notes are listed under that paper. In the survey response, the authors point out the mistake. Therefore, we have changed the classification to Article. ; http://reproducibility.cs.arizona.edu/data/sosp11_HarterDVAA11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_HarterDVAA11_build.txt http://reproducibility.cs.arizona.edu/data/sosp11_HarterDVAA11_survey.txt
PopaRZB11 CryptDB: protecting confidentiality with encrypted query processing SOSP '11 Raluca A. Popa, Catherine M. S. Redfield, Nickolai Zeldovich, Hari Balakrishnan Conference 16 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/sosp11_PopaRZB11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_PopaRZB11_build.txt http://reproducibility.cs.arizona.edu/data/sosp11_PopaRZB11_survey.txt
AdyaCMP11 Thialfi: a client notification service for internet-scale applications SOSP '11 Atul Adya, Gregory Cooper, Daniel Myers, Michael Piatek Conference 14 BC EM_no - We originally classified this paper as EM_no. In the survey response, the authors said that the code is published but that only part of the code is available. Therefore, we have kept the original classification of EM_no. ; http://reproducibility.cs.arizona.edu/data/sosp11_AdyaCMP11_data.txt - http://reproducibility.cs.arizona.edu/data/sosp11_AdyaCMP11_survey.txt
YinMZZBP11 An empirical study on configuration errors in commercial and open source systems SOSP '11 Xiao Ma, Jing Zheng, Yuanyuan Zhou, Lakshmi N. Bairavasundaram, Shankar Pasupathy, Zuoning Yin Conference 14 NC - - http://reproducibility.cs.arizona.edu/data/sosp11_YinMZZBP11_data.txt - -
MaoCZWZK11 Software fault isolation with API integrity and multi-principal modules SOSP '11 Yandong Mao, Haogang Chen, Dong Zhou, Xi Wang, Nickolai Zeldovich, M. Frans Kaashoek Conference 14 BC EM_no - http://reproducibility.cs.arizona.edu/data/sosp11_MaoCZWZK11_data.txt - http://reproducibility.cs.arizona.edu/data/sosp11_MaoCZWZK11_survey.txt
CalderWONSMXSWSHUKEBMAAHHBDAMSMR11 Windows Azure Storage: a highly available cloud storage service with strong consistency SOSP '11 Brad Calder, Ju Wang, Aaron Ogus, Niranjan Nilakantan, Arild Skjolsvold, Sam McKelvie, Yikang Xu, Shashwat Srivastav, Jiesheng Wu, Huseyin Simitci, Jaidev Haridas, Chakravarthy Uddaraju, Hemal Khatri, Andrew Edwards, Vaman Bedekar, Shane Mainali, Rafay Abbasi, Arpit Agarwal, Mian Fahim ul Haq, Muhammad Ikram ul Haq, Deepali Bhardwaj, Sowmya Dayanand, Anitha Adusumilli, Marvin McNett, Sriram Sankaran, Kavitha Manivannan, Leonidas Rigas Conference 15 BC EM_0 - http://reproducibility.cs.arizona.edu/data/sosp11_CalderWONSMXSWSHUKEBMAAHHBDAMSMR11_data.txt - -
LaadanVTBYN11 Pervasive detection of process races in deployed systems SOSP '11 Oren Laadan, Nicolas Viennot, Chia-che Tsai, Chris Blinn, Junfeng Yang, Jason Nieh Conference 15 EX - - http://reproducibility.cs.arizona.edu/data/sosp11_LaadanVTBYN11_data.txt - -
LloydFKA11 Don't settle for eventual: scalable causal consistency for wide-area storage with COPS SOSP '11 Wyatt Lloyd, Michael J. Freedman, Michael Kaminsky, David G. Andersen Conference 16 BC EM_yes OK_Author http://reproducibility.cs.arizona.edu/data/sosp11_LloydFKA11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_LloydFKA11_build.txt http://reproducibility.cs.arizona.edu/data/sosp11_LloydFKA11_survey.txt
ZhangCCZ11 CloudVisor: retrofitting protection of virtual machines in multi-tenant cloud with nested virtualization SOSP '11 Fengzhe Zhang, Jin Chen, Haibo Chen, Binyu Zang Conference 14 BC EM_no - http://reproducibility.cs.arizona.edu/data/sosp11_ZhangCCZ11_data.txt - -
ColpNZACDLW11 Breaking up is hard to do: security and functionality in a commodity hypervisor SOSP '11 Patrick Colp, Mihir Nanavati, Jun Zhu, William Aiello, George Coker, Tim Deegan, Peter Loscocco, Andrew Warfield Conference 14 BC EM_yes Fails http://reproducibility.cs.arizona.edu/data/sosp11_ColpNZACDLW11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_ColpNZACDLW11_build.txt -
SovranPAL11 Transactional storage for geo-replicated systems SOSP '11 Yair Sovran, Russell Power, Marcos K. Aguilera, Jinyang Li Conference 16 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/sosp11_SovranPAL11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_SovranPAL11_build.txt -
LiuCB11 Dthreads: efficient deterministic multithreading SOSP '11 Tongping Liu, Charlie Curtsinger, Emery D. Berger Conference 10 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/sosp11_LiuCB11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_LiuCB11_build.txt http://reproducibility.cs.arizona.edu/data/sosp11_LiuCB11_survey.txt
CuiWGGY11 Efficient deterministic multithreading through schedule relaxation SOSP '11 Heming Cui, Jingyue Wu, John Gallagher, Huayang Guo, Junfeng Yang Conference 15 EX - - http://reproducibility.cs.arizona.edu/data/sosp11_CuiWGGY11_data.txt - -
LenersWHAW11 Detecting failures in distributed systems with the Falcon spy network SOSP '11 Joshua B. Leners, Hao Wu, Wei-Lun Hung, Marcos Kawazoe Aguilera, Michael Walfish Conference 16 BC Article Fails Because of this study, we have updated our project page to include a "dev box" virtual machine disk image that can be used to build Falcon and its dependencies. The VM image also includes a utility for copying executables (and their dependencies) to other machines for execution.; http://reproducibility.cs.arizona.edu/data/sosp11_LenersWHAW11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_LenersWHAW11_build.txt http://reproducibility.cs.arizona.edu/data/sosp11_LenersWHAW11_survey.txt
ZhouFNHLS11 Secure network provenance SOSP '11 Wenchao Zhou, Qiong Fei, Arjun Narayan, Andreas Haeberlen, Boon Thau Loo, Micah Sherr Conference 16 BC EM_no - http://reproducibility.cs.arizona.edu/data/sosp11_ZhouFNHLS11_data.txt - -
MickensD11 Atlantis: robust, extensible execution environments for web applications SOSP '11 James Mickens, Mohan Dhawan Conference 15 BC EM_no - http://reproducibility.cs.arizona.edu/data/sosp11_MickensD11_data.txt - http://reproducibility.cs.arizona.edu/data/sosp11_MickensD11_survey.txt
AndrusDHLN11 Cells: a virtual mobile smartphone architecture SOSP '11 Jeremy Andrus, Christoffer Dall, Alexander Van't Hof, Oren Laadan, Jason Nieh Conference 15 BC EM_no - We originally classified this paper as EM_no. We did not receive code within our two month window after the initial request. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; Code now available at http://cells.cs.columbia.edu (notified via survey as of 9/22/2014) http://reproducibility.cs.arizona.edu/data/sosp11_AndrusDHLN11_data.txt - http://reproducibility.cs.arizona.edu/data/sosp11_AndrusDHLN11_survey.txt
GuoWZHYZ11 Practical software model checking via dynamic interface reduction SOSP '11 Huayang Guo, Ming Wu, Lidong Zhou, Gang Hu, Junfeng Yang, Lintao Zhang Conference 14 EX - - http://reproducibility.cs.arizona.edu/data/sosp11_GuoWZHYZ11_data.txt - -
SirerBRSWWS11 Logical attestation: an authorization architecture for trustworthy computing SOSP '11 Emin Gun Sirer, Willem de Bruijn, Patrick Reynolds, Alan Shieh, Kevin Walsh, Dan Williams, Fred B. Schneider Conference 16 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/sosp11_SirerBRSWWS11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_SirerBRSWWS11_build.txt http://reproducibility.cs.arizona.edu/data/sosp11_SirerBRSWWS11_survey.txt
MesnierCLA11 Differentiated storage services SOSP '11 Michael P. Mesnier, Feng Chen, Tian Luo, Jason B. Akers Conference 14 BC EM_no - We originally classified this paper as EM_no. In the email response, the authors said that to get the code we would need to sign a license agreement. For this study, we don't accept code that requires a legal agreement. In the survey response, the authors said that the code is available. We have kept the original classification of EM_no. ; http://reproducibility.cs.arizona.edu/data/sosp11_MesnierCLA11_data.txt - http://reproducibility.cs.arizona.edu/data/sosp11_MesnierCLA11_survey.txt
VeeraraghavanCFN11 Detecting and surviving data races using complementary schedules SOSP '11 Kaushik Veeraraghavan, Peter M. Chen, Jason Flinn, Satish Narayanasamy Conference 16 EX - - http://reproducibility.cs.arizona.edu/data/sosp11_VeeraraghavanCFN11_data.txt - -
OngaroRSOR11 Fast crash recovery in RAMCloud SOSP '11 Diego Ongaro, Stephen M. Rumble, Ryan Stutsman, John K. Ousterhout, Mendel Rosenblum Conference 13 BC Web OK_Author RAMCloud is a large system, and we've made a huge effort to produce some quality open-source code. Several factors fundamentally make it harder to reproduce RAMCloud's fast crash recovery results: RAMCloud had to be in C++ for the level of performance we were looking for, making it less portable and harder to build than most modern languages, and it needs a large cluster with very modern hardware. We expect our first users to have to configure a bunch of hardware to use RAMCloud effectively, so making it build without effort on a variety of distros wasn't high on our list. That's a place where leveraging a growing community makes sense: it's really easy for outsiders to contribute updated build instructions and patches needed to build RAMCloud on their systems, whereas we only develop with one particular cluster configuration. RAMCloud is an ongoing project, and we hope building and running it gets easier over time. For example, Jakob Blomer has recently developed some RPM packages in hopes of making it easier for others to get started.; http://reproducibility.cs.arizona.edu/data/sosp11_OngaroRSOR11_data.txt http://reproducibility.cs.arizona.edu/data/sosp11_OngaroRSOR11_build.txt http://reproducibility.cs.arizona.edu/data/sosp11_OngaroRSOR11_survey.txt
GlendenningBKA11 Scalable consistency in Scatter SOSP '11 Lisa Glendenning, Ivan Beschastnikh, Arvind Krishnamurthy, Thomas E. Anderson Conference 14 BC EM_no - We originally classified this paper as EM_no. In the original email response, the authors said that only part of the relevant code was available. In the survey response, the authors said that the code is available. We have kept the original classification of EM_no. ; http://reproducibility.cs.arizona.edu/data/sosp11_GlendenningBKA11_data.txt - http://reproducibility.cs.arizona.edu/data/sosp11_GlendenningBKA11_survey.txt
FakasCM11 Size-l Object Summaries for Relational Keyword Search VLDB '12 Georgios John Fakas, Zhi Cai, Nikos Mamoulis Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_FakasCM11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_FakasCM11_build.txt -
RanuS11 Answering Top-k Queries Over a Mixture of Attractive and Repulsive Dimensions VLDB '12 Sayan Ranu, Ambuj K. Singh Conference 12 BC EM_no - We originally classified this paper as EM_no. We did not receive code within our two month window after the initial request. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; http://reproducibility.cs.arizona.edu/data/vldb12_RanuS11_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_RanuS11_survey.txt
LiuZW11 Controlling False Positives in Association Rule Mining VLDB '12 Guimei Liu, Haojun Zhang, Limsoon Wong Conference 12 BC EM_yes OK_leq_30 We compared and studied three existing approaches in our paper. Our implementation of the three algorithms are available upon request.
When we first received the email from you, we asked which algorithm in our paper you were interested in, but we got no answer. We thought you had lost interest, so we did not follow-up.; http://reproducibility.cs.arizona.edu/data/vldb12_LiuZW11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_LiuZW11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_LiuZW11_survey.txt
PavloJZ11 On Predictive Modeling for Optimizing Transaction Execution in Parallel OLTP Systems VLDB '12 Andrew Pavlo, Evan P. C. Jones, Stanley B. Zdonik Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_PavloJZ11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_PavloJZ11_build.txt -
HoobinPZ11 Relative Lempel-Ziv Factorization for Efficient Storage and Retrieval of Web Collections VLDB '12 Christopher Hoobin, Simon J. Puglisi, Justin Zobel Conference 9 BC Web OK_leq_30 This is a significant project that deserves broad support across the computing community. There are often perfectly legitimate obstacles to code publishing but these should become the exception.; In the survey response, the authors said that the code we originally downloaded was related but not relevant to the study. Therefore, we downloaded the correct code and made a build attempt. ; http://reproducibility.cs.arizona.edu/data/vldb12_HoobinPZ11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_HoobinPZ11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_HoobinPZ11_survey.txt
WuXDCZZ12 Shortest Path and Distance Queries on Road Networks: An Experimental Evaluation VLDB '12 Lingkun Wu, Xiaokui Xiao, Dingxiong Deng, Gao Cong, Andy Diwen Zhu, Shuigeng Zhou Conference 12 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/vldb12_WuXDCZZ12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_WuXDCZZ12_build.txt -
ZhangTPH11 Towards Cost-Effective Storage Provisioning for DBMSs VLDB '12 Ning Zhang, Jun'ichi Tatemura, Jignesh M. Patel, Hakan Hacigumus Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_ZhangTPH11_data.txt - -
SuchanekAS11 PARIS: Probabilistic Alignment of Relations, Instances,and Schema VLDB '12 Fabian M. Suchanek, Serge Abiteboul, Pierre Senellart Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_SuchanekAS11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_SuchanekAS11_build.txt -
FangSYB11 REX: Explaining Relationships between Entity Pairs VLDB '12 Lujun Fang, Anish Das Sarma, Cong Yu, Philip Bohannon Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_FangSYB11_data.txt - -
LinJZXL11 A MovingObject Index for Efficient Query Processing with Peer-Wise Location Privacy VLDB '12 Dan Lin, Christian S. Jensen, Rui Zhang, Lu Xiao, Jiaheng Lu Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_LinJZXL11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_LinJZXL11_build.txt -
SunAH12 Relation Strength-Aware Clustering of Heterogeneous Information Networks with Incomplete Attributes VLDB '12 Yizhou Sun, Charu C. Aggarwal, Jiawei Han Conference 12 BC EM_yes OK_leq_30 DBLP dataset: www.ccs.neu.edu /home/yzsun/data/DBLP_four_area.zip; http://reproducibility.cs.arizona.edu/data/vldb12_SunAH12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_SunAH12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_SunAH12_survey.txt
ZhaoAW11 gSketch: On Query Estimation in Graph Streams VLDB '12 Peixiang Zhao, Charu C. Aggarwal, Min Wang Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_ZhaoAW11_data.txt - -
RohPKSL11 B+-tree Index Optimization by Exploiting Internal Parallelism of Flash-based Solid State Drives VLDB '12 Hongchan Roh, Sanghyun Park, Sungho Kim, Mincheol Shin, Sang-Won Lee Conference 12 BC EM_no - We originally classified this paper as EM_no. In the original email response, the authors said that only part of the system could be released. In the survey response, the authors said that the is code available. Because our policy is to consider the code available at the time of the study, we have kept the original classification of EM_no. ; http://reproducibility.cs.arizona.edu/data/vldb12_RohPKSL11_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_RohPKSL11_survey.txt
KruegerKGSSCPDZ11 Fast Updates on Read-Optimized Databases Using Multi-Core CPUs VLDB '12 Jens Kruger, Changkyu Kim, Martin Grund, Nadathur Satish, David Schwalb, Jatin Chhugani, Hasso Plattner, Pradeep Dubey, Alexander Zeier Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_KruegerKGSSCPDZ11_data.txt - -
YangRW11 Summarization and Matching of Density-Based Clusters in Streaming Environments VLDB '12 Di Yang, Elke A. Rundensteiner, Matthew O. Ward Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_YangRW11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_YangRW11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_YangRW11_survey.txt
NguyenMNNF11 Multilingual Schema Matching for Wikipedia Infoboxes VLDB '12 Thanh Hoang Nguyen, Viviane Moreira, Huong Nguyen, Hoa Nguyen, Juliana Freire Conference 12 BC EM_0 - We originally classified this paper as EM_0. We did not receive code within our two month window after the initial request. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_0. ; Code now available at https://nominum.box.com/s/u3tfv1ui2ah6zb3bkfln (notified via survey as of 9/22/2014) http://reproducibility.cs.arizona.edu/data/vldb12_NguyenMNNF11_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_NguyenMNNF11_survey.txt
MansourASK11 ERA: Efficient Serial and Parallel Suffix Tree Construction for Very Long Strings VLDB '12 Essam Mansour, Amin Allam, Spiros Skiadopoulos, Panos Kalnis Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_MansourASK11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_MansourASK11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_MansourASK11_survey.txt
MarcusWKMM11 Human-powered Sorts and Joins VLDB '12 Adam Marcus, Eugene Wu, David R. Karger, Samuel Madden, Robert C. Miller Conference 12 BC EM_no - We originally classified this paper as EM_no. We did not receive code within our two month window after the initial request. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; Code now available at https://github.com/sirrice/qurk_experiments (notified via survey as of 9/22/2014) http://reproducibility.cs.arizona.edu/data/vldb12_MarcusWKMM11_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_MarcusWKMM11_survey.txt
JestesYL11 Building Wavelet Histograms on Large Data in MapReduce VLDB '12 Jeffrey Jestes, Ke Yi, Feifei Li Conference 12 BC Web Fails http://reproducibility.cs.arizona.edu/data/vldb12_JestesYL11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_JestesYL11_build.txt -
GoasdoueKLM11 View Selection in Semantic Web Databases VLDB '12 Francois Goasdoue, Konstantinos Karanasos, Julien Leblay, Ioana Manolescu Conference 12 BC EM_yes OK_Author We originally classified this paper as EM_yes. We received an email with the code. In the survey response, the authors said the paper doesn't have published code. We have kept the classification as EM_yes. ; http://reproducibility.cs.arizona.edu/data/vldb12_GoasdoueKLM11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_GoasdoueKLM11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_GoasdoueKLM11_survey.txt
CormodeTY11 Verifying Computations with Streaming Interactive Proofs VLDB '12 Graham Cormode, Justin Thaler, Ke Yi Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_CormodeTY11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_CormodeTY11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_CormodeTY11_survey.txt
ArmbrustCKFFP11 PIQL: Success-Tolerant Query Processing in the Cloud VLDB '12 Michael Armbrust, Kristal Curtis, Tim Kraska, Armando Fox, Michael J. Franklin, David A. Patterson Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_ArmbrustCKFFP11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_ArmbrustCKFFP11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_ArmbrustCKFFP11_survey.txt
FabbriL11 Explanation-Based Auditing VLDB '12 Daniel Fabbri, Kristen LeFevre Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_FabbriL11_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_FabbriL11_survey.txt
RuttenbergS11 Indexing the Earth Mover's Distance Using Normal Distributions VLDB '12 Brian E. Ruttenberg, Ambuj K. Singh Conference 12 BC EM_no - This code contains the quad-tree implementation and thus is not runnable without a scan-and-refine implementation (the scan-and-refine implementation from the original paper is not allowing public release of the code); Originally this paper was classified as code from Web. In the survey response, the authors said that the code is only partially available because of IP restrictions on a required part. Therefore, we have reclassified it as EM_no. ; http://reproducibility.cs.arizona.edu/data/vldb12_RuttenbergS11_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_RuttenbergS11_survey.txt
GoyalBL11 A Data-Based Approach to Social Influence Maximization VLDB '12 Amit Goyal, Francesco Bonchi, Laks V. S. Lakshmanan Conference 12 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_GoyalBL11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_GoyalBL11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_GoyalBL11_survey.txt
LiDWF11 PASS-JOIN: A Partition-based Method for Similarity Joins VLDB '12 Guoliang Li, Dong Deng, Jiannan Wang, Jianhua Feng Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_LiDWF11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_LiDWF11_build.txt -
QumsiyehPN11 Generating Exact- and Ranked Partially-Matched Answers to Questions in Advertisements VLDB '12 Rani Qumsiyeh, Maria Soledad Pera, Yiu-Kai Ng Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_QumsiyehPN11_data.txt - -
CaoSTC12 Whom to Ask? Jury Selection for Decision Making Tasks on Micro-blog Services VLDB '12 Caleb Chen Cao, Jieying She, Yongxin Tong, Lei Chen Conference 12 BC EM_no - The algorithms are described explicitly in the published paper, and can be easily implemented in any language.; http://reproducibility.cs.arizona.edu/data/vldb12_new_CaoSTC12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_CaoSTC12_survey.txt
SelkeLB12 Pushing the Boundaries of Crowd-enabled Databases with Query-driven Schema Expansion VLDB '12 Joachim Selke, Christoph Lofi, Wolf-Tilo Balke Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_new_SelkeLB12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_SelkeLB12_survey.txt
KonigDCN11 A Statistical Approach Towards Robust Progress Estimation VLDB '12 Arnd Christian Konig, Bolin Ding, Surajit Chaudhuri, Vivek Narasayya Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_KonigDCN11_data.txt - -
KanagalAPJYP12 Supercharging Recommender Systems using Taxonomies for Learning User Purchase Behavior VLDB '12 Bhargav Kanagal, Amr Ahmed, Sandeep Pandey, Vanja Josifovski, Jeff Yuan, Lluis Garcia-Pueyo Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_new_KanagalAPJYP12_data.txt - -
SilvaMZ12 Mining Attribute-structure Correlated Patterns in Large Attributed Graphs VLDB '12 Arlei Silva, Wagner Meira Jr, Mohammed J. Zaki Conference 12 BC Article OK_Author http://reproducibility.cs.arizona.edu/data/vldb12_new_SilvaMZ12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_SilvaMZ12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_SilvaMZ12_survey.txt
FanWW12 Performance Guarantees for Distributed Reachability Queries VLDB '12 Wenfei Fan, Xin Wang, Yinghui Wu Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_FanWW12_data.txt - -
FunkeKN12 Compacting Transactional Data in Hybrid OLTP {\&}amp; OLAP Databases VLDB '12 Florian Funke, Alfons Kemper, Thomas Neumann Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_FunkeKN12_data.txt - -
TongCCY12 Mining Frequent Itemsets over Uncertain Databases VLDB '12 Yongxin Tong, Lei Chen, Yurong Cheng, Philip S. Yu Conference 12 BC Web OK_leq_30 I am very pleasure that you use our work as a part of your researches. I think that you can directly publish our executable code and datasets in your studies as long as you cite our papers. Thanks !; http://reproducibility.cs.arizona.edu/data/vldb12_new_TongCCY12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_TongCCY12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_TongCCY12_survey.txt
CandanRSW12 sDTW: Computing DTW Distances using Locally Relevant Constraints based on Salient Feature Alignments VLDB '12 K Selcuk Candan, Rosaria Rossini, Maria Luisa Sapino, Xiaolan Wang Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_CandanRSW12_data.txt - -
GoodrichNOPTTL12 Efficient Verification of Web-Content Searching Through Authenticated Web Crawlers VLDB '12 Michael T. Goodrich, Duy Nguyen, Olga Ohrimenko, Charalampos Papamanthou, Roberto Tamassia, Nikos Triandopoulos, Cristina Videira Lopes Conference 12 BC EM_no - At the time of the request, the code used in this work could not be released due to a related patent application. However, we plan to make the code available in the near future.; http://reproducibility.cs.arizona.edu/data/vldb12_new_GoodrichNOPTTL12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_GoodrichNOPTTL12_survey.txt
BaoDM12 Labeling Workflow Views with Fine-Grained Dependencies VLDB '12 Zhuowei Bao, Susan B. Davidson, Tova Milo Conference 12 BC EM_yes OK_leq_30 We have all the code and testing data available in the school svn repository, and would love to share for repeatability test.; We originally classified this paper as EM_no. The authors had replied positively to our initial inquiry over email but we didn't follow up on our request. In the survey response, the authors said the code is available. Therefore, we have classified the paper as EM_yes, downloaded the code and made a build attempt. ; http://reproducibility.cs.arizona.edu/data/vldb12_new_BaoDM12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_BaoDM12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_BaoDM12_survey.txt
CheungAMM12 Automatic Partitioning of Database Applications VLDB '12 Alvin Cheung, Owen Arden, Samuel Madden, Andrew C. Myers Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_CheungAMM12_data.txt - -
MetwallyF12 V-SMART-Join: A Scalable MapReduce Framework for All-Pair Similarity Joins of Multisets and Vectors VLDB '12 Ahmed Metwally, Christos Faloutsos Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_MetwallyF12_data.txt - -
KhoussainovaBS12 PerfXplain: Debugging MapReduce Job Performance VLDB '12 Nodira Khoussainova, Magdalena Balazinska, Dan Suciu Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_KhoussainovaBS12_data.txt - -
ChubakR12 Efficient Indexing and Querying over Syntactically Annotated Trees VLDB '12 Pirooz Chubak, Davood Rafiei Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_ChubakR12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ChubakR12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ChubakR12_survey.txt
DallachiesaNMP12 Uncertain Time-Series Similarity: Return to the Basics VLDB '12 Michele Dallachiesa, Besmira Nushi, Katsiaryna Mirylenka, Themis Palpanas Conference 12 BC Article OK_gt_30 Originally the paper was classified as BC. In the survey response, the authors said the paper is NC. The article links to relevant code. We have kept the original classification of code from Web. ;Originally this paper was classified as code from Web. There was an error copying the link from the pdf. Therefore, the paper was reclassified as Article. ; http://reproducibility.cs.arizona.edu/data/vldb12_new_DallachiesaNMP12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_DallachiesaNMP12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_DallachiesaNMP12_survey.txt
ZhuKA12 A Generic Framework for Efficient and Effective Subsequence Retrieval VLDB '12 Haohan Zhu, George Kollios, Vassilis Athitsos Conference 12 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhuKA12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhuKA12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhuKA12_survey.txt
JiangBCL12 MOIST: A Scalable and Parallel Moving Object Indexer with School Tracking VLDB '12 Junchen Jiang, Hongji Bao, Edward Y. Chang, Yuqian Li Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_JiangBCL12_data.txt - -
AlyAO12 Spatial Queries with Two kNN Predicates VLDB '12 Ahmed M. Aly, Walid G. Aref, Mourad Ouzzani Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_AlyAO12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_AlyAO12_build.txt -
BakibayevOZ12 FDB: A Query Engine for Factorised Relational Databases VLDB '12 Nurzhan Bakibayev, Dan Olteanu, Jakub Zavodny Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_BakibayevOZ12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_BakibayevOZ12_survey.txt
UpadhyayaBS12 How to Price Shared Optimizations in the Cloud VLDB '12 Prasang Upadhyaya, Magdalena Balazinska, Dan Suciu Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_UpadhyayaBS12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_UpadhyayaBS12_survey.txt
SatuluriP12 Bayesian Locality Sensitive Hashing for Fast Similarity Search VLDB '12 Venu Satuluri, Srinivasan Parthasarathy Conference 12 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_SatuluriP12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_SatuluriP12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_SatuluriP12_survey.txt
AngelKSS12 Dense Subgraph Maintenance under Streaming Edge Weight Updates for Real-time Story Identification VLDB '12 Albert Angel, Nick Koudas, Nikos Sarkas, Divesh Srivastava Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_AngelKSS12_data.txt - -
FujiwaraNOK12 Fast and Exact Top-k Search for Random Walk with Restart VLDB '12 Yasuhiro Fujiwara, Makoto Nakatsuji, Makoto Onizuka, Masaru Kitsuregawa Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_FujiwaraNOK12_data.txt - -
SunWWSL12 Efficient Subgraph Matching on Billion Node Graphs VLDB '12 Zhao Sun, Hongzhi Wang, Haixun Wang, Bin Shao, Jianzhong Li Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_SunWWSL12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_SunWWSL12_survey.txt
PimplikarS12 Answering Table Queries on the Web using Column Keywords VLDB '12 Rakesh Pimplikar, Sunita Sarawagi Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_PimplikarS12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_PimplikarS12_survey.txt
ZhangCW12 Efficient Multi-way Theta-Join Processing Using MapReduce VLDB '12 Xiaofei Zhang, Lei Chen, Min Wang Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhangCW12_data.txt - -
DasuL12 Statistical Distortion: Consequences of Data Cleaning VLDB '12 Tamraparni Dasu, Ji Meng Loh Conference 10 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_new_DasuL12_data.txt - -
VoWACO12 LogBase: A Scalable Log-structured Database System in the Cloud VLDB '12 Hoang Tam Vo, Sheng Wang, Divyakant Agrawal, Gang Chen, Beng Chin Ooi Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_VoWACO12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_VoWACO12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_VoWACO12_survey.txt
KumarR11 Probabilistic Management of OCR Data using an RDBMS VLDB '12 Arun Kumar, Christopher Re Conference 12 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_KumarR11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_KumarR11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_KumarR11_survey.txt
LaptevZZ12 Early Accurate Results for Advanced Analytics on MapReduce VLDB '12 Nikolay Laptev, Kai Zeng, Carlo Zaniolo Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_LaptevZZ12_data.txt - -
SchnaitterP12 Semi-Automatic Index Tuning: Keeping DBAs in the Loop VLDB '12 Karl Schnaitter, Neoklis Polyzotis Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_SchnaitterP12_data.txt - -
BenediktBL12 Querying Schemas With Access Restrictions VLDB '12 Michael Benedikt, Pierre Bourhis, Clemens Ley Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/vldb12_new_BenediktBL12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_BenediktBL12_survey.txt
QinYC12 Diversifying Top-K Results VLDB '12 Lu Qin, Jeffrey Xu Yu, Lijun Chang Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_new_QinYC12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_QinYC12_survey.txt
LimHB12 Stubby: A Transformation-based Optimizer for MapReduce Workflows VLDB '12 Harold Lim, Herodotos Herodotou, Shivnath Babu Conference 12 BC EM_no - We aren't ready to release the sources just yet since it
is part of a potential patent application.; http://reproducibility.cs.arizona.edu/data/vldb12_new_LimHB12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_LimHB12_survey.txt
AlbutiuKN12 Massively Parallel Sort-Merge Joins in Main Memory Multi-Core Database Systems VLDB '12 MartinaCezara Albutiu, Alfons Kemper, Thomas Neumann Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_new_AlbutiuKN12_data.txt - -
JhaS12 Probabilistic Databases with MarkoViews VLDB '12 Abhay Jha, Dan Suciu Conference 12 BC EM_no - This work has been superseded by a different project, and the code was never made publicly available.; http://reproducibility.cs.arizona.edu/data/vldb12_new_JhaS12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_JhaS12_survey.txt
LiM12 An Adaptive Mechanism for Accurate Query Answering under Differential Privacy VLDB '12 Chao Li, Gerome Miklau Conference 12 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_LiM12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_LiM12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_LiM12_survey.txt
AhmadKKN12 DBToaster: Higher-order Delta Processing for Dynamic, Frequently Fresh Views VLDB '12 Yanif Ahmad, Oliver Kennedy, Christoph Koch, Milos Nikolic Conference 12 BC Web OK_leq_30 We have recently (Aug. 1, 2014) released a much improved version of the system -- see www.dbtoaster.org; http://reproducibility.cs.arizona.edu/data/vldb12_new_AhmadKKN12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_AhmadKKN12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_AhmadKKN12_survey.txt
FinkHO12 Aggregation in Probabilistic Databases via Knowledge Compilation VLDB '12 Robert Fink, Larisa Han, Dan Olteanu Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_FinkHO12_data.txt - -
LiuLOSWZ12 CDAS: A Crowdsourcing Data Analytics System VLDB '12 Xuan Liu, Meiyu Lu, Beng Chin Ooi, Yanyan Shen, Sai Wu, Meihui Zhang Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_LiuLOSWZ12_data.txt - -
DasTADY12 Who Tags What? An Analysis Framework VLDB '12 Mahashweta Das, Saravanan Thirumuruganathan, Sihem AmerYahia, Gautam Das Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_DasTADY12_data.txt - -
ZhangZXYW12 Functional Mechanism: Regression Analysis under Differential Privacy VLDB '12 Jun Zhang, Zhenjie Zhang, Xiaokui Xiao, Yin Yang, Marianne Winslett Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhangZXYW12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhangZXYW12_build.txt -
LarsonBDFPZ11 High-Performance Concurrency Control Mechanisms for Main-Memory Databases VLDB '12 Per-Ake Larson, Spyros Blanas, Cristian Diaconu, Craig Freedman, Jignesh M. Patel, Mike Zwilling Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_LarsonBDFPZ11_data.txt - -
YinCLYC12 Challenging the Long Tail Recommendation VLDB '12 Hongzhi Yin, Bin Cui, Jing Li, Junjie Yao, Chen Chen Conference 12 BC EM_yes OK_Author http://reproducibility.cs.arizona.edu/data/vldb12_new_YinCLYC12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_YinCLYC12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_YinCLYC12_survey.txt
BahmaniKV12 Densest Subgraph in Streaming and MapReduce VLDB '12 Bahman Bahmani, Ravi Kumar, Sergei Vassilvitskii Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_BahmaniKV12_data.txt - -
LuoLMCZ12 hStorage-DB: Heterogeneity-aware Data Management to Exploit the Full Capability of Hybrid Storage Systems VLDB '12 Tian Luo, Rubao Lee, Michael Mesnier, Feng Chen, Xiaodong Zhang Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_LuoLMCZ12_data.txt - -
ShengZTJ12 Optimal Algorithms for Crawling a Hidden Database in the Web VLDB '12 Cheng Sheng, Nan Zhang, Yufei Tao, Xin Jin Conference 12 BC EM_yes OK_Author http://reproducibility.cs.arizona.edu/data/vldb12_new_ShengZTJ12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ShengZTJ12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ShengZTJ12_survey.txt
GulloT12 Uncertain Centroid based Partitional Clustering of Uncertain Data VLDB '12 Francesco Gullo, Andrea Tagarelli Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_GulloT12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_GulloT12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_GulloT12_survey.txt
AgarwalRB12 Real Time Discovery of Dense Clusters in Highly Dynamic Graphs: Identifying Real World Events in Highly Dynamic Environments VLDB '12 Manoj K Agarwal, Krithi Ramamritham, Manish Bhide Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_AgarwalRB12_data.txt - -
DalviMP12 An Analysis of Structured Data on the Web VLDB '12 Nilesh Dalvi, Ashwin Machanavajjhala, Bo Pang Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/vldb12_new_DalviMP12_data.txt - -
LiKNC12 Robust Estimation of Resource Consumption for SQL Queries using Statistical Techniques VLDB '12 Jiexing Li, Arnd Christian Konig, Vivek Narasayya, Surajit Chaudhuri Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_LiKNC12_data.txt - -
Bidoit-TolluCU12 Type-Based Detection of XML Query-Update Independence VLDB '12 Nicole Bidoit-Tollu, Dario Colazzo, Federico Ulliana Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_Bidoit-TolluCU12_data.txt - -
BlunschiJKMS12 SODA: Generating SQL for Business Users VLDB '12 Lukas Blunschi, Claudio Jossen, Donald Kossmann, Magdalini Mori, Kurt Stockinger Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_new_BlunschiJKMS12_data.txt - -
KangLM12 Flash-based Extended Cache for Higher Throughput and Faster Recovery VLDB '12 Woon-Hak Kang, Sang-Won Lee, Bongki Moon Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_new_KangLM12_data.txt - -
BenderFJKKMMSSZ12 Don't Thrash: How to Cache Your Hash on Flash VLDB '12 Michael A. Bender, Martin FarachColton, Rob Johnson, Russell Kraner, Bradley C. Kuszmaul, Dzejla Medjedovic, Pablo Montes, Pradeep Shetty, Richard P. Spillane, Erez Zadok Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_BenderFJKKMMSSZ12_data.txt - -
FanLZCH12 SEAL: Spatio-Textual Similarity Search VLDB '12 Ju Fan, Guoliang Li, Lizhu Zhou, Shanshan Chen, Jun Hu Conference 12 BC EM_0 - http://reproducibility.cs.arizona.edu/data/vldb12_new_FanLZCH12_data.txt - -
LiQSC12 PrivBasis: Frequent Itemset Mining with Differential Privacy VLDB '12 Ninghui Li, Wahbeh Qardaji, Dong Su, Jianneng Cao Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_LiQSC12_data.txt - -
TerrovitisLMS12 Privacy Preservation by Disassociation VLDB '12 Manolis Terrovitis, John Liagouris, Nikos Mamoulis, Spiros Skiadopoulos Conference 12 BC EM_no - The source code will be published once we clean it up. We acknowledge that the delay has been significant.; http://reproducibility.cs.arizona.edu/data/vldb12_new_TerrovitisLMS12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_TerrovitisLMS12_survey.txt
MamourasOSKG12 The Complexity of Social Coordination VLDB '12 Konstantinos Mamouras, Sigal Oren, Lior Seeman, Lucja Kot, Johannes Gehrke Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_MamourasOSKG12_data.txt - -
LuSCO12 Efficient Processing of k Nearest Neighbor Joins using MapReduce VLDB '12 Wei Lu, Yanyan Shen, Beng Chin Ooi, Su Chen Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_LuSCO12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_LuSCO12_build.txt -
PapapetrouGD12 Sketch-based Querying of Distributed Sliding-Window Data Streams VLDB '12 Odysseas Papapetrou, Minos Garofalakis, Antonios Deligiannakis Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_PapapetrouGD12_data.txt - -
BarskyKWH11 Mining Flipping Correlations from Large Datasets with Taxonomies VLDB '12 Marina Barsky, Sangkyum Kim, Tim Weninger, Jiawei Han Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_BarskyKWH11_data.txt - -
BahmaniMVKV12 Scalable K-Means++ VLDB '12 Bahman Bahmani, Benjamin Moseley, Andrea Vattani, Sergei Vassilvitskii, Ravi Kumar Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_BahmaniMVKV12_data.txt - -
HallBBGN12 Processing a Trillion Cells per Mouse Click VLDB '12 Alexander Hall, Olaf Bachmann, Robert Bussow, Silviu Ganceanu, Marc Nunkesser Conference 11 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_HallBBGN12_data.txt - -
WangC12 Truss Decomposition in Massive Networks VLDB '12 Jia Wang, James Cheng Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_WangC12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_WangC12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_WangC12_survey.txt
EwenTKM12 Spinning Fast Iterative Data Flows VLDB '12 Stephan Ewen, Kostas Tzoumas, Moritz Kaufmann, Volker Markl Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_EwenTKM12_data.txt - -
AmsterdamerDDMST11 Putting Lipstick on Pig: Enabling Database-style Workflow Provenance VLDB '12 Yael Amsterdamer, Susan B. Davidson, Daniel Deutch, Tova Milo, Julia Stoyanovich Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_AmsterdamerDDMST11_data.txt - -
SzlichtaGG12 Fundamentals of Order Dependencies VLDB '12 Jaroslaw Szlichta, Parke Godfrey, Jarek Gryz Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/vldb12_new_SzlichtaGG12_data.txt - -
MouratidisY12 Shortest Path Computation with No Information Leakage VLDB '12 Kyriakos Mouratidis, Man Lung Yiu Conference 12 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_MouratidisY12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_MouratidisY12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_MouratidisY12_survey.txt
CaoK12 Publishing Microdata with a Robust Privacy Guarantee VLDB '12 Jianneng Cao, Panagiotis Karras Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_CaoK12_data.txt - -
CautisK12 Answering Queries using Views over Probabilistic XML: Complexity and Tractability VLDB '12 Bogdan Cautis, Evgeny Kharlamov Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/vldb12_new_CautisK12_data.txt - -
CaoCCX12 Keyword-aware Optimal Route Search VLDB '12 Xin Cao, Lisi Chen, Gao Cong, Xiaokui Xiao Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_CaoCCX12_data.txt - -
ZengH12 Comments on "Stack-based Algorithms for Pattern Matching on DAGs" VLDB '12 Qiang Zeng, Hai Zhuge Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_ZengH12_data.txt - -
TauheedHSMA12 SCOUT: Prefetching for Latent Feature Following Queries VLDB '12 Farhan Tauheed, Thomas Heinis, Felix Schurmann, Anastasia Ailamaki, Henry Markram Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_TauheedHSMA12_data.txt - -
HueskePSRBKT12 Opening the Black Boxes in Data Flow Optimization VLDB '12 Fabian Hueske, Mathias Peters, Matthias J. Sax, Astrid Rheinlander, Rico Bergmann, Aljoscha Krettek, Kostas Tzoumas Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_HueskePSRBKT12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_HueskePSRBKT12_survey.txt
NguyenHZW12 Boosting Moving Object Indexing through Velocity Partitioning VLDB '12 Thi Nguyen, Zhen He, Rui Zhang, Phillip Ward Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_NguyenHZW12_data.txt - -
GraefeK12 Definition, Detection, and Recovery of Single-Page Failures,a Fourth Class of Database Failures VLDB '12 Goetz Graefe, Harumi Kuno Conference 10 NC - - http://reproducibility.cs.arizona.edu/data/vldb12_new_GraefeK12_data.txt - -
PattersonENAA12 Serializability, not Serial: Concurrency Control and Availability in Multi-Datacenter Datastores VLDB '12 Stacy Patterson, Aaron J. Elmore, Faisal Nawab, Divyakant Agrawal, Amr El Abbadi Conference 12 BC EM_no - We originally classified this paper as BC. In the survey response, the authors said that the code is secondary to the proofs. The paper includes code benchmarks. Therefore, we have kept the original classification of BC. ; http://reproducibility.cs.arizona.edu/data/vldb12_new_PattersonENAA12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_PattersonENAA12_survey.txt
YangLW12 ALAE: Accelerating Local Alignment with Affine Gap Exactly in Biosequence Databases VLDB '12 Xiaochun Yang, Honglei Liu, Bin Wang Conference 12 BC Web OK_leq_30 We would welcome feedback from users and would endeavour to improve it.; http://reproducibility.cs.arizona.edu/data/vldb12_new_YangLW12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_YangLW12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_YangLW12_survey.txt
PorobicPBTA12 OLTP on Hardware Islands VLDB '12 Danica Porobic, Ippokratis Pandis, Miguel Branco, Pinar Tozun, Anastasia Ailamaki Conference 12 NC - - We originally classified this paper as NC. In the survey response, the authors said that the paper was BC. Therefore, we have changed the classification to BC and attempted a build using the link given in the survey. ; http://reproducibility.cs.arizona.edu/data/vldb12_new_PorobicPBTA12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_PorobicPBTA12_survey.txt
MaCFHW11 Capturing Topology in Graph Pattern Matching VLDB '12 Shuai Ma, Yang Cao, Jinpeng Huai, Wenfei Fan, Tianyu Wo Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_MaCFHW11_data.txt - -
JestesPLT12 Ranking Large Temporal Data VLDB '12 Jeffrey Jestes, Jeff M. Phillips, Mingwang Tang, Feifei Li Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_JestesPLT12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_JestesPLT12_build.txt -
Shirani-MehrKS12 Efficient Reachability Query Evaluation in Large Spatiotemporal Contact Datasets VLDB '12 Houtan Shirani-Mehr, Farnoush Banaei-Kashani, Cyrus Shahabi Conference 12 BC EM_no - The student who was working on this project graduated and left for Yahoo! Since employment, he did not respond to the first request for the code and after following up later, it was too late and he had cleared his systems and lost the code.; http://reproducibility.cs.arizona.edu/data/vldb12_new_Shirani-MehrKS12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_Shirani-MehrKS12_survey.txt
GaoJZYJW11 Relational Approach for Shortest Path Discovery over Large Graphs VLDB '12 Jun Gao, Ruoming Jin, Jiashuai Zhou, Jeffrey Xu Yu, Xiao Jiang, Tengjiao Wang Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_GaoJZYJW11_data.txt - -
ErdosILTB12 The Filter-Placement Problem and its Application to Minimizing Information Multiplicity VLDB '12 Dora Erdos, Vatche Ishakian, Andrei Lapets, Evimaria Terzi, Azer Bestavros Conference 12 BC EM_yes OK_leq_30 In the survey response the authors say that we did not find the correct code. The code we downloaded is the same as the link that is given in the survey and in the original email response. We have kept the original classification of EM_yes. ; http://reproducibility.cs.arizona.edu/data/vldb12_new_ErdosILTB12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ErdosILTB12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ErdosILTB12_survey.txt
GuanYK12 Measuring Two-Event Structural Correlations on Graphs VLDB '12 Ziyu Guan, Xifeng Yan, Lance M. Kaplan Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_GuanYK12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_GuanYK12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_GuanYK12_survey.txt
ZhaoRGH12 A Bayesian Approach to Discovering Truth from Conflicting Sources for Data Integration VLDB '12 Bo Zhao, Benjamin I P Rubinstein, Jim Gemmell, Jiawei Han Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhaoRGH12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhaoRGH12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhaoRGH12_survey.txt
ChoiCT12 A Scalable Algorithm for Maximizing Range Sum in Spatial Databases VLDB '12 Dong-Wan Choi, Chin-Wan Chung, Yufei Tao Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_ChoiCT12_data.txt - -
BailisVFHS12 Probabilistically Bounded Staleness for Practical Partial Quorums VLDB '12 Peter Bailis, Shivaram Venkataraman, Michael J. Franklin, Joseph M. Hellerstein, Ion Stoica Conference 12 BC Article OK_leq_30 cs.brown.edu/~sk/Memos/Examining-Reproducibility/ vldb12new/BailisVFHS12/dispute.txt
cs.brown.edu/~sk/Memos/Examining-Reproducibility/ vldb12new/BailisVFHS12/cleared.txt; We originally classified the paper as OK_lt_30. In the survey response, the authors said that we did not find the correct code. The online implementation that we evaluated is linked to in the paper. We have kept the original classification of OK_lt_30. ; http://reproducibility.cs.arizona.edu/data/vldb12_new_BailisVFHS12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_BailisVFHS12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_BailisVFHS12_survey.txt
Jacques-SilvaGWWK12 Building User-defined Runtime Adaptation Routines for Stream Processing Applications VLDB '12 Gabriela Jacques-Silva, Bugra Gedik, Rohit Wagle, Kun-Lung Wu, Vibhore Kumar Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_Jacques-SilvaGWWK12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_Jacques-SilvaGWWK12_survey.txt
LangHPST12 Towards Energy-Efficient Database Cluster Design VLDB '12 Willis Lang, Stavros Harizopoulos, Jignesh M. Patel, Mehul A. Shah, Dimitris Tsirogiannis Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_LangHPST12_data.txt - -
GiannikisAK12 SharedDB: Killing One Thousand Queries With One Stone VLDB '12 Georgios Giannikis, Gustavo Alonso, Donald Kossmann Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_GiannikisAK12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_GiannikisAK12_survey.txt
PawlikA11 RTED: A Robust Algorithm for the Tree Edit Distance VLDB '12 Mateusz Pawlik, Nikolaus Augsten Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_PawlikA11_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_PawlikA11_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_PawlikA11_survey.txt
BaranyCO12 Queries with Guarded Negation VLDB '12 Vince barany, Balder ten Cate, Martin Otto Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/vldb12_new_BaranyCO12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_BaranyCO12_survey.txt
WangKFF12 CrowdER: Crowdsourcing Entity Resolution VLDB '12 Jiannan Wang, Tim Kraska, Michael J. Franklin, Jianhua Feng Conference 12 BC EM_no - 2/13/2015: Author reports that source and data is available by email request. http://reproducibility.cs.arizona.edu/data/vldb12_new_WangKFF12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_WangKFF12_survey.txt
YuanZWXYH12 Low-Rank Mechanism: Optimizing Batch Queries under Differential Privacy VLDB '12 Ganzhao Yuan, Zhenjie Zhang, Marianne Winslett, Xiaokui Xiao, Yin Yang, Zhifeng Hao Conference 12 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_YuanZWXYH12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_YuanZWXYH12_build.txt -
SinghG12 Learning Semantic String Transformations from Examples VLDB '12 Rishabh Singh, Sumit Gulwani Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_SinghG12_data.txt - -
BoldiBGT12 Injecting Uncertainty in Graphs for Identity Obfuscation VLDB '12 Paolo Boldi, Francesco Bonchi, Aristides Gionis, Tamir Tassa Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_BoldiBGT12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_BoldiBGT12_build.txt -
DittrichQRSJS12 Only Aggressive Elephants are Fast Elephants VLDB '12 Jens Dittrich, Stefan Richter, Jorge-Arnulfo Quiane-Ruiz, Stefan Schuh, Alekh Jindal, Jorg Schad Conference 12 BC EM_no - The code is not available publicly as we applied for an international patent for the method. However, anyone who signs an NDA will gets access to the code. Just send us an email...; We originally classified this paper as EM_no. In the survey response, the authors said that code is available if we sign an NDA. For this study, we don't accept code that requires a legal agreement. Therefore, we have kept the original classification of EM_no. ; http://reproducibility.cs.arizona.edu/data/vldb12_new_DittrichQRSJS12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_DittrichQRSJS12_survey.txt
GraefeHIKM12 Concurrency Control for Adaptive Indexing VLDB '12 Goetz Graefe, Felix Halim, Stratos Idreos, Harumi Kuno, Stefan Manegold Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_GraefeHIKM12_data.txt - -
WangHLWZS12 Accelerating Pathology Image Data Cross-Comparison on CPU-GPU Hybrid Systems VLDB '12 Kaibo Wang, Yin Huai, Rubao Lee, Fusheng Wang, Xiaodong Zhang, Joel H. Saltz Conference 12 BC EM_yes OK_Author This study on code repeatability is very important to improve publication quality in many CS research fields.;The authers of this survey lack necessary background and capability to judge the correctnesss and practibility of our study. We suggest they get the latest code from our website and find the right person to re-run the tests.; Originally, we classified the build as Fails because in the original email response, the authors only gave us part of the code. Then, in the survey response, the authors provided the rest of the code. Since the code was not available at the time of the study, we have kept the original classification as Fails. ; http://reproducibility.cs.arizona.edu/data/vldb12_new_WangHLWZS12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_WangHLWZS12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_WangHLWZS12_survey.txt
ZengJZ12 Adding Logical Operators to Tree Pattern Queries on Graph-Structured Data VLDB '12 Qiang Zeng, Xiaorui Jiang, Hai Zhuge Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_ZengJZ12_data.txt - -
LowGKBGH12 Distributed GraphLab: A Framework for Machine Learning in the Cloud VLDB '12 Yucheng Low, Joseph Gonzalez, Aapo Kyrola, Danny Bickson, Joseph M. Hellerstein Conference 12 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_LowGKBGH12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_LowGKBGH12_build.txt -
LiuRLMB12 Cologne: A Declarative Distributed Constraint Optimization Platform VLDB '12 Changbin Liu, Lu Ren, Boon Thau Loo, Yun Mao, Prithwish Basu Conference 12 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_LiuRLMB12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_LiuRLMB12_build.txt -
LappasVGT12 On The Spatiotemporal Burstiness of Terms VLDB '12 Theodoros Lappas, Marcos R. Vieira, Dimitrios Gunopulos, Vassilis J. Tsotras Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_LappasVGT12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_LappasVGT12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_LappasVGT12_survey.txt
ZhangY12 Optimizing I/O for Big Array Analytics VLDB '12 Yi Zhang, Jun Yang Conference 12 BC Web OK_Author Originally, we attempted to build code that was related but not relevant. In the survey response, the authors give the correct code location. Therefore, we have attempted building the correct code. ; http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhangY12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhangY12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_ZhangY12_survey.txt
ElghandourA12 ReStore: Reusing Results of MapReduce Jobs VLDB '12 Iman Elghandour, Ashraf Aboulnaga Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_ElghandourA12_data.txt - -
IseleB12 Learning Expressive Linkage Rules using Genetic Programming VLDB '12 Robert Isele, Christian Bizer Conference 12 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_IseleB12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_IseleB12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_IseleB12_survey.txt
SowellGS12 Minuet: A Scalable Distributed Multiversion B-Tree VLDB '12 Benjamin Sowell, Wojciech Golab, Mehul A. Shah Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_SowellGS12_data.txt - -
CaoCLT12 Optimization of Analytic Window Functions VLDB '12 Yu Cao, Chee-Yong Chan, Jie Li, Kian-Lee Tan Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/vldb12_new_CaoCLT12_data.txt - -
SachanB12 Mining Statistically Significant Substrings using the Chi-Square Statistic VLDB '12 Mayank Sachan, Arnab Bhattacharya Conference 12 BC EM_no - I would like to publish the code for this. However, this requires organizing the code from our end.; http://reproducibility.cs.arizona.edu/data/vldb12_new_SachanB12_data.txt - http://reproducibility.cs.arizona.edu/data/vldb12_new_SachanB12_survey.txt
HalimIKY12 Stochastic Database Cracking: Towards Robust Adaptive Indexing in Main-Memory Column-Stores VLDB '12 Felix Halim, Stratos Idreos, Panagiotis Karras, Roland H C Yap Conference 12 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/vldb12_new_HalimIKY12_data.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_HalimIKY12_build.txt http://reproducibility.cs.arizona.edu/data/vldb12_new_HalimIKY12_survey.txt
YuanWCW12 Efficient Subgraph Similarity Search on Large Probabilistic Graph Databases VLDB '12 Ye Yuan, Guoren Wang, Lei Chen, Haixun Wang Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/vldb12_new_YuanWCW12_data.txt - -
GebhartJTKDLS12 A Hierarchical Thread Scheduler and Register File for Energy-Efficient Throughput Processors TOCS '30 Mark Gebhart, Daniel R. Johnson, David Tarjan, Stephen W. Keckler, William J. Dally, Erik Lindholm, Kevin Skadron Journal 38 BC EM_no - http://reproducibility.cs.arizona.edu/data/tocs30_GebhartJTKDLS12_data.txt - -
GandhiHRK12 AutoScale: Dynamic, Robust Capacity Management for Multi-Tier Data Centers TOCS '30 Anshul Gandhi, Mor Harchol-Balter, Ram Raghunathan, Michael A. Kozuch Journal 26 BC EM_no - http://reproducibility.cs.arizona.edu/data/tocs30_GandhiHRK12_data.txt - -
BugnionDRSW12 Bringing Virtualization to the x86 Architecture with the Original VMware Workstation TOCS '30 Edouard Bugnion, Mendel Rosenblum, Scott Devine, Jeremy Sugerman, Edward Y. Wang Journal 51 BC EM_no - http://reproducibility.cs.arizona.edu/data/tocs30_BugnionDRSW12_data.txt - http://reproducibility.cs.arizona.edu/data/tocs30_BugnionDRSW12_survey.txt
EsmaeilzadehBASB12 Power Limitations and Dark Silicon Challenge the Future of Multicore TOCS '30 Hadi Esmaeilzadeh, Emily R. Blem, Renee St. Amant, Karthikeyan Sankaralingam, Doug Burger Journal 27 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/tocs30_EsmaeilzadehBASB12_data.txt http://reproducibility.cs.arizona.edu/data/tocs30_EsmaeilzadehBASB12_build.txt -
SchupbachBRP12 A Declarative Language Approach to Device Configuration TOCS '30 Adrian Schupbach, Andrew Baumann, Timothy Roscoe, Simon Peter Journal 35 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/tocs30_SchupbachBRP12_data.txt http://reproducibility.cs.arizona.edu/data/tocs30_SchupbachBRP12_build.txt -
ChipounovKC12 The S2E Platform: Design, Implementation, and Applications TOCS '30 George Candea, Vitaly Chipounov, Volodymyr Kuznetsov Journal 49 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/tocs30_ChipounovKC12_data.txt http://reproducibility.cs.arizona.edu/data/tocs30_ChipounovKC12_build.txt -
SaezFKP12 Leveraging Core Specialization via OS Scheduling to Improve Performance on Asymmetric Multicore Systems TOCS '30 Juan Carlos Saez, Alexandra Fedorova, David Koufaty, Manuel Prieto Journal 38 HW - - We originally classified this paper as BC. In the survey response, the authors said the paper was HW. Therefore, we have reclassified the paper as HW. ; http://reproducibility.cs.arizona.edu/data/tocs30_SaezFKP12_data.txt - http://reproducibility.cs.arizona.edu/data/tocs30_SaezFKP12_survey.txt
HarterDVAA12 A File Is Not a File: Understanding the I/O Behavior of Apple Desktop Applications TOCS '30 Tyler Harter, Chris Dragga, Michael Vaughn, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau Journal 39 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/tocs30_HarterDVAA12_data.txt http://reproducibility.cs.arizona.edu/data/tocs30_HarterDVAA12_build.txt http://reproducibility.cs.arizona.edu/data/tocs30_HarterDVAA12_survey.txt
YuanZPZS12 Improving Software Diagnosability via Log Enhancement TOCS '30 Ding Yuan, Jing Zheng, Soyeon Park, Yuanyuan Zhou, Stefan Savage Journal 28 BC EM_0 - http://reproducibility.cs.arizona.edu/data/tocs30_YuanZPZS12_data.txt - -
ErlingssonPPBM12 Fay: Extensible Distributed Tracing from Kernels to Clusters TOCS '30 Mihai Budiu, Ulfar Erlingsson, Marcus Peinado, Simon Peter, Gloria Mainar-Ruiz Journal 35 BC EM_no - http://reproducibility.cs.arizona.edu/data/tocs30_ErlingssonPPBM12_data.txt - http://reproducibility.cs.arizona.edu/data/tocs30_ErlingssonPPBM12_survey.txt
FerdmanAKVAJKPAF12 Quantifying the Mismatch between Emerging Scale-Out Applications and Modern Processors TOCS '30 Michael Ferdman, Almutaz Adileh, Yusuf Onur Kocberber, Stavros Volos, Mohammad Alisafaee, Djordje Jevdjic, Cansu Kaynak, Adrian Daniel Popescu, Anastasia Ailamaki, Babak Falsafi Journal 24 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/tocs30_FerdmanAKVAJKPAF12_data.txt http://reproducibility.cs.arizona.edu/data/tocs30_FerdmanAKVAJKPAF12_build.txt -
EbrahimiLMP12 Fairness via Source Throttling: A Configurable and High-Performance Fairness Substrate for Multicore Memory Systems TOCS '30 Eiman Ebrahimi, Chang Joo Lee, Onur Mutlu, Yale N. Patt Journal 35 BC EM_0 - http://reproducibility.cs.arizona.edu/data/tocs30_EbrahimiLMP12_data.txt - -
VeeraraghavanLWOCFN12 DoublePlay: Parallelizing Sequential Logging and Replay TOCS '30 Peter M. Chen, Kaushik Veeraraghavan, Dongyoon Lee, Benjamin Wester, Jessica Ouyang, Jason Flinn, Satish Narayanasamy Journal 24 BC EM_no - http://reproducibility.cs.arizona.edu/data/tocs30_VeeraraghavanLWOCFN12_data.txt - -
AuZHL12 PScout: analyzing the Android permission specification CCS '12 Kathy Wain Yee Au, Yi Fan Zhou, Zhen Huang, David Lie Conference 12 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/ccs12_AuZHL12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_AuZHL12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_AuZHL12_survey.txt
LiZXYW12 Knowing your enemy: understanding and detecting malicious web advertising CCS '12 Zhou Li, Kehuan Zhang, Yinglian Xie, Fang Yu, XiaoFeng Wang Conference 13 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_LiZXYW12_data.txt - -
PengGSLQPNM12 Using probabilistic generative models for ranking risks of Android apps CCS '12 Hao Peng, Chris Gates, Bhaskar Sarma, Ninghui Li, Yuan Qi, Rahul Potharaju, Cristina Nita-Rotaru, Ian Molloy Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_PengGSLQPNM12_data.txt - -
BoldyrevaL12 Provable security of S-BGP and other path vector protocols: model, analysis and extensions CCS '12 Alexandra Boldyreva, Robert Lychev Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_BoldyrevaL12_data.txt - -
AlSabahBG12 Enhancing Tor's performance using real-time traffic classification CCS '12 Mashael AlSabah, Kevin Bauer, Ian Goldberg Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_AlSabahBG12_data.txt - -
SunB12 The devil is in the (implementation) details: an empirical analysis of OAuth SSO systems CCS '12 San-Tsai Sun, Konstantin Beznosov Conference 13 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_SunB12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_SunB12_survey.txt
KamaraMR12 Salus: a system for server-aided secure function evaluation CCS '12 Seny Kamara, Payman Mohassel, Ben Riva Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/ccs12_KamaraMR12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_KamaraMR12_survey.txt
ChenAC12 Differentially private sequential data publication via variable-length n-grams CCS '12 Rui Chen, Gergely Acs, Calude Castelluccia Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_ChenAC12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_ChenAC12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_ChenAC12_survey.txt
VaradarajanKFRS12 Resource-freeing attacks: improve your cloud performance (at your neighbor's expense) CCS '12 Venkatanathan Varadarajan, Thawan Kooburat, Benjamin Farley, Thomas Ristenpart, Michael M. Swift Conference 12 BC EM_yes OK_leq_30 We originally classified this paper as EM_no. The authors had replied positively to our initial inquiry over email but we didn't follow up on request. In the survey response, the authors give a link to the code. Therefore, we have classified the paper as EM_yes, downloaded the code and made a build attempt. ; http://reproducibility.cs.arizona.edu/data/ccs12_VaradarajanKFRS12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_VaradarajanKFRS12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_VaradarajanKFRS12_survey.txt
YanLKW12 Towards a bayesian network game framework for evaluating DDoS attacks and defense CCS '12 Guanhua Yan, Ritchie Lee, Alex Kent, David Wolpert Conference 14 BC EM_no - http://reproducibility.cs.arizona.edu/data/ccs12_YanLKW12_data.txt - -
AlmeidaBBBKB12 Full proof cryptography: verifiable compilation of efficient zero-knowledge protocols CCS '12 Jose Bacelar Almeida, Manuel Barbosa, Endre Bangerter, Gilles Barthe, Stephan Krenn, Santiago Zanella Beguelin Conference 13 BC EM_no - http://reproducibility.cs.arizona.edu/data/ccs12_AlmeidaBBBKB12_data.txt - -
KammerstetterPW12 Vanity, cracks and malware: insights into the anti-copy protection ecosystem CCS '12 Markus Kammerstetter, Christian Platzer, Gilbert Wondracek Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_KammerstetterPW12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_KammerstetterPW12_survey.txt
NikiforakisIKAJKPV12 You are what you include: large-scale evaluation of remote javascript inclusions CCS '12 Nick Nikiforakis, Luca Invernizzi, Alexandros Kapravelos, Steven Van Acker, Wouter Joosen, Christopher Kruegel, Frank Piessens, Giovanni Vigna Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_NikiforakisIKAJKPV12_data.txt - -
SchroederS12 Verifiable data streaming CCS '12 Dominique Schroder, Heike Schroder Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_SchroederS12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_SchroederS12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_SchroederS12_survey.txt
BarthePB12 Verified security of redundancy-free encryption from Rabin and RSA CCS '12 Gilles Barthe, David Pointcheval, Santiago Zanella Beguelin Conference 12 BC EM_0 - The paper reports on a machine-checkable proof. The introduction indicates that the infrastructure needed to check this proof is available on request: "The EasyCrypt input file corresponding to the proof presented in Section 4 appears in an extended version [7]; all the infrastructure needed to machine-check this proof is available on request." At no point the authors were contacted; rather, as shown in the build notes, the analysts obtained the code from a link found on Google (http://www.easycrypt.info/#download). A glance at the notes shows that the code downloaded is that of a candidate release of EasyCrypt (v1.0), rather than the version used in the paper (v0.2). So, the outcome of the evaluation, although successful, could not possibly be a measure of the reproducibility of the paper's results. Should the analysts have contacted the authors (or should they have downloaded the right version of EasyCrypt), they would have been able to reproduce the paper's results without significant effort. To sustain this claim, we give detailed instructions on how to get and build EasyCrypt v0.2, and check the proof on Debian 7.6 (the latest stable release). The whole process could be completed in under 5 minutes and does not require any particular skill besides identifying the Debian packages corresponding to external dependencies (listed in the README file). 1) Install external dependencies sudo apt-get install ocaml libocamlgraph-ocaml-dev alt-ergo cvc3 2) Get EasyCrypt 0.2 wget http://old.easycrypt.info/easycrypt-0.2.tgz tar zxf easycrypt-0.2.tgz 3) Build and install Why3 and EasyCrypt (following instructions in the README file) cd easycrypt-0.2/why3-0.71/ ./configure-disable-ide make sudo make install make byte sudo make install-lib why3config-detect cd .. ./configure make sudo make install 4) Check the proof reported on the paper ./easycrypt examples/ZAEP.ec; We originally classified the paper as Article because a link to the code was found in the paper. In the survey response, the authors said that we built related but incorrect code. The correct code is in an appendix in the article itself, but (because of how it is typeset) this code is not extractable from the pdf-file. We requested plain-text code through an email but did not receive a response. Therefore, we have reclassified as EM_0. ; http://reproducibility.cs.arizona.edu/data/ccs12_BarthePB12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_BarthePB12_survey.txt
CamenischLN12 Practical yet universally composable two-server password-authenticated secret sharing CCS '12 Jan Camenisch, Anna Lysyanskaya, Gregory Neven Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/ccs12_CamenischLN12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_CamenischLN12_survey.txt
BackesMU12 Computational soundness without protocol restrictions CCS '12 Michael Backes, Ankit Malik, Dominique Unruh Conference 13 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_BackesMU12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_BackesMU12_survey.txt
LuLWLJ12 CHEX: statically vetting Android apps for component hijacking vulnerabilities CCS '12 Long Lu, Zhichun Li, Zhenyu Wu, Wenke Lee, Guofei Jiang Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_LuLWLJ12_data.txt - -
MoonLLKPK12 Vigilare: toward snoop-based kernel integrity monitor CCS '12 Hyungon Moon, Hojoon Lee, Jihoon Lee, Kihwan Kim, Yunheung Paek, Brent Byunghoon Kang Conference 10 HW - - http://reproducibility.cs.arizona.edu/data/ccs12_MoonLLKPK12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_MoonLLKPK12_survey.txt
EdwardsC12 An historical examination of open source releases and their vulnerabilities CCS '12 Nigel Edwards, Liqun Chen Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_EdwardsC12_data.txt - -
CzeskisDKWB12 Strengthening user authentication through opportunistic cryptographic identity assertions CCS '12 Alexei Czeskis, Michael Dietz, Tadayoshi Kohno, Dan Wallach, Dirk Balfanz Conference 11 BC EM_no - The project was implemented and tested end-to-end. However, the code heavily depends on Google's internal systems: if released publicly, it will not build.; http://reproducibility.cs.arizona.edu/data/ccs12_CzeskisDKWB12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_CzeskisDKWB12_survey.txt
QianMX12 Collaborative TCP sequence number inference attack: how to crack sequence number under a second CCS '12 Zhiyun Qian, Z Morley Mao, Yinglian Xie Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_QianMX12_data.txt - -
ButtLSG12 Self-service cloud computing CCS '12 Shakeel Butt, H Andres Lagar-Cavilla, Abhinav Srivastava, Vinod Ganapathy Conference 12 BC EM_no - Your data says "Email sent" and "Replied no". This data point is wrong.
Cristian Collberg sent us email requesting the code, and we replied saying that the code is available, but requires the requesting institution to sign a collaboration agreement with AT&T Research. We have shared this code with at least one other team who signed such a collaboration agreement with AT&T Research.
We cannot make the code publicly available (e.g., on GitHub) because of the terms of the collaboration agreement under which the system was developed, as is the case with several systems built in collaboration with industrial partners. But the code is available for those willing to enter into a collaboration agreement with AT&T Research. The contact point to begin such an agreement would be Abhinav Srivastava, a co-author on the paper.; We originally classified this paper as EM_no. In the email response, the authors said that to get the code we would need to sign a collaboration agreement. For this study, we don't accept code that requires a legal agreement. In the survey response, the authors said that the code is available. We have kept the original classification of EM_no. ; http://reproducibility.cs.arizona.edu/data/ccs12_ButtLSG12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_ButtLSG12_survey.txt
MoghaddamLDG12 SkypeMorph: protocol obfuscation for Tor bridges CCS '12 Hooman Mohajeri Moghaddam, Baiyu Li, Mohammad Derakhshani, Ian Goldberg Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_MoghaddamLDG12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_MoghaddamLDG12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_MoghaddamLDG12_survey.txt
GeorgievIJABS12 The most dangerous code in the world: validating SSL certificates in non-browser software CCS '12 Martin Georgiev, Subodh Iyengar, Suman Jana, Rishita Anubhai, Dan Boneh, Vitaly Shmatikov Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_GeorgievIJABS12_data.txt - -
BianchiSKV12 Blacksheep: detecting compromised hosts in homogeneous crowds CCS '12 Antonio Bianchi, Yan Shoshitaishvili, Christopher Kruegel, Giovanni Vigna Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_BianchiSKV12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_BianchiSKV12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_BianchiSKV12_survey.txt
McCoyDKVS12 Priceless: the role of payments in abuse-advertised goods CCS '12 Damon McCoy, Hitesh Dharmdasani, Christian Kreibich, Geoffrey M. Voelker, Stefan Savage Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_McCoyDKVS12_data.txt - -
Bravo-LilloCDKSS12 Operating system framed in case of mistaken identity: measuring the success of web-based spoofing attacks on OS password-entry dialogs CCS '12 Cristian Bravo-Lillo, Lorrie Cranor, Julie Downs, Saranga Komanduri, Stuart Schechter, Manya Sleeper Conference 13 NC - - To replicate a user study requires not just the code used to run the study (if any -- some studies do not have any code behind them) but also all surveys, scripts, and other study materials. This does not seem to be the focus of your repeatability study. But I think you should label these as user studies rather than theoretical studies because these are empirical studies.;The study was a human-subjects experiment, so the most important feature in reproducibility is that we described every aspect of the study in such as way that someone could reproduce the methodology -- including code -- from the description. This is not a systems study where someone who reproduces code that looks and appears the same to the human eye might get different results. That said, I don't think our lead author is particularly protective of the code. Since it's not a systems project, the code was not written to be scalable or easily adopted by other users.; http://reproducibility.cs.arizona.edu/data/ccs12_Bravo-LilloCDKSS12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_Bravo-LilloCDKSS12_survey.txt
ChenJL12 A software-hardware architecture for self-protecting data CCS '12 Yu-Yuan Chen, Pramod A. Jamkhedkar, Ruby B. Lee Conference 14 HW - - http://reproducibility.cs.arizona.edu/data/ccs12_ChenJL12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_ChenJL12_survey.txt
Mironov12 On significance of the least significant bits for differential privacy CCS '12 Ilya Mironov Conference 12 EX - - Code used to generate graphs in Section 4 of the paper is available upon request.; http://reproducibility.cs.arizona.edu/data/ccs12_Mironov12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_Mironov12_survey.txt
PengLTLZ12 Mobile data charging: new attacks and countermeasures CCS '12 Chunyi Peng, Chi-yu Li, Guan-hua Tu, Songwu Lu, Lixia Zhang Conference 10 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_PengLTLZ12_data.txt - -
WeinbergWYBCWB12 StegoTorus: a camouflage proxy for the Tor anonymity system CCS '12 Zachary Weinberg, Jeffrey Wang, Vinod Yegneswaran, Linda Briesemeister, Steven Cheung, Frank Wang, Dan Boneh Conference 12 BC Web OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_WeinbergWYBCWB12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_WeinbergWYBCWB12_build.txt -
CaiZJJ12 Touching from a distance: website fingerprinting attacks and defenses CCS '12 Xiang Cai, Xin Cheng Zhang, Brijesh Joshi, Rob Johnson Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_CaiZJJ12_data.txt - -
ChuangGM12 How secure are power network signature based time stamps? CCS '12 Wei-Hong Chuang, Ravi Garg, Min Wu Conference 11 BC EM_yes OK_leq_30 Our work as anti-forensic analysis (attacks and countermeasure for ENF based forensic work) has a mix of theoretical analysis, practical algorithms, and hardware (sensing data collection).; http://reproducibility.cs.arizona.edu/data/ccs12_ChuangGM12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_ChuangGM12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_ChuangGM12_survey.txt
Akinyele0HP12 Machine-generated algorithms, proofs and software for the batch verification of digital signature schemes CCS '12 Joseph A. Akinyele, Matthew Green, Susan Hohenberger, Matthew W. Pagano Conference 14 BC EM_yes OK_gt_30 http://reproducibility.cs.arizona.edu/data/ccs12_Akinyele0HP12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_Akinyele0HP12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_Akinyele0HP12_survey.txt
StrackxP12 Fides: selectively hardening software application components against kernel-level or process-level malware CCS '12 Raoul Strackx, Frank Piessens Conference 12 BC EM_no - Source code and other work related to Fides can be found at this location: https://distrinet.cs.kuleuven.be/software/pcbac; We originally classified this paper as EM_no because in their email response the authors said that the code was not available due to possible commercialization. In the survey response, the authors said that the code is now available. Our policy is to consider the code available at the time of the study. Therefore, we have kept the original classification of EM_no. ; Code now available at https://distrinet.cs.kuleuven.be/software/pcbac/#fides (notified via survey as of 9/22/2014) http://reproducibility.cs.arizona.edu/data/ccs12_StrackxP12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_StrackxP12_survey.txt
XieYKAGVWHM12 Innocent by association: early recognition of legitimate users CCS '12 Yinglian Xie, Fang Yu, Qifa Ke, Martin Abadi, Eliot Gillum, Krish Vitaldevaria, Jason Walter, Junxian Huang, Z Morley Mao Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_XieYKAGVWHM12_data.txt - -
SrivatsaH12 Deanonymizing mobility traces: using social network as a side-channel CCS '12 Mudhakar Srivatsa, Mike Hicks Conference 10 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_SrivatsaH12_data.txt - -
WilliamsST12 PrivateFS: a parallel oblivious file system CCS '12 Peter Williams, Radu Sion, Alin Tomescu Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_WilliamsST12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_WilliamsST12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_WilliamsST12_survey.txt
YangLQQMM12 Minimizing private data disclosures in the smart grid CCS '12 Weining Yang, Ninghui Li, Yuan Qi, Wahbeh Qardaji, Stephen McLaughlin, Patrick McDaniel Conference 13 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_YangLQQMM12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_YangLQQMM12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_YangLQQMM12_survey.txt
HolzerFKV12 Secure two-party computations in ANSI C CCS '12 Andreas Holzer, Martin Franz, Stefan Katzenbeisser, Helmut Veith Conference 12 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_HolzerFKV12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_HolzerFKV12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_HolzerFKV12_survey.txt
AizatulinGJ12 Computational verification of C protocol implementations by symbolic execution CCS '12 Mihhail Aizatulin, Andrew D. Gordon, Jan Jurjens Conference 12 BC Web OK_gt_30 http://reproducibility.cs.arizona.edu/data/ccs12_AizatulinGJ12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_AizatulinGJ12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_AizatulinGJ12_survey.txt
KamaraPR12 Dynamic searchable symmetric encryption CCS '12 Seny Kamara, Charalampos Papamanthou, Tom Roeder Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_KamaraPR12_data.txt - -
WartellMHL12 Binary stirring: self-randomizing instruction addresses of legacy x86 binary code CCS '12 Richard Wartell, Vishwath Mohan, Kevin W. Hamlen, Zhiqiang Lin Conference 12 BC EM_yes OK_Author 1. Your student did not escape backlashes ('\') while feeding path strings to the python calls. For example, the build log has this
-
>>> synthesize_dll( "C:\Users\student6\Documents\GitHub\\repro\ ccs12\WartellMHL12\src\Obfuscation\\results")
This call will work if the path is amended to,
>>> synthesize_dll( "C:\\Users\student6\\Documents\\GitHub\\repro \ccs12\WartellMHL12\src\Obfuscation\\results")
2. The last sentence states the student was unable to proceed because the script was looking for version 11 while the version of Visual Studio he was using was upgraded to 12.
However the first command in the build log creates a new project by setting the vsvars path to within version 11 of Visual Studio (which is why it is looking specifically for version 11).
I've copied the line I'm referencing below
-
>>> create_project(".\\results", "C:\Users\student6\Downloads\ Notepad++Portable\Notepad++Portable.exe", "C:\Program Files (
x86)\Microsoft Visual Studio 11.0\ Common7\Tools\vavars32.bat")
If that path is instead pointed to the location of vsvars for the currently used version of Visual Studio (not vavars, that seems to be a typo by the student), and if the path is correctly escaped as explained in (1), the build should work just fine.; http://reproducibility.cs.arizona.edu/data/ccs12_WartellMHL12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_WartellMHL12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_WartellMHL12_survey.txt
JamshedLMYKLYP12 Kargus: a highly-scalable software-based intrusion detection system CCS '12 Muhammad Jamshed, Jihyung Lee, Sangwoo Moon, Insu Yun, Deokjin Kim, Sungryoul Lee, Yung Yi, KyoungSoo Park Conference 12 BC EM_no - The code is unavailable as it is in the process of being commercialized.; http://reproducibility.cs.arizona.edu/data/ccs12_JamshedLMYKLYP12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_JamshedLMYKLYP12_survey.txt
FahlHMSBF12 Why eve and mallory love android: an analysis of android SSL (in)security CCS '12 Sascha Fahl, Marian Harbach, Thomas Muders, Matthew Smith, Lars Baumgartner, Bernd Freisleben Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_FahlHMSBF12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_FahlHMSBF12_build.txt -
WilliamsS12 Single round access privacy on outsourced storage CCS '12 Peter Williams, Radu Sion Conference 12 HW - - We originally classified the paper as BC. In the survey response, the authors said the paper is HW. Therefore, we have reclassified the paper as HW. ; http://reproducibility.cs.arizona.edu/data/ccs12_WilliamsS12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_WilliamsS12_survey.txt
SchuchardGTH12 Routing around decoys CCS '12 Max Schuchard, John Geddes, Christopher Thompson, Nicholas Hopper Conference 12 BC EM_yes OK_leq_30 The debug message from the student's attempt to run the code is pretty self-explanatory.; http://reproducibility.cs.arizona.edu/data/ccs12_SchuchardGTH12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_SchuchardGTH12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_SchuchardGTH12_survey.txt
EngelhardtMZ12 Intransitive noninterference in nondeterministic systems CCS '12 Kai Engelhardt, Ron van der Meyden, Chenyi Zhang Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_EngelhardtMZ12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_EngelhardtMZ12_survey.txt
AkkusCHFG12 Non-tracking web analytics CCS '12 Istemi Ekin Akkus, Ruichuan Chen, Michaela Hardt, Paul Francis, Johannes Gehrke Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_AkkusCHFG12_data.txt - -
GordonKKKM0V12 Secure two-party computation in sublinear (amortized) time CCS '12 S Dov Gordon, Jonathan Katz, Vladimir Kolesnikov, Fernando Krell, Tal Malkin, Mariana Raykova, Yevgeniy Vahlis Conference 12 BC EM_no - As far as I am concerned, the code we have should be public. But a student at another institution controls the code, not me.; http://reproducibility.cs.arizona.edu/data/ccs12_GordonKKKM0V12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_GordonKKKM0V12_survey.txt
ZhangJRR12 Cross-VM side channels and their use to extract private keys CCS '12 Yinqian Zhang, Ari Juels, Michael K. Reiter, Thomas Ristenpart Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_ZhangJRR12_data.txt - -
DamGL12 TreeDroid: a tree automaton based approach to enforcing data processing policies CCS '12 Mads Dam, Gurvan Le Guernic, Andreas Lundblad Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_DamGL12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_DamGL12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_DamGL12_survey.txt
WangGNHB12 CensorSpoofer: asymmetric communication using IP spoofing for censorship-resistant web browsing CCS '12 Qiyan Wang, Xun Gong, Giang T. K Nguyen, Amir Houmansadr, Nikita Borisov Conference 12 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_WangGNHB12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_WangGNHB12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_WangGNHB12_survey.txt
McLaughlinM12 SABOT: specification-based payload generation for programmable logic controllers CCS '12 Stephen McLaughlin, Patrick McDaniel Conference 11 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_McLaughlinM12_data.txt - -
AuK12 PERM: practical reputation-based blacklisting without TTPS CCS '12 Man Ho Au, Apu Kapadia Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_AuK12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_AuK12_survey.txt
CalvetFM12 Aligot: cryptographic function identification in obfuscated binary programs CCS '12 Joan Calvet, Jose M. Fernandez, Jean-Yves Marion Conference 14 BC Article OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_CalvetFM12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_CalvetFM12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_CalvetFM12_survey.txt
DijkJORST12 Hourglass schemes: how to prove that cloud files are encrypted CCS '12 Marten van Dijk, Ari Juels, Alina Oprea, Ronald L. Rivest, Emil Stefanov, Nikos Triandopoulos Conference 16 BC EM_yes OK_Author Unfortunately, the author who has done most of the coding for this paper (Emil Stefanov) has passed away and the code is no longer maintained.; http://reproducibility.cs.arizona.edu/data/ccs12_DijkJORST12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_DijkJORST12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_DijkJORST12_survey.txt
MuthukumaranJG12 Leveraging "choice" to automate authorization hook placement CCS '12 Divya Muthukumaran, Trent Jaeger, Vinod Ganapathy Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_MuthukumaranJG12_data.txt - -
ArapinisMRRGRB12 New privacy issues in mobile telephony: fix and verification CCS '12 Myrto Arapinis, Loretta Mancini, Eike Ritter, Mark Ryan, Nico Golde, Kevin Redon, Ravishankar Borgaonkar Conference 12 HW - - The ProVerif code provided in the paper is fully executable with the latest version of ProVerif available at the time the paper was published.
I myself reproduced the femtocell hack, at a different location and using different hardware and a different SIM card (with respect to the experiments run in order to publish the paper) using the code provided to me by my co-authors. I could reproduce all of our results so I am confident that with the right equipment (femtocell + SIM card) our experiments can be repeated; We originally classified the paper as BC. In the survey response, the authors said the paper is HW. Therefore, we have reclassified the paper as HW. ; http://reproducibility.cs.arizona.edu/data/ccs12_ArapinisMRRGRB12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_ArapinisMRRGRB12_survey.txt
ShokriTTHB12 Protecting location privacy: optimal strategy against localization attacks CCS '12 Reza Shokri, George Theodorakopoulos, Carmela Troncoso, Jean-Pierre Hubaux, Jean-Yves Le Boudec Conference 11 BC EM_yes OK_leq_30 http://reproducibility.cs.arizona.edu/data/ccs12_ShokriTTHB12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_ShokriTTHB12_build.txt -
BellareHR12 Foundations of garbled circuits CCS '12 Mihir Bellare, Viet Tung Hoang, Phillip Rogaway Conference 13 NC - - The label "theoretical" may be a misleading synonym for "not backed by code". In terms of everyday English usage, our CCS'12 paper is both theoretical and practical. But the code associated to this project was described in a follow-on paper of ours, "Efficient Garbling from a Fixed-Key Blockcipher" (2013).; http://reproducibility.cs.arizona.edu/data/ccs12_BellareHR12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_BellareHR12_survey.txt
MooreAC12 Precise enforcement of progress-sensitive security CCS '12 Scott Moore, Aslan Askarov, Stephen Chong Conference 13 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_MooreAC12_data.txt - -
BernhardCPW12 Measuring vote privacy, revisited CCS '12 David Bernhard, Veronique Cortier, Olivier Pereira, Bogdan Warinschi Conference 12 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_BernhardCPW12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_BernhardCPW12_survey.txt
MavrogiannopoulosVVP12 A cross-protocol attack on the TLS protocol CCS '12 Nikos Mavrogiannopoulos, Frederik Vercauteren, Vesselin Velichkov, Bart Preneel Conference 11 BC EM_0 - The code used was a minor modification (less than 60 lines of code) of open-source projects, attributed in the paper. The referenced projects are available online.; http://reproducibility.cs.arizona.edu/data/ccs12_MavrogiannopoulosVVP12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_MavrogiannopoulosVVP12_survey.txt
GroefDNP12 FlowFox: a web browser with flexible and precise information flow control CCS '12 Willem De Groef, Dominique Devriese, Nick Nikiforakis, Frank Piessens Conference 12 BC Article OK_gt_30 We want to make clear that the first "build failure" status was not something specific to the research results of our CCS'12 paper but happened due to a difference in version of the installed VirtualBox. The error clearly explained what the student had to (i.e., adding an extra command line parameter).
Our software artefact has been online since the beginning of our research (back in 2010) and has been used and tested by a numerous amount of users on very different occasions (demo's, business events, academic conference, research project defences, ...) and has never failed to showcase for what is was built/designed.; http://reproducibility.cs.arizona.edu/data/ccs12_GroefDNP12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_GroefDNP12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_GroefDNP12_survey.txt
HongYX12 Populated IP addresses: classification and applications CCS '12 Chi-Yao Hong, Fang Yu, Yinglian Xie Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/ccs12_HongYX12_data.txt - -
KimGHOHPG12 OTO: online trust oracle for user-centric trust establishment CCS '12 Tiffany Hyun-Jin Kim, Payas Gupta, Jun Han, Emmanuel Owusu, Jason Hong, Adrian Perrig, Debin Gao Conference 13 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_KimGHOHPG12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_KimGHOHPG12_survey.txt
RoufMXXMG12 Neighborhood watch: security and privacy analysis of automatic meter reading systems CCS '12 Ishtiaq Rouf, Hossen Mustafa, Miao Xu, Wenyuan Xu, Rob Miller, Marco Gruteser Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/ccs12_RoufMXXMG12_data.txt - -
HardtN12 Privacy-aware personalization for mobile advertising CCS '12 Michaela Hardt, Suman Nath Conference 12 BC EM_no - http://reproducibility.cs.arizona.edu/data/ccs12_HardtN12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_HardtN12_survey.txt
NighswanderLDBB12 GPS software attacks CCS '12 Tyler Nighswander, Brent Ledvina, Jonathan Diamond, Robert Brumley, David Brumley Conference 12 HW - - http://reproducibility.cs.arizona.edu/data/ccs12_NighswanderLDBB12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_NighswanderLDBB12_survey.txt
CramptonGY12 On the parameterized complexity of the workflow satisfiability problem CCS '12 Jason Crampton, Gregory Gutin, Anders Yeo Conference 31 NC - - http://reproducibility.cs.arizona.edu/data/ccs12_CramptonGY12_data.txt - -
GeneiatakisPKK12 Adaptive defenses for commodity software through virtual application partitioning CCS '12 Dimitris Geneiatakis, Georgios Portokalidis, Vasileios P. Kemerlis, Angelos D. Keromytis Conference 12 BC Article OK_gt_30 http://reproducibility.cs.arizona.edu/data/ccs12_GeneiatakisPKK12_data.txt http://reproducibility.cs.arizona.edu/data/ccs12_GeneiatakisPKK12_build.txt http://reproducibility.cs.arizona.edu/data/ccs12_GeneiatakisPKK12_survey.txt
GrierBCCDLMMNPPRRRTPSV12 Manufacturing compromise: the emergence of exploit-as-a-service CCS '12 Chris Grier, Lucas Ballard, Juan Caballero, Neha Chachra, Christian J. Dietrich, Kirill Levchenko, Panayiotis Mavrommatis, Damon McCoy, Antonio Nappa, Andreas Pitsillidis, Niels Provos, M Zubair Rafique, Moheeb Abu Rajab, Christian Rossow, Kurt Thomas, Vern Paxson, Stefan Savage, Geoffrey M. Voelker Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_GrierBCCDLMMNPPRRRTPSV12_data.txt - http://reproducibility.cs.arizona.edu/data/ccs12_GrierBCCDLMMNPPRRRTPSV12_survey.txt
XuCGK12 PeerPress: utilizing enemies' P2P strength against them CCS '12 Zhaoyan Xu, Lingfeng Chen, Guofei Gu, Christopher Kruegel Conference 12 EX - - http://reproducibility.cs.arizona.edu/data/ccs12_XuCGK12_data.txt - -