How TORPEDO Verification Works

Non-Verified Results

Any organization or individual may submit a TORPEDO result. The results will be posted after a cursory check, but usually without modification. If we are able to run the files, then the results will be posted. If we are unable to get the configuration to run at all, then the submission is rejected. When results are posted, we include the date of submission, the name of the person or organization submitting the result, and the version of TORPEDO used, along with the results themselves. There is no analysis performed other than the cursory running of the configuration files. We do not check to see if the files are correct or valid.

The Verification Process

For an organization that wishes to have a set of results to be classified as Verified, we implement the following process. The primary objective of verification is to re-create the same results in a environment overseen by the review committee. If we are able to recreate the same results in our environment, we verify their correctness. Correctness verification includes running a concurrency test on the submissions, which is important as it is one area where competing results may attempt to optimize access at the sacrifice of proper execution under heavier loads. If the results are correct, then we also provide an analysis of what the OR mapping software does, how it is tuned, and a results summary in a short write up. If the results prove to be incorrect, we will work with submitter to identify the discrepancies and to correct the results.

Get Verified!

Would you like to start the process of having a set of results verified in our labs? If so, contact us at i n f o r m a t i o n@torpedo-group.org and we'll be in touch to talk about what's involved.