Visible to the public Development of Methodology Guidelines for Security ResearchConflict Detection Enabled

Submitted by nzahan on Fri, 12/18/2020 - 12:46pm

PI(s), Co-PI(s), Researchers:

PI: Jeffrey Carver

HARD PROBLEM(S) ADDRESSED
This refers to Hard Problems, released November 2012.

PUBLICATIONS
Still in progress, none submitted/published yet

KEY HIGHLIGHTS
Each effort should submit one or two specific highlights. Each item should include a paragraph or two along with a citation if available. Write as if for the general reader of IEEE S&P.
The purpose of the highlights is to give our immediate sponsors a body of evidence that the funding they are providing (in the framework of the SoS lablet model) is delivering results that "more than justify" the investment they are making.

During this quarter, we focused on a manuscript to be submitted to IEEE S&P magazine that illustrates good examples of reporting cyber security research in a scientifically rigorous manner. These examples provide the type of information necessary to further the key tenets of scientific progress, repetition, meta-analysis, and theory building. Supporting these three tenets of scientific progress will in turn support the growth of the science of security. Two members of the Lablet have reviewed and provided feedback on the manuscript. We are finalizing it for submission to IEEE S&P in the next quarter.

To augment the interviews we conducted with members and associates of the Lablets in previous quarters, this quarter we began a study of review comments from the HotSoS papers. We obtained IRB approval and are in the process of obtaining consent and gathering the comments for further analysis. The goal of this analysis is to gain another perspective on the information that expert reviewers expect from scientifically rigorous cyber security papers. The HotSoS conference is the perfect venue for obtaining this type of information due to the nature of the papers and of the reviewers.

COMMUNITY ENGAGEMENTS

  • We have begun engaging with members of prior HoTSoS organizing and program committees to obtain consent for our comment review process study.
  • The Good Examples article is based on past SoS work and showcases papers listed as "Notable SoS Papers" (https://cps-vo.org/node/61173).
  • The Good Examples article has been reviewed by SoS members.

EDUCATIONAL ADVANCES:

None

Groups: