NCSU SoS Lablet Evaluation - October 2014

Public Audience
Purpose: To highlight project progress. Information is generally at a higher level which is accessible to the interested public. All information contained in the report (regions 1-3) is a Government Deliverable/CDRL.

PI(s):  Lindsey McGowen, Alyson Wilson, David Wright, Jeff Carver
Researchers: Merve Tekbudak

PROBLEM ADDRESSED

• Contributions to Developing a Science of Security - We will design and implement an evaluation process for assessing the effectiveness and impact of the Lablet's research and community development activities (McGowen, Wilson, & Wright).
• Contributions to Security Science Research Methodology - We will examine both the impact of Lablet work on the maturity of the SoS field and the methodological rigor of the Lablet research projects themselves (McGowen, Carver).
• Development of a Community of Practice for the Science of Security - We will develop methods to assess whether Lablet activities are contributing to the development of a sustainable community of practice for the SoS field (McGowen, Wilson, & Wright).

PUBLICATIONS
Report papers written as a results of this research. If accepted by or submitted to a journal, which journal. If presented at a conference, which conference.

ACCOMPLISHMENT HIGHLIGHTS

• Presented and discussed the NCSU lablet evaluation plan at the last Quarterly PI meeting at CMU.  Revised evaluation plan based on the feedback provided at that meeting.
• Refined and further developed evaluation tools and protocols for scientific impact assessment.
• Reviewed literature to identify measures of scientific impact appropriate for computer science.
• Refined methodology feedback tools for student research papers and plans.
• Presented methodology guidelines and feedback process at the first student research session.
• Trained student on evaluation methodologies.