First of all, I am happy that there are conversations about helping the NPTE and the community’s wants and needs about how we use judge preferences now and in the future.
Secondly, I would like to remind folks - the NPTE Board officially does its business on Net-Benefits. I am probably one of the few that lacks access to the book of face, so I don’t have the ability to contribute to these conversations. Though, I am happy they are occurring. In the future, though, I have a request - I would like someone to post the link to the post or discussion on Net-benefits in a new thread to alert the board and myself that a response is sought.
Next, and most important, I am certainly on board with having us look at this pref data; it was something that was on my list of things to consider when I started as president, as I know it’s something that is very important to many members of our community. I have been in the process of compiling the last several years of data anonymized from past tab staff so that steps can be taken to evaluate these important questions about the implications of judge preferences. We are looking at the NPTE the last 6 years (may go back further, too), but there are some problems with obtaining the data - anonymizing the data is very time consuming and a process we’re looking into. Also, some of the STA files may have been eliminated or may be incomplete. Like I mentioned, we’re seeking the data we can find, if possible.
Now here are the next steps. I understand there are some who want copies of the data right, but this is my plan of action, as no data will be publicly released.
When thinking about how to analyze the data, there are some issues and things to consider regarding its use, which is why I have sought input from our IRB folks at my institution. One of the primary issues on the table is that we have not gathered consent for use of the data. Likely we will need to obtain legal consent from any competitor or coach to conduct the research. There is also a need to obtain the demographic data from all of former judges and competitors for which decisions in determining switches from various pref systems is needed. I have sought the help of one of my colleagues with a PhD in statistics to help me with this endeavor. As data becomes available, I will be happy to post it to Net-Benefits. As this is being cross posted, those stats gurus who want to contribute suggestions, possible research questions, ways to deal with a possible incomplete data set, feel free to post them there.
As many of you academics know, research takes time, and most importantly, I want to make sure it’s done right. I will seek help in expediting things as much as possible, so be on the look out for posts on NB etc. This year, prefs will remain the same until the research can be done and discussions can be had. We will certainly be seeking consent from attendees this upcoming year to ensure we can analyze the full data set so we can continue to make the tournament better in the future.
Has also been posted to facebook by Zach Schneider for me!