{"id":482,"date":"2021-03-01T00:01:58","date_gmt":"2021-03-01T00:01:58","guid":{"rendered":"http:\/\/marcschmalz.com\/blog\/?p=482"},"modified":"2021-08-21T02:58:26","modified_gmt":"2021-08-21T02:58:26","slug":"early-measure-testing","status":"publish","type":"post","link":"http:\/\/marcschmalz.com\/blog\/early-measure-testing\/","title":{"rendered":"Early Measure Testing"},"content":{"rendered":"<p>I&#8217;m trying to build a set of measures for a set of latent variables regarding the identity functions of materials that I can apply to software developers and the things their teams create. After trying to write up a set, I tested their face validity by asking fellow PhD students to sort the proposed measures into &#8220;buckets&#8221; representing those latent variables. I explained the functions to my participants like this:<\/p>\n<p style=\"padding-left: 40px;\">The following table contains definitions of the identity functions for you to use in your sort.\u00a0<b>There is a &#8220;NA&#8221; column if there is no good option<\/b>, so please evaluate every statement.<\/p>\n<table style=\"margin-left: 40px;\">\n<tbody style=\"padding-left: 40px;\">\n<tr style=\"padding-left: 40px;\">\n<td style=\"padding-left: 40px;\">Effectiveness (EFF)<\/td>\n<td style=\"padding-left: 40px;\">The thing allows me a sense of control and to show competence.<\/td>\n<\/tr>\n<tr style=\"padding-left: 40px;\">\n<td style=\"padding-left: 40px;\">Emotional Regulation (EMR)<\/td>\n<td style=\"padding-left: 40px;\">The thing is a means to generate, express, or regulating emotions (self-esteem, belongingness, continuity\/stability).<\/td>\n<\/tr>\n<tr style=\"padding-left: 40px;\">\n<td style=\"padding-left: 40px;\">Actual Identity\u00a0(AID)<\/td>\n<td style=\"padding-left: 40px;\">The thing represents who I am right now (my qualities and values, differentiating me from others).<\/td>\n<\/tr>\n<tr style=\"padding-left: 40px;\">\n<td style=\"padding-left: 40px;\">Ideal Identity (IID)<\/td>\n<td style=\"padding-left: 40px;\">The thing represents who I want to be (the qualities, values, and goals to which I aspire).<\/td>\n<\/tr>\n<tr style=\"padding-left: 40px;\">\n<td style=\"padding-left: 40px;\">Personal History (PRH)<\/td>\n<td style=\"padding-left: 40px;\">The thing provides a sense of continuity with my personal history and how I became the person I am today.<\/td>\n<\/tr>\n<tr style=\"padding-left: 40px;\">\n<td style=\"padding-left: 40px;\">Symbolic Interrelatedness (SIR)<\/td>\n<td style=\"padding-left: 40px;\">The thing represents a link to an individual (a friend, a family member, a colleague).<\/td>\n<\/tr>\n<tr style=\"padding-left: 40px;\">\n<td style=\"padding-left: 40px;\">Social Identity\u00a0(SID)<\/td>\n<td style=\"padding-left: 40px;\">The thing represents a link to (or membership in) a group or subculture.<\/td>\n<\/tr>\n<tr style=\"padding-left: 40px;\">\n<td style=\"padding-left: 40px;\">Not Applicable (NA)<\/td>\n<td style=\"padding-left: 40px;\">There is no good relationship between a material identity function and this statement.<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>As I told my committee:<\/p>\n<p style=\"padding-left: 40px;\">Succinctly put, that first test was <em>horrible<\/em>. It did show the way to improvements, and a second test was much, much better! (Michelle has been extremely helpful, advising me on the creation of the instrument.) Now, I\u2019ve launched a broader test of those measures, hoping to evaluate them with real software folk prior to rolling them out as part of the full survey.<\/p>\n<p>The &#8220;sort&#8221; exercise is here: <a href=\"https:\/\/ischooluw.co1.qualtrics.com\/jfe\/form\/SV_bK4t0yaPcxqn8Hz\">https:\/\/ischooluw.co1.qualtrics.com\/jfe\/form\/SV_bK4t0yaPcxqn8Hz<\/a><\/p>\n<p>I did decide to just stop trying to develop measures for <em>symbolic interrelatedness<\/em>. This is supposed to regard &#8220;relationships with specific others&#8221; and there are too many &#8220;specific others&#8221; involved in software development to include them all. Some research into symbolic interrelatedness is now &#8220;future work.&#8221;<\/p>\n<p>With the set of latent variables reduced to six,\u00a0I used Prolific.com to screen for software developers and ask them to respond to the set: <a href=\"https:\/\/wsu.co1.qualtrics.com\/jfe\/form\/SV_ehe3FxInziFwNvM\">https:\/\/wsu.co1.qualtrics.com\/jfe\/form\/SV_ehe3FxInziFwNvM<\/a><\/p>\n<p>Analysis of those results are <a href=\"http:\/\/marcschmalz.com\/blog\/validity-testing-notes\/\">in another post<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>I&#8217;m trying to build a set of measures for a set of latent variables regarding the identity functions of materials that I can apply to software developers and the things their teams create. After trying to write up a set, <a class=\"more-link\" href=\"http:\/\/marcschmalz.com\/blog\/early-measure-testing\/\">Read More &#8230;<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[19],"tags":[],"class_list":["post-482","post","type-post","status-publish","format-standard","hentry","category-dissertation"],"_links":{"self":[{"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/posts\/482","targetHints":{"allow":["GET"]}}],"collection":[{"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/comments?post=482"}],"version-history":[{"count":3,"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/posts\/482\/revisions"}],"predecessor-version":[{"id":529,"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/posts\/482\/revisions\/529"}],"wp:attachment":[{"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/media?parent=482"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/categories?post=482"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/marcschmalz.com\/blog\/wp-json\/wp\/v2\/tags?post=482"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}