{"id":285,"date":"2016-09-02T10:05:01","date_gmt":"2016-09-02T09:05:01","guid":{"rendered":"https:\/\/www.feverbee.com\/roi\/?p=285"},"modified":"2023-04-06T07:11:20","modified_gmt":"2023-04-06T07:11:20","slug":"measuring-research-cost-savings","status":"publish","type":"post","link":"https:\/\/www.feverbee.com\/roi\/measuring-research-cost-savings\/","title":{"rendered":"Measuring Research Cost Savings"},"content":{"rendered":"<section class=\"content standard\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<h1>10<\/h1>\n<h2>10.5: Measuring Research Cost Savings<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-7\" src=\"\/wp-content\/uploads\/sites\/2\/2016\/09\/sponsored-by-sap.png\" alt=\"Sponsored by SAP\" width=\"113\" height=\"65\"><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h3>An online community can yield considerable innovation and research benefits to an organization. Even if your community was not created as a research or innovation vehicle, you can still create the value of the community by extracting value insights from the community.<\/h3>\n<p><div class=\"boxout\"><\/p>\n<p>These insights come in two forms: those which are solicited and those which are unsolicited.<\/p>\n<table width=\"624\">\n<tbody>\n<tr>\n<td width=\"186\"><strong>Solicited feedback <\/strong><\/td>\n<td width=\"438\">\n<ul>\n<li>Interviews<\/li>\n<li>Surveys<\/li>\n<li>Questionnaires<\/li>\n<li>Polls<\/li>\n<li>Direct questions<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<tr>\n<td width=\"186\"><strong>Unsolicited feedback<\/strong><\/td>\n<td width=\"438\">\n<ul>\n<li>Trends<\/li>\n<li>Audience profile data<\/li>\n<li>Complaints<\/li>\n<li>Requests<\/li>\n<\/ul>\n<\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p><\/div><\/p>\n<p>An entire industry has developed around <a href=\"http:\/\/upfrontanalytics.com\/mrocs\/\">market research online communities (MROC)<\/a>. The goal is to harness the collective sentiment, wisdom, and creativity of an audience to generate useful product ideas. However, while these might be <em>core drivers <\/em>behind an organization\u2019s push to develop a community, they are not the only research and innovation benefits.<\/p>\n<p>However, these benefits are among the most difficult to fully capture in a financial metric. These benefits fall under two categories: 1) Those which have a clear equivalent cost (e.g. undertaking research in a community compared with focus groups) and 2) Those which yield a superior performance (e.g. resolving problems faster, improved time to market for new products, or development of new product ideas).<\/p>\n<p><div class=\"tweet\">\r\n\t<a href=\"https:\/\/twitter.com\/intent\/tweet?text=Research%2Finnovation+benefits+fit%26nbsp%3Bin+2+categories%3A+those+with+clear+equivalent+cost+%26+those+with+superior+performance&amp;url=https:\/\/www.feverbee.com\/roi\/measuring-research-cost-savings\/\" target=\"_blank\">\r\n\t\t<h3>Research\/innovation benefits fit&nbsp;in 2 categories: those with clear equivalent cost &amp; those with superior performance<\/h3>\r\n\t\t<span class=\"tweetButton\">&nbsp;<\/span><p class=\"tweetLink\">Click to Tweet<\/p>\r\n\t<\/a>\r\n<\/div><\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content standard\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><div class=\"cta questions\"><div><h3>Any Questions?<\/h3><p>Don\u2019t understand? Need some help? Ask a question in FeverBee Experts.<\/p><p><a class=\"button\" href=\"https:\/\/experts.feverbee.com\/t\/roi-testing-title-change\/4041\">Ask a Question<\/a><\/p><\/div><\/div><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<p>The former proves relatively easy to quantify. We first identify the cost of undertaking research to gather qualitative and quantitative insights through other forms (e.g. focus groups, surveys, research, etc.) and then contrast this with gaining comparable insights within the community. This can be on a \u2018<em>per project<\/em>\u2019 basis or \u2018<em>cost per idea<\/em>\u2019 basis.<\/p>\n<p>However, this treats all ideas as being equal. In practice, ideas from different sources might well vary in quality. Therefore, the organization might wish to further estimate the average quality of ideas from different sources, determine the difference, and adjust the measure of return accordingly.<\/p>\n<p>The latter category is more complicated to accurately measure. You would need to compare performance against the community to determine the additional benefit created. This would not be a cost saving, but an additional benefit. We have decided not to delve deeper into this process here (although the value of ideas is an interesting metric). Instead, we have decided to use a simple process to determine the cost of solicited feedback.<\/p>\n<p><div class=\"boxout\"><\/p>\n<p>To measure this, you need:<\/p>\n<ol>\n<li>Cost of feedback via the community (technology, staff, platform, overheads).<\/li>\n<li>Additional research-specific costs (software license, staff time, incentives to participate).<\/li>\n<li>Cost of undertaking research via equivalent methods (moderator, observer meals, respondent meals, recruitment incentives, recruitment, rooms, stationary video, computer rental, monitor, etc.).<\/li>\n<li>Number of research projects undertaken per year.<\/li>\n<\/ol>\n<p><\/div><\/p>\n<p><div class=\"cta spreadsheet\"><div><h3>Community ROI Template<\/h3><\/p>\n<p>You can enter this data <a href=\"http:\/\/roi.feverbee.com\">in this spreadsheet here<\/a> or follow the process below.<\/p>\n<p><\/div><\/div><\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content flipped\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-905\" src=\"\/wp-content\/uploads\/sites\/2\/Calculator-1.png\" alt=\"Calculator\" width=\"326\" height=\"343\"><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step One: Determine the Cost of Comparable Solicited Feedback<\/h2>\n<p>The cost of solicited feedback is the total cost of developing the community, the cost of developing and executing the method used to solicit feedback, and the cost of analyzing the data. However, this assumes that the purpose of the community is entirely to solicit research. This is often the case in market research or <em>insights <\/em>communities. Outside of this category (and in general practice), research is often an additional benefit as opposed to a core purpose.<\/p>\n<p>As such, the <em>total cost <\/em>may already be factored into costs we have covered elsewhere (e.g. member retention). In this case, we would only use the <em>additional cost <\/em>of conducting interviews, surveys, polls, questionnaires, or direct questions in the community as opposed to other channels. For the purposes of our calculations, we assume that research for the community is used as an additional benefit.<\/p>\n<p>At this point, we compare the much lower value of conducting an <em>additional <\/em>research project in the community against other methods. This would include the cost of software (polling software, survey software, questionnaires), the estimated full-time staff equivalent of conducting this survey (e.g. 50% of one person\u2019s time for a month), and any miscellaneous costs (e.g. offering members an incentive to participate in the survey).<\/p>\n<p>If we assume the cost of a single research project is a $200 software license, $3,125 in staff time, and $2,000 in incentives, the total cost of a single research project would be $5,325.<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-10.26.26.png\"><img loading=\"lazy\" decoding=\"async\" class=\"screenshot alignnone wp-image-449 size-full\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-10.26.26.png\" alt=\"screenshot-2016-09-02-10-26-26\" width=\"1060\" height=\"329\"><\/a><\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content standard\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><div class=\"cta share\"><div><h3>Share Your Efforts<\/h3><p>Let us know what you measure.<\/p><p><a class=\"button\" href=\"mailto:richard@feverbee.com?subject=Share%20Example\">Share With Us<\/a><\/p><\/div><\/div><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step Two: Compare With Equivalent Methods<\/h2>\n<p>Now, we compare this with a cost of undertaking that research project elsewhere. This might mean a focus group, collecting surveys from research assistants in public, or scheduling and undertaking interviews with select participants.<\/p>\n<p>We adapted a <a href=\"https:\/\/www.nngroup.com\/articles\/focus-group-cost\/\">slightly older focus group example from 1998<\/a> as an example of what a research project might cost outside of a community.<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-10.27.35.png\"><img loading=\"lazy\" decoding=\"async\" class=\"screenshot alignnone wp-image-448 size-full\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-10.27.35.png\" alt=\"screenshot-2016-09-02-10-27-35\" width=\"1056\" height=\"259\"><\/a><\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content flipped\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-889\" src=\"\/wp-content\/uploads\/sites\/2\/Extrapolate.png\" alt=\"Extrapolating\" width=\"324\" height=\"480\"><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step Three: Determine The Difference And Multiply By The Number Of Research Projects Undertaken Via The Community<\/h2>\n<p>We can now subtract the cost of research via offline methods with the community to identify the cost difference per research projects.<\/p>\n<p>We can now calculate the value of the community for research projects by multiplying this by the total number of research projects undertaken in the community, as shown below.<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-10.28.45.png\"><img loading=\"lazy\" decoding=\"async\" class=\"screenshot alignnone wp-image-447 size-full\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-10.28.45.png\" alt=\"screenshot-2016-09-02-10-28-45\" width=\"1061\" height=\"131\"><\/a><\/p>\n<p>We can now assume a cost saving per research project of $2,935. This would be multiplied per every equivalent project. If the community has undertaken seven research projects in two years, the cost saving would be $20,545.<\/p>\n<p>Note that this <em>strictly <\/em>assumes the research is directly comparable. If the quality of outcomes is not directly comparable, this must be adjusted by the comparable rating of the research. For example, if ideas from focus groups are rated as 4 out of 5 and, from the community, 3.5 out of 5, this is a 12.5% difference. The value of these ideas can be adjusted down by 12.5%. Hence, the cost saving would be $17,977.<\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"summary\"><div><article><h2>Summary<\/h2><\/p>\n<ol>\n<li>Many online communities have been created to yield innovation and insight. However, others can increase the value of their community by harvesting valuable insights.<\/li>\n<li>There are two types of insight: solicited and unsolicited. Solicited includes interviews, surveys, questionnaires, polls, direct questions. Unsolicited includes noticing trends, audience profile data, complaints, and requests.<\/li>\n<li>Measure the return of solicited insights is easy via cost comparison, while measuring the value of a good idea is more difficult (but not impossible, e.g. equivalent man hours to develop the idea).<\/li>\n<li>Measure the cost of a research project today against the cost of a research project via other method. Multiply this by the number of research projects to determine cost saving.<\/li>\n<\/ol>\n<p><\/article><\/div><\/section>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-285","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/posts\/285","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/comments?post=285"}],"version-history":[{"count":0,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/posts\/285\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/media?parent=285"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/categories?post=285"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/tags?post=285"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}