{"id":307,"date":"2016-09-02T12:01:44","date_gmt":"2016-09-02T11:01:44","guid":{"rendered":"https:\/\/www.feverbee.com\/roi\/?p=307"},"modified":"2023-04-06T07:06:55","modified_gmt":"2023-04-06T07:06:55","slug":"measuring-social-return","status":"publish","type":"post","link":"https:\/\/www.feverbee.com\/roi\/measuring-social-return\/","title":{"rendered":"Measuring Social Return"},"content":{"rendered":"<section class=\"content standard\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<h1>12<\/h1>\n<h2>12.1: Measuring Social Return<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-7\" src=\"\/wp-content\/uploads\/sites\/2\/2016\/09\/sponsored-by-sap.png\" alt=\"Sponsored by SAP\" width=\"113\" height=\"65\"><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h3>Measuring the social return first requires identifying a proxy figure. This might be the number of people reached with a message, the number of mentions about the topic online (and the % of those that mention the organization\u2019s work), the change in views on a topic as measured via a survey, the perceived level of knowledge of members, or quantified surveys where members can estimate their life satisfaction and their ability to handle their conditions.<\/h3>\n<p>From these, we can calculate a score and put a cost to the numbers which achieved this score. Once we have this score, we can compare this score before and after the community (or non-members vs. members) and estimate the impact of the community. From here, we can determine the cost per improvement in this figure.<\/p>\n<p>However, this assumes a cost saving rather than increased performance. It is equally possible using the CSAT scores approach to calculate the additional performance metrics of social return. For now, however, we will use the same method we use to determine customer spending.<\/p>\n<p><div class=\"boxout\"><\/p>\n<p>To measure the social return this way, we need the following metrics:<\/p>\n<ul>\n<li>Average satisfaction\/happiness scores of newcomers to the community.<\/li>\n<li>Average satisfaction\/happiness scores of the same group 12 months later.<\/li>\n<li>Average members within this cohort.<\/li>\n<li>Average member retention rate.<\/li>\n<li>Cost of the community (technology, staff, processes, overheads).<\/li>\n<li>Number of people reached by offline efforts.<\/li>\n<li>Duration of this reach.<\/li>\n<li>Investment per category of satisfaction point (content, events, staff costs, PR, direct response, etc.).<\/li>\n<\/ul>\n<p><\/div><\/p>\n<p><div class=\"cta spreadsheet\"><div><h3>Community ROI Template<\/h3><\/p>\n<p>You can drop these figures into <a href=\"http:\/\/roi.feverbee.com\">this spreadsheet<\/a> or follow the method below.<\/p>\n<p><\/div><\/div><\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content flipped\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><div class=\"cta questions\"><div><h3>Any Questions?<\/h3><p>Don\u2019t understand? Need some help? Ask a question in FeverBee Experts.<\/p><p><a class=\"button\" href=\"https:\/\/experts.feverbee.com\/t\/roi-testing-title-change\/4041\">Ask a Question<\/a><\/p><\/div><\/div><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step One: Determine the average <em>satisfaction <\/em>point per month per member<\/h2>\n<p>As a survey is the simplest method to capture social return outcomes, this is the method we will use here. We are also going to assume we are measuring life satisfaction scores here. This means we survey a portion of members each month to determine their satisfaction with the topic scores.<\/p>\n<p>There are two steps to this. It\u2019s very similar to measuring an increase or decrease in spending.<\/p>\n<p><strong>1) Calculate satisfaction score when members join<\/strong><\/p>\n<p>Send a survey or poll to newcomers asking them to rate their current life satisfaction, level of knowledge, their ability to handle the disease when they join. This is a scale from 1 to 10 with 1 being the lowest.<\/p>\n<p>Similar to the customer satisfaction scores, this can be accomplished using an <a href=\"https:\/\/en.wikipedia.org\/wiki\/Autoresponder\">autoresponder<\/a>, including a link in a welcome or confirmation email, directly messaging each newcomer, or manually sending out an email at the end of each month to all newcomers who joined within this period. From this data, you should be able to calculate the average satisfaction score of newcomers when they join the community.<\/p>\n<p>This is an important metric to capture as, without it, we can\u2019t determine the increase which is attributable to the community. We wish to break down the average response to this figure each month.<\/p>\n<p><strong>2) Calculate the satisfaction members after 6 to 12 months<\/strong><\/p>\n<p>Next, we setup an automated survey to go out to members after they have been active in the community for 6 to 12 months. Using an autoresponder to send this out after a defined amount of time will ensure you can match up similar cohorts of people by the month they joined.<\/p>\n<p>Now, calculate the average difference in satisfaction scores. This is the current satisfaction score minus the satisfaction score when they joined. If we know members rated their life satisfaction as 5.51 when they joined and this rose to 7.41 a year after joining the community, this shows a 1.9 increase in life satisfaction per member per year since joining the community.<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-13.59.51.png\"><img loading=\"lazy\" decoding=\"async\" class=\"screenshot alignnone wp-image-434 size-full\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-13.59.51.png\" alt=\"screenshot-2016-09-02-13-59-51\" width=\"1283\" height=\"188\"><\/a><\/p>\n<p>(Note that comparisons go off the page a little here)<\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content standard\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-886\" src=\"\/wp-content\/uploads\/sites\/2\/Community-Happiness-Chart-1.png\" alt=\"community-happiness-chart\" width=\"345\" height=\"406\"><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step Two: Determine the average increase of non-member satisfaction over the same time period<\/h2>\n<p>To determine this attribution, we can use either a random sample of non-members over the same time period or use the newcomer ratings to see whether this increased or decreased over the same period.<\/p>\n<p>Compare the increase or decrease in newcomer scores with the scores of newcomers who joined one year later. For example, this would be the scores from those that joined in January 2015 with January 2016, February 2015 with February 2016, etc.<\/p>\n<p>This is a good indication of the scores of the increase, or decrease in scores of non-members over that same time frame. We want to determine the difference in these scores each month.<\/p>\n<p>For example, using the spreadsheet below, we can see see the increase in these scores every single month. We then deduct this figure from the corresponding scores of those who registered one year ago.<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.00.52.png\"><img loading=\"lazy\" decoding=\"async\" class=\"screenshot alignnone wp-image-433 size-full\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.00.52.png\" alt=\"screenshot-2016-09-02-14-00-52\" width=\"1285\" height=\"262\"><\/a><\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content flipped\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><div class=\"cta share\"><div><h3>Share Your Efforts<\/h3><p>Let us know what you measure.<\/p><p><a class=\"button\" href=\"mailto:richard@feverbee.com?subject=Share%20Example\">Share With Us<\/a><\/p><\/div><\/div><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step Three: Determine Total Satisfaction Points<\/h2>\n<p>The above table shows us the influence of the community upon each member\u2019s satisfaction points.<\/p>\n<p>Next, we need to multiply this number by the number of members in the community and their average retention rates in order to determine the total growth in satisfaction points caused by the community each month.<\/p>\n<p>We can now combine these to identify the total increase in satisfaction points as a result of the community per year. In this case, 19,728 for the first year (bottom left box below).<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.01.43.png\"><img loading=\"lazy\" decoding=\"async\" class=\"screenshot alignnone wp-image-432 size-full\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.01.43.png\" alt=\"screenshot-2016-09-02-14-01-43\" width=\"1285\" height=\"201\"><\/a><\/p>\n<p>The next step is to calculate how much each one of these satisfaction points costs.<\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content standard\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-909\" src=\"\/wp-content\/uploads\/sites\/2\/Measuring.png\" alt=\"Measuring\" width=\"326\" height=\"467\"><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step Four: Measure the cost per satisfaction point<\/h2>\n<p>Now, we wish to measure what it costs to generate this many satisfaction points. This might be achieved by calculating the total cost of the community as per before and dividing the annual figure by the number of satisfaction points above.<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.02.12.png\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-431\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.02.12.png\" alt=\"screenshot-2016-09-02-14-02-12\" width=\"988\" height=\"255\"><\/a><\/p>\n<p>This shows us that each satisfaction point cost the organization $29 via the community.<\/p>\n<p>Now, we need to find out how this compares against other methods of increasing satisfaction points in order to determine how much money we are saving generating satisfaction points via this method. This means we need to run the same process for a sample of non-members.<\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content flipped\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><div class=\"cta share\"><div><h3>Add Suggestion<\/h3><p>If you have a suggestion for us in this area, please let us know!<\/p><p><a class=\"button\" href=\"mailto:richard@feverbee.com?subject=Suggestion\">Get in Touch<\/a><\/p><\/div><\/div><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step Five: Calculate Increase in Satisfaction Points For Non-Members<\/h2>\n<p>This process is very much the same. We multiply the difference in satisfaction points of non-members (newly registered members) by the number of people reached by the organization\u2019s non-community efforts in order to calculate the increase or decrease in satisfaction points per cohort.<\/p>\n<p>We can then identify the total number of satisfaction points generated by the organization\u2019s offline efforts.<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.03.58.png\"><img loading=\"lazy\" decoding=\"async\" class=\"screenshot alignnone wp-image-430 size-full\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.03.58.png\" alt=\"screenshot-2016-09-02-14-03-58\" width=\"1284\" height=\"229\"><\/a><\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content standard\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-905\" src=\"\/wp-content\/uploads\/sites\/2\/Calculator-1.png\" alt=\"Calculator\" width=\"326\" height=\"343\"><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step Six: Calculate the Total Cost of the Community and Cost Per Satisfaction Point Of Non-Community Efforts<\/h2>\n<p>Now, we can determine the costs involved in comparable efforts to increase the number of satisfaction points per the same period, then divide the total cost by the total number of points generated to get the cost per point generated.<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.05.12.png\"><img loading=\"lazy\" decoding=\"async\" class=\"screenshot alignnone wp-image-429 size-full\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.05.12.png\" alt=\"screenshot-2016-09-02-14-05-12\" width=\"982\" height=\"329\"><\/a><\/p>\n<p>This shows us that each satisfaction point via non-community efforts cost $22.73.<\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"content flipped\"><div><\/p>\n<p><aside class=\"\"><\/p>\n<p><div class=\"cta questions\"><div><h3>Any Questions?<\/h3><p>Don\u2019t understand? Need some help? Ask a question in FeverBee Experts.<\/p><p><a class=\"button\" href=\"https:\/\/experts.feverbee.com\/t\/roi-testing-title-change\/4041\">Ask a Question<\/a><\/p><\/div><\/div><\/p>\n<p><\/aside><\/p>\n<p><article class=\"\"><\/p>\n<h2>Step Seven: Calculate Difference And Multiply By Points Generated<\/h2>\n<p>The alternative method of calculating value would be to multiply this figure by the number of additional points generated to identify value.<\/p>\n<p>Our method is to determine the difference in satisfaction point costs and multiply this by the number of points generated. In this case, it is $36, with $29 via the community to get a difference of $7. This means it is $7 cheaper per every satisfaction point to increase value via the community instead of via other methods.<\/p>\n<p>We can multiply this by the total number of points generated by the community to get the total value below.<\/p>\n<p><a href=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.06.20.png\"><img loading=\"lazy\" decoding=\"async\" class=\"screenshot alignnone wp-image-428 size-full\" src=\"\/wp-content\/uploads\/sites\/2\/Screenshot-2016-09-02-14.06.20.png\" alt=\"screenshot-2016-09-02-14-06-20\" width=\"988\" height=\"171\"><\/a><\/p>\n<p><div class=\"boxout\"><\/p>\n<h2>Notes<\/h2>\n<p>A similar methodology could also be used to calculate any return where a proxy figure can be determined.<\/p>\n<p>For example, it would be possible to calculate the cost of generating a petition signature via the community compared with other methods. It would be possible to measure the cost of generating turnout at a protest vs. other methods.<\/p>\n<p><\/div><\/p>\n<p><\/article><\/p>\n<p><\/div><\/section>\n<section class=\"summary\"><div><article><h2>Summary<\/h2><\/p>\n<ol>\n<li>Social return is one of the hardest things to measure. To measure social return, we need to identify a relevant proxy figure (petition signatures collected, survey satisfaction\/happiness points, awareness\/mentions, etc.).<\/li>\n<li>We need to measure the cost of increasing the proxy via the community against traditional methods. Comparisons (before and after the community) are another possible proxy.<\/li>\n<li>This process will often need a lot of customization and adaptation to fit our specific situation.<\/li>\n<\/ol>\n<p><\/article><\/div><\/section>\n","protected":false},"excerpt":{"rendered":"","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"inline_featured_image":false,"footnotes":""},"categories":[2],"tags":[],"class_list":["post-307","post","type-post","status-publish","format-standard","hentry","category-uncategorised"],"acf":[],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/posts\/307","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/comments?post=307"}],"version-history":[{"count":0,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/posts\/307\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/media?parent=307"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/categories?post=307"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.feverbee.com\/roi\/wp-json\/wp\/v2\/tags?post=307"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}