{"id":467,"date":"2020-01-16T16:09:08","date_gmt":"2020-01-16T16:09:08","guid":{"rendered":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/?p=467"},"modified":"2020-01-16T16:09:08","modified_gmt":"2020-01-16T16:09:08","slug":"why-you-should-take-surveys-and-what-it-takes-to-make-one-behind-the-survey-scenes-with-a-social-scientist","status":"publish","type":"post","link":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/why-you-should-take-surveys-and-what-it-takes-to-make-one-behind-the-survey-scenes-with-a-social-scientist\/","title":{"rendered":"Why You Should Take Surveys (and What It Takes to Make One): Behind the Survey Scenes with a Social Scientist"},"content":{"rendered":"<p align=\"center\" style=\"text-align: left\"><strong>Why You Should Take Surveys (and What It Takes to Make One): Behind the Survey Scenes with a Social Scientist<\/strong><\/p>\n<p align=\"center\" style=\"text-align: left\">By Brook McWherter<\/p>\n<p>If you are like me, you are probably tired of being bothered by surveys &#8211; they are everywhere! There are surveys at the bottom of receipts, from people on the sidewalk, in the mail, and everywhere online. We are surrounded by surveys!&nbsp;<\/p>\n<p>As a natural resource social scientist, I get a look behind the scenes of survey development and testing. You may be surprised to know that it is actually a lot of work. I am going to take you on a journey to Bolivia, to the first stage of my PhD research where I learned what it takes to get survey questions on your screen (or in your hand).&nbsp;&nbsp;<\/p>\n<p>You may be asking yourself, why did she go all the way to Bolivia?<\/p>\n<figure id=\"attachment_470\" aria-describedby=\"caption-attachment-470\" style=\"width: 207px\" class=\"wp-caption alignleft\"><img loading=\"lazy\" decoding=\"async\" width=\"207\" height=\"300\" class=\"size-medium wp-image-470\" alt=\"Left: (left to right) Meagan, Brooke, and Natura Technician Basilio\" src=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/several-in-one-2-e1578674431632-207x300.png\" srcset=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/several-in-one-2-e1578674431632-207x300.png 207w, https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/several-in-one-2-e1578674431632.png 480w\" sizes=\"auto, (max-width: 207px) 100vw, 207px\" \/><figcaption id=\"caption-attachment-470\" class=\"wp-caption-text\">(left to right) Meagan, Brooke, and Basilio, a Technician with Natura.<\/figcaption><\/figure>\n<p>My answer is in two parts. First, we were trying to understand individuals&#8217; and communities&#8217; choices in and perceptions of a water conservation project in Bolivia.&nbsp; Second, because whom we decide to survey will impact the types of questions we can ask and how we ask them, testing in the community is vital to developing an effective survey.<\/p>\n<p>With this objective in mind, we began our work in the town of Vallegrande (translated as large valley). Located in the southern part of Bolivia and nestled in the mountains, Vallegrande is a small and beautiful town filled with a diverse group of people who live both in the valley and further up into the mountains. It is surrounded by farmland, forest, ranch land. And, while it may have been summer in Indiana, when we traveled, in Bolivia it was winter, which meant many chilly 30\u2080F nights and with no heat!&nbsp;<\/p>\n<figure id=\"attachment_469\" aria-describedby=\"caption-attachment-469\" style=\"width: 783px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" width=\"783\" height=\"697\" class=\"size-full wp-image-469\" alt=\"Top Right: Photos of mountains near Vallegrande, Bottom left: Vallegrande, Bottom Middle: Mountains from the plane, Bottom right: Our ride!\" src=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/several-in-one-Copy-2.png\" srcset=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/several-in-one-Copy-2.png 783w, https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/several-in-one-Copy-2-300x267.png 300w, https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/several-in-one-Copy-2-768x684.png 768w\" sizes=\"auto, (max-width: 783px) 100vw, 783px\" \/><figcaption id=\"caption-attachment-469\" class=\"wp-caption-text\">Top: Photos of mountains near Vallegrande, Bottom left: Vallegrande, Bottom Middle: Mountains from the plane, Bottom right: Our ride! Photo Credit: Brooke McWherter<\/figcaption><\/figure>\n<p>Which leads us to our objective for the \u201csummer\u201d: to test 42 pages of questions with people who are similar to our study population to see how it is received in the local context, and if possible, make it a more reasonable length. For those of us in the social sciences this process is called piloting.&nbsp;<\/p>\n<p>So, what does it take to pilot test a survey in the field?&nbsp;<\/p>\n<p>To begin with, we had to assemble our team, as this was a large collaborative process. Our team included:&nbsp;<\/p>\n<ul>\n<li>My fellow PhD students from Purdue University and Utah State,<\/li>\n<li>Our professors who visited us throughout the process to provide guidance on piloting and communicated with us remotely and,<\/li>\n<li>Our local collaborator <a href=\"http:\/\/www.naturabolivia.org\/en\/home-2\/\" target=\"_blank\" rel=\"noopener noreferrer\">Natura Foundation Bolivia<\/a> who provided us with technical assistance, assisted with transportation, and overall helped us in finding people to interview as well as making us feel welcome.<\/li>\n<\/ul>\n<p>What did this look like on a daily basis?&nbsp;&nbsp;<\/p>\n<p>Every day for 2.5 months, we would get up at 7am, get our breakfast, walk down to the market, buy lunch (always the same chicken with potatoes or rice), grab bottles of water, and then be ready to go by 8am when our Natura driver would pick us up. Oh! We also had to print off our survey sections for everyone. Then we would drive for as long as 2 hours away down a bumpy dirt road to a small community where we would go door to door asking if people had the time to talk to us.&nbsp;<\/p>\n<figure id=\"attachment_495\" aria-describedby=\"caption-attachment-495\" style=\"width: 597px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" width=\"597\" height=\"447\" class=\"size-full wp-image-495\" alt=\"Interview with participant in Vallegrande, with research team: Brooke, Meagan and Dr. Ricardo Godoy. Photo Credit: Brooke McWherter\" src=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Interview-with-participant-in-Vallegrande-with-research-team.jpg\" srcset=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Interview-with-participant-in-Vallegrande-with-research-team.jpg 597w, https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Interview-with-participant-in-Vallegrande-with-research-team-300x225.jpg 300w\" sizes=\"auto, (max-width: 597px) 100vw, 597px\" \/><figcaption id=\"caption-attachment-495\" class=\"wp-caption-text\">Interview with participant in Vallegrande, with research team: Brooke, Meagan and Dr. Ricardo Godoy. Photo Credit: Brooke McWherter<\/figcaption><\/figure>\n<p>When we arrived we would go house to house and strike up a conversation with local landowners to see if they would be willing to talk with us and take our survey.&nbsp;&nbsp;<\/p>\n<p>If they agreed, we would ask them one of the questions from our survey. For each question we would observe:<\/p>\n<ul>\n<li>Did they understand the wording of the question?<\/li>\n<li>If we reworded the question in the moment, did it work?<\/li>\n<li>If we had to explain the question, what type of explanation went best?<\/li>\n<li>How long did it take us to ask the questions in each section?<\/li>\n<\/ul>\n<p>During the interviews, we would listen and take notes on our observations and suggested changes. Then each night we would return to Vallegrande, grab a quick dinner at the market, and head to the hotel to tediously go over all our notes as a group.&nbsp; We would even call the rest of the team members scattered across the United States to ensure that our edits were not cutting out critical components to the survey.<\/p>\n<figure id=\"attachment_497\" aria-describedby=\"caption-attachment-497\" style=\"width: 270px\" class=\"wp-caption alignleft\"><img loading=\"lazy\" decoding=\"async\" width=\"270\" height=\"300\" class=\"wp-image-497 size-medium\" alt=\"Photo of interview participant\" src=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Photos-of-different-participants-from-across-the-Vallegrande-region-Copy-270x300.png\" srcset=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Photos-of-different-participants-from-across-the-Vallegrande-region-Copy-270x300.png 270w, https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Photos-of-different-participants-from-across-the-Vallegrande-region-Copy.png 619w\" sizes=\"auto, (max-width: 270px) 100vw, 270px\" \/><figcaption id=\"caption-attachment-497\" class=\"wp-caption-text\">Interview participant. Photo Credit: Brooke McWherter<\/figcaption><\/figure>\n<p>This process was repeated throughout the day, week-by-week and month-by-month, often into the night reviewing everything\u2026all in Spanish!&nbsp; Little by little, we began to make progress and our survey started to look trimmed and tidied up.&nbsp;<\/p>\n<p>Along the way we met some amazing people who were kind enough to give us 30-60 minutes of their very busy days to talk with us, show us around, and more often than not, offer us food or drinks!&nbsp;&nbsp;<\/p>\n<p>The last part of the \u201csummer\u201d consisted of us testing the entire survey, and again looking for clarity and making sure the length was acceptable. At this point, we had started dreaming about the survey and were editing it in our sleep!&nbsp;&nbsp; Eventually we had a solid survey that required only minor edits before being implemented in the field.&nbsp; Then, it was time to say goodbye to Bolivia to travel to Purdue University and start classes.&nbsp;&nbsp;<\/p>\n<figure style=\"width: 544px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" width=\"544\" height=\"685\" class=\"wp-image-498 size-full\" alt=\"Shows different participants from across the Vallegrande region\" src=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Photos-of-different-participants-from-across-the-Vallegrande-region.png\" srcset=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Photos-of-different-participants-from-across-the-Vallegrande-region.png 544w, https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Photos-of-different-participants-from-across-the-Vallegrande-region-238x300.png 238w\" sizes=\"auto, (max-width: 544px) 100vw, 544px\" \/><figcaption class=\"wp-caption-text\">Participants from across the Vallegrande region. Photo Credit: Brooke McWherter<\/figcaption><\/figure>\n<p>On a personal note, although we worked well into the late hours of the night, it was an amazing experience!&nbsp; We grew together as a team, learned valuable lessons about developing and pilot testing surveys, and were able to create strong relationships with Natura, who we will continue to work with this coming summer.&nbsp;&nbsp;<\/p>\n<p>There you have it &#8211; now you know what pilot testing a survey is really like!&nbsp; It is long hours of rigorous note taking and discussion, amazing conversations, and if you are lucky, you can do it all in a beautiful location.<\/p>\n<p>If I can leave you with one last thing, next time you see a survey on your screen or in the mail, think about what happened to get it to that point, and if you have time &#8211; take it!<\/p>\n<figure id=\"attachment_499\" aria-describedby=\"caption-attachment-499\" style=\"width: 1024px\" class=\"wp-caption alignnone\"><img loading=\"lazy\" decoding=\"async\" width=\"1024\" height=\"768\" class=\"wp-image-499 size-full\" alt=\"Research team members enjoying some gifted watermelon!\" src=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Research-Team-enjoying-some-gifted-watermelon.jpg\" srcset=\"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Research-Team-enjoying-some-gifted-watermelon.jpg 1024w, https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Research-Team-enjoying-some-gifted-watermelon-300x225.jpg 300w, https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-content\/uploads\/sites\/3\/2020\/01\/Research-Team-enjoying-some-gifted-watermelon-768x576.jpg 768w\" sizes=\"auto, (max-width: 1024px) 100vw, 1024px\" \/><figcaption id=\"caption-attachment-499\" class=\"wp-caption-text\">Research team enjoying some gifted watermelon! (left to right) Dr. Jonathan Bauchet, Will Munger, and Natura Technician Dionicio. Photo Credit: Meagan Rathjen<\/figcaption><\/figure>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Why You Should Take Surveys (and What It Takes to Make One): Behind the Survey Scenes with a Social Scientist By Brook McWherter If you are like me, you are probably tired of being bothered by surveys &#8211; they are<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-467","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/posts\/467","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/comments?post=467"}],"version-history":[{"count":34,"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/posts\/467\/revisions"}],"predecessor-version":[{"id":508,"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/posts\/467\/revisions\/508"}],"wp:attachment":[{"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/media?parent=467"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/categories?post=467"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.purdue.edu\/fnr\/sites\/ma\/wp-json\/wp\/v2\/tags?post=467"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}