{"id":169797,"date":"2021-03-04T07:45:14","date_gmt":"2021-03-04T12:45:14","guid":{"rendered":"https:\/\/today.uconn.edu\/?p=169797"},"modified":"2021-06-28T10:20:23","modified_gmt":"2021-06-28T14:20:23","slug":"testing-the-success-of-their-communication-class-scientists-are-surprised","status":"publish","type":"post","link":"https:\/\/today.uconn.edu\/2021\/03\/testing-the-success-of-their-communication-class-scientists-are-surprised\/","title":{"rendered":"Testing the Success of Their Communication Class, Scientists are Surprised"},"content":{"rendered":"<p>It takes plenty of practice to become a skilled science communicator\u2014and \u201cskilled communication\u201d is more subjective than researchers have assumed, a team of researchers found out when they tried measuring the success of their own graduate science communication course.<\/p>\n<p>Despite the fact that most of us learn to talk around age three, effectively conveying information to another person so they act on it can be a lifelong challenge. George Bernard Shaw memorably said the single biggest problem in communication is the illusion that it has taken place. The playwright had a point.<\/p>\n<p>If merely communicating is widely recognized to be difficult, communicating about science can be doubly so. Particularly in the United States, clashes over values and culture and the politicization of certain topics can make it hard to find a common place to even start a conversation. But as a society we face challenges from climate change, viruses, decaying infrastructure, agricultural failures, and many other issues that could be profitably informed by scientific data\u2014if we could only find a way to communicate with each other.<\/p>\n<p>A UConn science communication course jointly offered by the departments of Journalism and Ecology and Environmental Biology (EEB) has tried for 15 years to help students do exactly that. The class brought journalism and graduate science students together to learn from each other. The journalists learned how to question scientists and write about arcane concepts for regular readers, and the scientists practiced explaining difficult ideas, with the resulting news stories for feedback.<\/p>\n<p>But after more than a decade of teaching the class, journalism professor Bob Wyss, former journalist and EEB staff scientist Bob Capers, and EEB professor Margaret Rubega decided they needed a way to evaluate how well the class was actually working. Did students really improve their communication skills? Self-evaluations by the students always gave the class high marks, but self-evaluations are notoriously unreliable. As Rubega points out, everyone who takes a driver\u2019s education course feels more confident about driving\u2014but confidence does not a good driver make.<\/p>\n<p>Instead of self-reports, Capers, Rubega and Wyss ran a three-year study comparing their science graduate students\u2019 spoken communication skills before and after the class with those of equivalent grad students who did not take the course. They teamed up with Andrew M. MacDonald at the Universit\u00e9 de Montr\u00e9al, and UConn Communication professor Anne Oeldorf Hirsch and EEB post doctoral researcher Kevin Burgio to conduct the study. They had the hundreds of undergraduate students who take Communication 100 class each year be the judges of communication quality.<\/p>\n<p>The results, published <a href=\"https:\/\/journals.sagepub.com\/doi\/full\/10.1177\/1075547020971639\">in Science Communication in December<\/a>, were not what the researchers expected. Not only did the graduate students who took the science communication course not improve, but the audience themselves did not agree about who was, and was not, a good communicator.<\/p>\n<p>\u201cHow do you measure effective communication? It\u2019s hard, so context specific,\u201d says Oeldorf-Hirsch. She points out that there are many goals you can have for a specific message. Do you want the listener to remember it? Like it? Understand it? Do you want to persuade them? For the purposes of the study, the team decided to have the undergrad judges focus on just three things: the speaker\u2019s clarity, trustworthiness and engagement.<\/p>\n<p>But even for those simple goals, the audience did not agree. Even the graduate student with the highest average rating was scored low by some reviewers, and the graduate student with the lowest average rating still received some high scores.<\/p>\n<p>\u201cWe went into this thinking we\u2019d get an answer,\u201d to whether the class was working, but \u201cinstead, we found a whole mound of complexities,\u201d says Wyss.<\/p>\n<p>They have lots of questions about the meaning of the results. One guess is that a one-semester course just doesn\u2019t provide enough time, or practice, to improve working communication skills.<\/p>\n<p>\u201cNobody masters a complex skill in six months. It takes time and practice; you have to do it over and over again,\u201d says Capers.<\/p>\n<p>Oeldorf-Hirsch says it may also be that there are unique challenges to communicating about science. Or that we aren\u2019t measuring the right things. One thing is sure; if the semester-long class with multiple opportunities to practice science communication is not effective, the many two-hour or day-long seminars on science communication are probably not any better, at least as standalone classes.<\/p>\n<p>But that\u2019s not to say they are useless, either.<\/p>\n<p>\u201cWe don&#8217;t believe for a minute that students in our classes learn nothing,\u201d Rubega says. \u201cIt is clear from their performance in class that they know a lot about the pitfalls of communicating to public audiences, and the theory of what successful communication should look like. What our study shows is that knowing about it, and being able to actually communicate successfully with an audience, are different.\u201d The other researchers agree. And they\u2019re also investigating now whether written communication is different than spoken; they\u2019re still evaluating results from a different class on writing about science.<\/p>\n<p>And if the effectiveness of a class is measured by the outcomes, the science communication class has had some pretty good ones. Take Kevin Burgio, who worked as a post doc on this study. He took the science communication class as an undergrad in 2009, and then several times as a graduate student. He subsequently published a science story he began writing in class through a syndication service and participated in a science storytelling workshop in 2018. And now he\u2019s the Director of Conservation Science at the New York City Audubon, a role that requires significant outreach to the public about science.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>How do you measure the success of a science communication class? The answer is more complex than it may seem.<\/p>\n","protected":false},"author":79,"featured_media":169900,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"wds_primary_category":0,"wds_primary_series":0,"wds_primary_attribution":0,"footnotes":""},"categories":[2226,2317,2076,2235,2225],"tags":[],"magazine-issues":[],"coauthors":[1899],"class_list":["post-169797","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-clas","category-journalism","category-research","category-today-homepage","category-uconn-storrs"],"pp_statuses_selecting_workflow":false,"pp_workflow_action":"current","pp_status_selection":"publish","acf":[],"publishpress_future_action":{"enabled":false,"date":"2026-07-19 12:13:53","action":"change-status","newStatus":"draft","terms":[],"taxonomy":"category","extraData":[]},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts\/169797","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/users\/79"}],"replies":[{"embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/comments?post=169797"}],"version-history":[{"count":7,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts\/169797\/revisions"}],"predecessor-version":[{"id":169901,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts\/169797\/revisions\/169901"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/media\/169900"}],"wp:attachment":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/media?parent=169797"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/categories?post=169797"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/tags?post=169797"},{"taxonomy":"magazine-issue","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/magazine-issues?post=169797"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/coauthors?post=169797"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}