{"id":192609,"date":"2022-11-30T07:15:40","date_gmt":"2022-11-30T12:15:40","guid":{"rendered":"https:\/\/today.uconn.edu\/?p=192609"},"modified":"2023-07-06T11:08:32","modified_gmt":"2023-07-06T15:08:32","slug":"making-music-from-data-points-grad-student-collaborates-to-sonify-science","status":"publish","type":"post","link":"https:\/\/today.uconn.edu\/2022\/11\/making-music-from-data-points-grad-student-collaborates-to-sonify-science\/","title":{"rendered":"Making Music from Data Points: Grad Student Collaborates to &#8216;Sonify&#8217; Science"},"content":{"rendered":"<p>Just before Molly James \u201923 Ph.D. visited South Korea in August, the country had experienced significant flooding, the worst in 80 years, during a monsoon season that caused the Han River to overflow and wash out many areas of Seoul.<\/p>\n<p>It\u2019s a storm that on a graph comparing the country\u2019s daily precipitation in July and August of the last three years shoots a spike significantly higher than other daily records. And for James, it\u2019s a storm that gave pause, as she tried to figure out how to account for it in her latest project \u2013 translating scientific data into song.<\/p>\n<p>\u201cThis project doesn\u2019t necessarily focus on climate change, but it\u2019s hard not to think about it when you see the graph about rain,\u201d James says. \u201cWhen you analyze a change over time, it\u2019s obvious there are fluctuations that have happened because of climate change. You can see it in the data, and you can hear it in the music.\u201d<\/p>\n<p>James is a self-described numbers person, who studied physics as an undergraduate and now as a <a href=\"https:\/\/marinesciences.uconn.edu\/\">marine sciences<\/a> graduate student at <a href=\"https:\/\/averypoint.uconn.edu\/\">UConn Avery Point<\/a> looks at the hydrodynamics of the salt marsh system and how tides affect creeks and adjacent grasses.<\/p>\n<p>She loves math.<\/p>\n<p>\u201cBut in my college orchestra, the entire trombone section was physicists,\u201d she notes. \u201cI played tuba alongside them, and now I play trombone in the <a href=\"https:\/\/seccorchestra.com\/\">Southeastern Connecticut Community Orchestra<\/a>. Music is all patterning; it\u2019s math. The scales work the left side, the logic side, of your brain.\u201d<\/p>\n<p>James met <a href=\"https:\/\/www.youtube.com\/c\/SOPIANIST\/featured\">Hea Youn \u201cSophy\u201d Chung<\/a>, a Julliard School-trained pianist from South Korea, about five years ago and reconnected during the pandemic to practice conversational speaking in each other\u2019s native languages. Chung was impressed with James\u2019 work as an oceanographer and suggested they partner on a different project, one that would combine their strengths.<\/p>\n<p>They decided to use publicly available data from the Korean Meteorological Administration \u2013 the equivalent of the National Weather Service or the National Oceanic and Atmospheric Administration in the U.S. \u2013 and translate into musical notes various data points, James says, whether temperature or wind speed or another measure.<\/p>\n<p>Chung then tapped the right side, the creative side, of her brain to build chords and melodies to turn each song into a piece that\u2019s pleasant to the ear. A planning grant from the <a href=\"https:\/\/www.arko.or.kr\/eng\/index\">Arts Council Korea<\/a> funded the full project and allowed James to travel to South Korea for 2\u00bd weeks last summer, a trip during which the pair recorded some meteorological data of their own, including temperatures and humidity levels.<\/p>\n<p>\u201cThis project is meant to make people feel more connected to the environment, make people feel more connected to nature,\u201d James says. \u201cLooking at graphs is not something that\u2019s intuitive for most people, but music is a way that you can communicate something, even if it\u2019s very abstract.\u201d<\/p>\n<p><strong>Find a Baseline and Assign It a Note<\/strong><\/p>\n<p>James says one of the best sounding of the five songs is about precipitation, \u201cFlight Cancelled Due to Rain at Gimpo Airport,\u201d the song that took note of that historic monsoon rain.<\/p>\n<p>In writing it, James says, she and Chung assigned the piano\u2019s low D to the rain measurement of zero, times when there was no precipitation. Each added millimeter corresponded to a piano key, with the notes moving up the register to use as many of the instrument\u2019s 88 keys as possible \u2013 30 millimeters of rain equates to the key that\u2019s 30 away from D1.<\/p>\n<p>But the historic August storm recorded at one point 140 millimeters of rain, well off the keyboard.<\/p>\n<div class=\"wp-playlist wp-audio-playlist wp-playlist-light\">\n\t\t\t<div class=\"wp-playlist-current-item\"><\/div>\n\t\t<audio controls=\"controls\" preload=\"none\" width=\"640\"\n\t\t\t><\/audio>\n\t<div class=\"wp-playlist-next\"><\/div>\n\t<div class=\"wp-playlist-prev\"><\/div>\n\t<noscript>\n\t<ol>\n\t\t<li><a href='https:\/\/today.uconn.edu\/wp-content\/uploads\/2022\/11\/Flight-Cancelled-Due-to-Rain-at-Gimpo-Airport-audio.mp3'>Flight Cancelled Due to Rain at Gimpo Airport<\/a><\/li>\t<\/ol>\n\t<\/noscript>\n\t<script type=\"application\/json\" class=\"wp-playlist-script\">{\"type\":\"audio\",\"tracklist\":true,\"tracknumbers\":true,\"images\":true,\"artists\":true,\"tracks\":[{\"src\":\"https:\/\/today.uconn.edu\/wp-content\/uploads\/2022\/11\/Flight-Cancelled-Due-to-Rain-at-Gimpo-Airport-audio.mp3\",\"type\":\"audio\/mpeg\",\"title\":\"Flight Cancelled Due to Rain at Gimpo Airport\",\"caption\":\"\",\"description\":\"\\\"TR03_T10\\\". Track 31.\",\"meta\":{\"length_formatted\":\"0:48\"},\"image\":{\"src\":\"https:\/\/today.uconn.edu\/wp-includes\/images\/media\/audio.svg\",\"width\":48,\"height\":64},\"thumb\":{\"src\":\"https:\/\/today.uconn.edu\/wp-includes\/images\/media\/audio.svg\",\"width\":48,\"height\":64}}]}<\/script>\n<\/div>\n\t\n<figure id=\"attachment_192617\" aria-describedby=\"caption-attachment-192617\" style=\"width: 909px\" class=\"wp-caption aligncenter\"><img decoding=\"async\" class=\"wp-image-192617 img-responsive lazyload\" data-src=\"https:\/\/today.uconn.edu\/wp-content\/uploads\/2022\/11\/Flight-Cancelled-Due-to-Rain-at-Gimpo-Airport-graph-1-300x169.jpeg\" alt=\"This graph shows the daily precipitation over three years in July and August in Seoul, South Korea. The spike shown on Aug. 9, 2022, was recorded during the country's monsoon season, just before Molly James '23 Ph.D. visited the country as part of a collaboration with Hyeyoon &quot;Sophy&quot; Jung to turn scientific data into music. The pair assigned each daily measurement a note on the piano keyboard to write the song, &quot;Flight Cancelled Due to Rain at Gimpo Airport.&quot;\" width=\"909\" height=\"512\" data-srcset=\"https:\/\/today.uconn.edu\/wp-content\/uploads\/2022\/11\/Flight-Cancelled-Due-to-Rain-at-Gimpo-Airport-graph-1-300x169.jpeg 300w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2022\/11\/Flight-Cancelled-Due-to-Rain-at-Gimpo-Airport-graph-1-768x432.jpeg 768w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2022\/11\/Flight-Cancelled-Due-to-Rain-at-Gimpo-Airport-graph-1-630x354.jpeg 630w, https:\/\/today.uconn.edu\/wp-content\/uploads\/2022\/11\/Flight-Cancelled-Due-to-Rain-at-Gimpo-Airport-graph-1.jpeg 960w\" data-sizes=\"(max-width: 909px) 100vw, 909px\" src=\"data:image\/svg+xml;base64,PHN2ZyB3aWR0aD0iMSIgaGVpZ2h0PSIxIiB4bWxucz0iaHR0cDovL3d3dy53My5vcmcvMjAwMC9zdmciPjwvc3ZnPg==\" style=\"--smush-placeholder-width: 909px; --smush-placeholder-aspect-ratio: 909\/512;\" \/><figcaption id=\"caption-attachment-192617\" class=\"wp-caption-text\">This graph shows the daily precipitation over three years in July and August in Seoul, South Korea. The spike shown on Aug. 9, 2022, was recorded during the country&#8217;s monsoon season, just before Molly James &#8217;23 Ph.D. visited the country as part of a collaboration with Hea Youn &#8220;Sophy&#8221; Chung\u00a0to turn scientific data into music. The pair assigned each daily measurement a note on the piano keyboard to write the song, &#8220;Flight Cancelled Due to Rain at Gimpo Airport.&#8221; (Contributed photo)<\/figcaption><\/figure>\n<p>\u201cConsequently, in the music you hear this huge jump from the lowest register to the highest register of the piano,\u201d James explains, adding that Chung set a quick tempo for the 48-second song to mimic the patter of raindrops. \u201cWe looked at the various graphs and found a baseline number that we could assign a note. All the other notes are in reference to that.\u201d<\/p>\n<p>\u201cFlight Cancelled\u201d was straightforward to write, James says, while the other songs layered in a bit more of the data. For \u201cOne Week in Incheon,\u201d a sonification of the air temperature, the two used hourly temperatures on a graph from December 2021, found the weekly average, and assigned that data point middle C to establish a melody line.<\/p>\n<p>\u201cOverlaid on that we had chords that were made from the daily maximum, daily average, and daily minimum temperatures. The result is you feel this progression in the longer term over a week, but also the movement throughout the day of what the temperature is,\u201d James says. \u201cTo me it sounds a little somber, but to Sophy it doesn\u2019t.\u201d<\/p>\n<p>In adding a layer of complexity to \u201cWind and Waves from the East Sea,\u201d Chung brought in the second half of her two-person musical group, <a href=\"https:\/\/www.youtube.com\/playlist?list=PLVhQwBgTK_COlqTpz4i01eI-ucnokWq5f\">2SO<\/a>, to perform it as a four-hands concerto \u2013 one person playing the wave data on one side of the keyboard, the other playing the wind data on the other end, James says.<\/p>\n<p>\u201cScientifically and physically, it makes sense because the wind is what\u2019s causing the waves so there\u2019s a direct connection and we thought that would be an interesting combination to do,\u201d James says. \u201cThat one, I think, was the hardest because there were a lot of moving parts to arrange.\u201d<\/p>\n<p>Chung performed the songs, along with selections from composers Anton Arensky and Claude Debussy, during a concert carrying the same name as the project, <a href=\"https:\/\/blog.naver.com\/sopianistofficial\/222906833446\">Harmony of Nature<\/a>, in Seoul on Nov. 13. It\u2019s the first of what the two hope will be a continued collaboration.<\/p>\n<p>\u201cGoing forward, we want to explore more with different key signatures or how we decide the starting reference point. These statistical interpretations lent themselves well to it,\u201d James says.<\/p>\n<p>With historical and future data in endless supply, James says there are myriad directions the pair can go as they continue to create. They plan to apply for additional funding from the Arts Council Korea and bring in more collaborators, including another scientist and more instrumentation, to develop longer and more complex compositions, James says. A focus on oceanographic phenomena also is likely.<\/p>\n<p>James says that in addition to oceanography research, she\u2019s <a href=\"https:\/\/sites.google.com\/uconn.edu\/mollymjames\/scicomm\">professionally passionate about science communication<\/a>, and this project \u2013 even without words \u2013 does just that.<\/p>\n<p>\u201cThe focus of this work and what we do in the future is about getting people to feel more connected to their natural environment,\u201d James says. \u201cWe want people who hear these songs and say to themselves, \u2018Oh, I\u2019ve been there\u2019 or \u2018My aunt lives there,\u2019 and have them connect to the music and to the data.\u201d<\/p>\n<p>Listen to the professional recordings on <a href=\"https:\/\/music.apple.com\/us\/album\/harmony-of-nature-ep\/1654851971\">Apple Music<\/a>, <a href=\"https:\/\/open.spotify.com\/album\/20kqqqfI2vMzPy6vkspPhe\">Spotify<\/a>, or <a href=\"https:\/\/music.amazon.com\/albums\/B0BMQ532MJ\">Amazon Music<\/a>.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>&#8216;Looking at graphs is not something that\u2019s intuitive for most people, but music is a way that you can communicate something&#8217; <\/p>\n","protected":false},"author":160,"featured_media":192614,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_crdt_document":"","wds_primary_category":0,"wds_primary_series":0,"wds_primary_attribution":0,"footnotes":""},"categories":[1711,2226,2466,156,2387,1875,2235,173],"tags":[],"magazine-issues":[],"coauthors":[2368],"class_list":["post-192609","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-arts-culture","category-clas","category-marine-sciences","category-profile","category-sustainability","category-grad-school","category-today-homepage","category-uconn-avery-point"],"pp_statuses_selecting_workflow":false,"pp_workflow_action":"current","pp_status_selection":"publish","acf":[],"publishpress_future_action":{"enabled":false,"date":"2026-04-14 05:28:09","action":"change-status","newStatus":"draft","terms":[],"taxonomy":"category","extraData":[]},"publishpress_future_workflow_manual_trigger":{"enabledWorkflows":[]},"_links":{"self":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts\/192609","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/users\/160"}],"replies":[{"embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/comments?post=192609"}],"version-history":[{"count":9,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts\/192609\/revisions"}],"predecessor-version":[{"id":192874,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/posts\/192609\/revisions\/192874"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/media\/192614"}],"wp:attachment":[{"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/media?parent=192609"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/categories?post=192609"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/tags?post=192609"},{"taxonomy":"magazine-issue","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/magazine-issues?post=192609"},{"taxonomy":"author","embeddable":true,"href":"https:\/\/today.uconn.edu\/wp-rest\/wp\/v2\/coauthors?post=192609"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}