{"id":440,"date":"2023-10-23T17:21:31","date_gmt":"2023-10-23T17:21:31","guid":{"rendered":"https:\/\/golancourses.net\/fall23\/?page_id=440"},"modified":"2023-10-30T05:11:30","modified_gmt":"2023-10-30T05:11:30","slug":"07-gesture-expander","status":"publish","type":"page","link":"https:\/\/golancourses.net\/fall23\/deliverables\/07-gesture-expander\/","title":{"rendered":"07. Gesture Expander"},"content":{"rendered":"<p>There are two components, <strong>due Wednesday 11\/1<\/strong> (Revised Deadline).<\/p>\n<ul>\n<li>Readings\/Viewings (1 hour)<\/li>\n<li>Interactive Gesture Expander (11 hours)<\/li>\n<\/ul>\n<hr \/>\n<h3>Readings\/Viewings<\/h3>\n<p>(45-60 minutes) Please watch\/read the following media. This should take under an hour:<\/p>\n<ul>\n<li>Zach Lieberman,\u00a0<a href=\"https:\/\/zachlieberman.medium.com\/m%C3%A1s-que-la-cara-overview-48331a0202c0\"><em>M\u00e1s Que La Cara Overview<\/em><\/a>\u00a0(~12 minute read)<\/li>\n<li>Last Week Tonight:\u00a0<a href=\"https:\/\/www.youtube.com\/watch?v=jZjmlJPJgug\"><em>Face Recognition<\/em><\/a>\u00a0(21 minutes)<\/li>\n<li>Joy Buolamwini:\u00a0<em><a href=\"https:\/\/www.youtube.com\/watch?v=UG_X_7g63rY\">How I\u2019m fighting bias in algorithms<\/a><\/em>\u00a0(9 minutes)<\/li>\n<\/ul>\n<p>In a brief Discord post in the <em>#face-viewings<\/em> channel, jot down an idea, fact, claim, or image that you came across in any of the above media that struck you. <strong>Write<\/strong> a sentence about why you found it interesting.<\/p>\n<hr \/>\n<h3>Interactive Gesture Expander<\/h3>\n<ul>\n<li><b>Choice A: <\/b><em>Costume\/Puppet<\/em><b>. An accompanying <em>performance<\/em> video is 40% of the grade.<\/b><\/li>\n<li><strong>Choice B:<\/strong> <em>Something other than a costume or puppet<\/em>. <strong>An accompanying <em>demonstration<\/em> video is 20% of the grade.\u00a0<\/strong><\/li>\n<\/ul>\n<p><strong>(11 hours, due Wednesday 11\/1, a revised deadline)<\/strong> For this project, you are asked to make and document software which creatively interprets, uses, or responds to the <strong>actions and gestures<\/strong> of the body. In other words: develop an interesting treatment of real-time data captured (with a camera) from a person\u2019s face, hands, or other body parts.<\/p>\n<p>Consider whether your treatment is a kind of entertainment, or whether it serves a ritual purpose, a practical purpose, or operates to some other end. You can create a game. Your project may be a musical instrument, or a drawing tool. It could be an abstract visual composition. It could be a vehicle that allows you to assume a new identity, inhabiting something nonhuman or even inanimate. It could interact with a simulated environment with articulated parts and dynamic behaviors. It may blur the line between self and others, or between self and not-self.<\/p>\n<p>To share your project in documentation, you will record a short video in which you use it. Design your software for a specific \u201cperformance\u201d, and plan your performance with your software in mind; be prepared to explain your creative decisions. Rehearse and record your performance.<\/p>\n<h3><em>Now:\u00a0<\/em><\/h3>\n<ul>\n<li><strong>Create<\/strong> your project using p5.js. Some links to code for template projects are provided below. (<em>Alternatively, if you would prefer to independently teach yourself GLSL shader programming,\u00a0 you may use <a href=\"https:\/\/shaderbooth.com\/\">ShaderBooth<\/a>.<\/em>)<\/li>\n<li><strong>Enact a brief demonstration or performance<\/strong>\u00a0that makes use of your software.\u00a0<em>Be deliberate<\/em>\u00a0about how you perform, demonstrate, or use your software.\u00a0<strong>Consider<\/strong> how your demo-performance should be tailored to your software, and your software should be tailored to your performance. It may help to <strong>write<\/strong> a script for your performance or demo narration.<\/li>\n<li><strong>Document<\/strong> your demo\/performance with a video recording. Store this in an Unlisted (not Private) video on YouTube or Vimeo.\n<ul>\n<li><em>If you create a costume or puppet, your accompanying video should be a recording of a <strong>performance<\/strong>, must be at least 30 seconds long, with sound, and have a beginning, middle, and end; <strong>the video will be 40% of your grade.\u00a0<\/strong><\/em><\/li>\n<li><em>If you create something other than a costume or puppet, your video should be a narrated <strong>documentation<\/strong> that explains what your software is, and how it is used; <strong>the video will be 20% of your grade.\u00a0<\/strong><\/em><\/li>\n<\/ul>\n<\/li>\n<li><strong>Write<\/strong> a post in the <em>#gesture-expander\u00a0<\/em>channel on Discord. Include about 100-150 words that explain and evaluate your project.<\/li>\n<li><b>Include<\/b> at least two screenshots; <strong>embed<\/strong> these in your Discord post.<\/li>\n<li><strong>Link<\/strong> to your demo\/performance video in the Discord post as well.<\/li>\n<\/ul>\n<hr \/>\n<h3>Code Templates<\/h3>\n<p>For this project, we will use the (very) new <strong>ML5-Next-Gen<\/strong> templates for face, body, and hand tracking. I have ported these to OpenProcessing so that you can easily work on your projects there. <em><strong>NOTE:<\/strong><\/em> If you need a template that provides multiple modalities, talk to the professor.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-456\" src=\"https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/10\/op-ml5-demos-1024x367.png\" alt=\"\" width=\"840\" height=\"301\" srcset=\"https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/10\/op-ml5-demos-1024x367.png 1024w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/10\/op-ml5-demos-300x107.png 300w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/10\/op-ml5-demos-768x275.png 768w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/10\/op-ml5-demos-1536x550.png 1536w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/10\/op-ml5-demos-1200x430.png 1200w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/10\/op-ml5-demos.png 1888w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<ul>\n<li><strong>ML5-NextGen Bodypose<\/strong>: <a href=\"https:\/\/openprocessing.org\/sketch\/2059089\">@OpenProcessing.org<\/a> | <a href=\"https:\/\/editor.p5js.org\/ml5\/sketches\/OukJYAJAb\">@Editor.p5js.org<\/a><\/li>\n<li><strong>ML5-NextGen Facemesh<\/strong>: <a href=\"https:\/\/openprocessing.org\/sketch\/2059066\">@OpenProcessing.org<\/a> | <a href=\"https:\/\/editor.p5js.org\/ml5\/sketches\/lCurUW1TT\">@Editor.p5js.org<\/a><\/li>\n<li><strong>ML5-NextGen Handpose<\/strong>: <a href=\"https:\/\/openprocessing.org\/sketch\/2059071\">@OpenProcessing.org<\/a> | <a href=\"https:\/\/editor.p5js.org\/ml5\/sketches\/QGH3dwJ1A\">@Editor.p5js.org<\/a><\/li>\n<\/ul>\n<p><a href=\"https:\/\/openprocessing.org\/sketch\/1503759\"><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-1671\" src=\"https:\/\/courses.ideate.cmu.edu\/60-212\/s2022\/wp-content\/uploads\/2022\/03\/handsfreejs-640x480-1.gif\" alt=\"\" width=\"640\" height=\"480\" \/><\/a><\/p>\n<p><em><strong>Also of possible interest:<\/strong><\/em><\/p>\n<ul>\n<li><strong>Pose<\/strong>, <strong>Hands<\/strong>, or <strong>Face with Metrics<\/strong>: <a href=\"https:\/\/editor.p5js.org\/golan\/sketches\/0yyu6uEwM\">2023 MediaPipe+p5<\/a> (MediaPipe&#8217;s <a href=\"https:\/\/codepen.io\/mediapipe-preview\/pen\/OJBVQJm\">face metrics demo<\/a>)<\/li>\n<li><strong>Face+Hands+Body<\/strong> (<a href=\"https:\/\/openprocessing.org\/sketch\/1503759\">Handsfree 2018+p5<\/a>). Note: Handsfree is very slow to load.<\/li>\n<li><strong>Face+Hands+Body<\/strong> (with Handsfree 2018+p5, <a href=\"https:\/\/editor.p5js.org\/golan\/sketches\/0Sho5V1KY\">Editor<\/a>)<\/li>\n<li><strong><a href=\"https:\/\/editor.p5js.org\/ml5\/sketches\/DNbSiIYKB\">Handpose Parts<\/a> <\/strong>(ML5-NextGen) \u2014 imagine a <a href=\"https:\/\/en.wikipedia.org\/wiki\/Lune_(geometry)\">game<\/a><\/li>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/2065809\"><strong>Gesture Recognition<\/strong><\/a> (Rock-Paper-Scissors with ML5-NextGen)<\/li>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/1847362\">Clown Face template<\/a> (Handsfree 2018)<\/li>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/1846001\">Frog Face template<\/a> (Handsfree 2018)<\/li>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/1845989\">FingerFingerNose template<\/a> (Handsfree 2018)<\/li>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/1845926\">SimpleHandsFaceBody template<\/a> (Handsfree 2018)<\/li>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/1849092\">HandPuppet template<\/a> (Handsfree 2018)<\/li>\n<\/ul>\n<hr \/>\n<h3>Some Creative Opportunities<\/h3>\n<p>The following suggestions, which are by no means comprehensive, are intended to prompt you to appreciate the breadth of the conceptual space you may explore.<\/p>\n<ul>\n<li>You could make a body-controlled game.<\/li>\n<li>You could make a sound-responsive costume.<\/li>\n<li>You could make a creativity tool, like a drawing program.<\/li>\n<li>You may capture more than one person.<\/li>\n<li>You may\u00a0focus on just\u00a0part\u00a0of the body.<\/li>\n<li>You may focus on how an environment is affected by a body.<\/li>\n<li>You may control\u00a0the behavior\u00a0of something\u00a0non-human.<\/li>\n<li>You could make software which is\u00a0analytic.<\/li>\n<li>You could make something altogether unexpected.<\/li>\n<\/ul>\n","protected":false},"excerpt":{"rendered":"<p>There are two components, due Wednesday 11\/1 (Revised Deadline). Readings\/Viewings (1 hour) Interactive Gesture Expander (11 hours) Readings\/Viewings (45-60 minutes) Please watch\/read the following media. This should take under an hour: Zach Lieberman,\u00a0M\u00e1s Que La Cara Overview\u00a0(~12 minute read) Last Week Tonight:\u00a0Face Recognition\u00a0(21 minutes) Joy Buolamwini:\u00a0How I\u2019m fighting bias in algorithms\u00a0(9 minutes) In a brief &hellip; <a href=\"https:\/\/golancourses.net\/fall23\/deliverables\/07-gesture-expander\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;07. Gesture Expander&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":10,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-440","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages\/440","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/comments?post=440"}],"version-history":[{"count":16,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages\/440\/revisions"}],"predecessor-version":[{"id":503,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages\/440\/revisions\/503"}],"up":[{"embeddable":true,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages\/10"}],"wp:attachment":[{"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/media?parent=440"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}