{"id":515,"date":"2023-11-01T03:41:10","date_gmt":"2023-11-01T03:41:10","guid":{"rendered":"https:\/\/golancourses.net\/fall23\/?page_id=515"},"modified":"2023-11-01T22:52:47","modified_gmt":"2023-11-01T22:52:47","slug":"08-situated-eye","status":"publish","type":"page","link":"https:\/\/golancourses.net\/fall23\/deliverables\/08-situated-eye\/","title":{"rendered":"08. Situated Eye"},"content":{"rendered":"<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-large wp-image-522\" src=\"https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/11\/jeremijenko_suicidebox_842x725-1024x882.jpg\" alt=\"\" width=\"840\" height=\"724\" srcset=\"https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/11\/jeremijenko_suicidebox_842x725-1024x882.jpg 1024w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/11\/jeremijenko_suicidebox_842x725-300x258.jpg 300w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/11\/jeremijenko_suicidebox_842x725-768x661.jpg 768w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/11\/jeremijenko_suicidebox_842x725-1536x1323.jpg 1536w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/11\/jeremijenko_suicidebox_842x725-2048x1763.jpg 2048w, https:\/\/golancourses.net\/fall23\/wp-content\/uploads\/2023\/11\/jeremijenko_suicidebox_842x725-1200x1033.jpg 1200w\" sizes=\"auto, (max-width: 709px) 85vw, (max-width: 909px) 67vw, (max-width: 1362px) 62vw, 840px\" \/><\/p>\n<p><em>Create a machine that asks a question of the world. Your machine should either measure\/detect something interesting, measure\/detect something in an interesting way, or create an interesting provocation by bringing an uncommon measurement\/detection to our attention. The focus here is on the selection and collection of intriguing data, rather than on the production of an attractive interpretation or visualization. What overlooked dynamics or invisible rhythms can you discover?<\/em><\/p>\n<p>In this <em>speed project<\/em>, you are asked to create a &#8220;<strong>situated eye<\/strong>&#8221; &#8211; a &#8220;<strong>contextualized classifier<\/strong>&#8221; &#8211; a &#8220;<strong>purposeful detector<\/strong>&#8221; &#8211; a &#8220;<strong>poetic surveillant<\/strong>&#8220;. You are asked to create a camera-based system:<\/p>\n<ul>\n<li>which is located in a specific place;<\/li>\n<li>which is\u00a0<em>trained<\/em>\u00a0to detect a specific thing (or things);<\/li>\n<li><del>and which\u00a0<em>responds<\/em> to what it sees, in an interesting way.<\/del> (<strong>NOPE<\/strong>)<\/li>\n<\/ul>\n<p><span style=\"color: #993300;\"><strong>This is a speed project, due Monday 11\/6.<\/strong><\/span> The project values your inventiveness about <em>where you point your camera<\/em>, your cleverness in <em>choosing a subject on which to train an AI system<\/em>, and your care in <em>actually training the AI system<\/em>. Although you will be working in p5.js, <strong>almost no code is required or expected.<\/strong><\/p>\n<hr \/>\n<h3>Who, What, When, Where, Why<\/h3>\n<p><strong><em>What is an interesting subject to study<\/em> with a video camera?<\/strong><br \/>\n<strong>For this subject, what are some interesting <em>observations you can automate<\/em>?<br \/>\n<em>How might a system respond<\/em> in an interesting way to these observations?<\/strong><\/p>\n<p>You will be provided a webcam, and potentially a tripod and\/or USB extension cable.<\/p>\n<ul>\n<li>You are asked to<strong> \u2014 <span style=\"text-decoration: underline;\">choose a subject<\/span>,<\/strong> i.e., point the camera at something\/someplace\/someone interesting. Your system might respond to trees, machines, vehicles, places, animals. You can point your camera at people, but it is understood that <em>you will not violate anyone&#8217;s privacy<\/em>.<\/li>\n<li>You are asked to<strong> \u2014 <span style=\"text-decoration: underline;\">train a neural network to analyze your subject<\/span>.<\/strong> You can train a <em>classifier<\/em> (to recognize certain discrete patterns), or a <em>regressor<\/em> (to measure your subject along a continuum). You will actually train a real system. Although you will work in p5.js, there is no software deliverable expected (e.g. no OpenProcessing sketch to submit).<\/li>\n<li>You are asked to \u2014 <strong><span style=\"text-decoration: underline;\">document your neural network doing its job<\/span>,<\/strong> successfully classifying or measuring your subject. Your document can take the form of a video or animated GIF.<\/li>\n<li>You are asked to \u2014 <span style=\"text-decoration: underline;\"><em><strong>speculatively<\/strong> <\/em><strong><em>describe<\/em> a custom app<\/strong><\/span> that would respond to these measurements or classifications.\u00a0 You don&#8217;t actually have to make the software\u2014but it should be possible for you to do so in theory. Your description will take the form of a 100-150 word written Discord post in the <em>#situated-eye<\/em> channel. Your post should include your video\/GIF documentation.<\/li>\n<\/ul>\n<p><em><strong>Here&#8217;s a dumb example\u2014you can do better:<\/strong><\/em> Put the camera in your fridge. Train it to recognize when the fridge is open and closed. Perhaps you can train it to recognize the face of which roommate is opening the fridge. Use this system to create a system that records which of your roommates opened the fridge, when. <em><strong>Other examples:<\/strong> Cheese<\/em> by Christian Moeller; <em>Suicide Box<\/em> by Natalie Jeremijenko.<\/p>\n<hr \/>\n<h3>Design Considerations<\/h3>\n<ul>\n<li><strong><em>Escape the physical context of the laptop.<\/em><\/strong> Don&#8217;t limit yourself to the physical constraints of your laptop&#8217;s webcam, and the implicit assumptions it imposes on where a camera can be (on a table, in a room, at waist height, with a level pitch).\u00a0Give extremely careful consideration to <em>where<\/em> your camera is located, and\/or what it observes. Is your camera on a building? In a refrigerator? Above a pet dish? Part of a microscope? Pointed at the sky, or at the floor? Looking at custom cardboard game pieces on a table?<\/li>\n<li><strong><em>When describing your speculative system,<\/em><\/strong> remember that your system might respond in real-time (like a game, etc.), or it might serve as a system for recording, logging, or counting what it observes. Keep in mind that you can save files (data, images) to disk. Your system might respond audiovisually (i.e. with graphics and\/or sound), and\/or it might send a signal over the internet.<\/li>\n<\/ul>\n<hr \/>\n<h3>Template Code<\/h3>\n<p>Demonstrations of the following AI systems will be given in class. It is strongly recommended you use one of these.<\/p>\n<p><strong>Classification:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/2065809\">p5 + Categorization of Pose Data (Rock\/Paper\/Scissors)<\/a>\u00a0(ML5 v.20)<\/li>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/2066299\">p5 + TeachableMachine: Classification of Image Data<\/a>\u00a0(ML5 v.0.12)<\/li>\n<\/ul>\n<p><strong>Regression:<\/strong><\/p>\n<ul>\n<li><a href=\"https:\/\/editor.p5js.org\/golan\/sketches\/dpzEzaapt\">p5 + ML:\u00a0<em>Very Simple<\/em>\u00a0Regression<\/a>\u00a0(ML5 v.20)<\/li>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/2069567\">p5 + Pose Data Regression<\/a>\u00a0(ML5 v.20)<\/li>\n<li><a href=\"https:\/\/openprocessing.org\/sketch\/2066017\">p5 + Image Regression<\/a>\u00a0(ML5 v.0.12)<\/li>\n<\/ul>\n<hr \/>\n<h3>Thoughts<\/h3>\n<p>Census historian James C. Scott points out that measurement is a political act. Artists like Natalie Jeremijenko collect measurements in order to prompt evidence-driven discussion; others, like Mimi Onuoha, point out that what is not measured is equally revealing of a culture\u2019s biases and indifferences (the study of which is called <em>agnotology<\/em>). In the weird world of quantum physics, the term \u201cobserver effect\u201d refers to the idea that the very act of measurement changes the subject being measured. Measurement, or the collection of data, alters the world and the way we see it.<\/p>\n<p>Data collection has become a key practice across many fields. \u201cCitizen science\u201d is an educational and political movement that enlists everyday people in scientific activities and often focuses on monitoring local environmental conditions through distributed DIY sensing. For example, in the aftermath of the Fukushima disaster, radiation sensors were distributed to a concerned public, who transmitted readings to a central server.<\/p>\n<p>Scholars Catherine D\u2019Ignazio and Lauren Klein outline ways to responsibly work with data, taking philosophical ideas from feminist thought and applying them to data collection and visualization practices. The principles of feminist data visualization include acknowledging that data represents an incomplete perspective; emphasizing the context and the situation in which data was collected; and providing a way for those represented in the data to respond to it.<\/p>\n<p>There is often something absurd, poignant, or whimsically futile about the act of measurement \u2014an attempt to reduce an infinitely complex experience to a handful of numbers. In the arts, measurement can explicitly remind us that our understanding of reality is only ever an approximation.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Create a machine that asks a question of the world. Your machine should either measure\/detect something interesting, measure\/detect something in an interesting way, or create an interesting provocation by bringing an uncommon measurement\/detection to our attention. The focus here is on the selection and collection of intriguing data, rather than on the production of an &hellip; <a href=\"https:\/\/golancourses.net\/fall23\/deliverables\/08-situated-eye\/\" class=\"more-link\">Continue reading<span class=\"screen-reader-text\"> &#8220;08. Situated Eye&#8221;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"parent":10,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-515","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages\/515","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/comments?post=515"}],"version-history":[{"count":10,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages\/515\/revisions"}],"predecessor-version":[{"id":529,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages\/515\/revisions\/529"}],"up":[{"embeddable":true,"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/pages\/10"}],"wp:attachment":[{"href":"https:\/\/golancourses.net\/fall23\/wp-json\/wp\/v2\/media?parent=515"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}