{"id":391,"date":"2016-12-13T12:33:48","date_gmt":"2016-12-13T18:33:48","guid":{"rendered":"http:\/\/ericlambert.net\/blog\/?p=391"},"modified":"2016-12-13T12:33:48","modified_gmt":"2016-12-13T18:33:48","slug":"the-augmented-world-legal-and-privacy-perspectives-on-augmented-reality","status":"publish","type":"post","link":"https:\/\/ericlambert.net\/blog\/2016\/12\/13\/the-augmented-world-legal-and-privacy-perspectives-on-augmented-reality\/","title":{"rendered":"The Augmented World &#8212; Legal and Privacy Perspectives on Augmented Reality (AR)"},"content":{"rendered":"<p>You&#8217;ve likely heard that\u00a0Augmented Reality (AR) is the next technology that will transform our lives. You may not realize that AR has been here for years. You&#8217;ve seen it on NFL broadcasts when the first down line and down\/yardage appear on the screen under players&#8217; feet. You&#8217;ve seen it in\u00a0the Haunted Mansion ride in Disneyland when ghosts seem to appear in the mirror riding with you in your cart. You&#8217;ve seen it in cars and fighter jets when speed and other data is superimposed onto the windshield through a heads-up display. You&#8217;re seeing it in the explosion of Pok\u00e9mon\u00a0Go around the world.\u00a0AR\u00a0will affect all sectors, much as the World Wide Web did in the mid-1990s.\u00a0Any new technology such as AR brings with it questions on <em>how<\/em> it fits under the umbrella of existing legal and privacy laws, <em>where<\/em> it pushes the boundaries and requires adjustments to the size and shape of the legal and regulatory umbrella, and <em>when<\/em>\u00a0a new technology leads to a fundamental shift in\u00a0certain areas of law. This article will define augmented reality and the augmented world, and analyze its impact on the legal and privacy landscape.<\/p>\n<h1><strong>What is &#8220;augmented reality&#8221; and the &#8220;augmented world?&#8221;<\/strong><\/h1>\n<p>One of the hallmarks\u00a0of an\u00a0emerging technology is that it is not easily defined.\u00a0Similar to the &#8220;<a href=\"http:\/\/ericlambert.net\/blog\/fourth-age-of-the-internet\/\" target=\"_blank\" rel=\"noopener nofollow\">Internet of Things<\/a>,&#8221; AR means different things to different people, can exist as a group of related technologies instead of a single technology, and is still developing.\u00a0However, there are certain common elements among existing\u00a0AR technologies\u00a0from which a basic definition can be distilled.<\/p>\n<p>I would define &#8220;<em><strong>augmented reality<\/strong><\/em>&#8221; as &#8220;<strong>a process, technology, or device that presents a\u00a0user with real-world information, commonly but not limited to audiovisual imagery,\u00a0<\/strong><em><strong>augmented<\/strong><\/em><strong> with additional contextual data elements layered on top of\u00a0the real-world information, by (1)\u00a0collecting\u00a0real-world audiovisual imagery, properties, and other data; (2) processing the real-world data via remote servers to identify elements, such as real-world objects, to augment with supplemental contextual data;\u00a0and (3) presenting\u00a0in real time\u00a0supplemental\u00a0contextual data overlaid on the real-world data.<\/strong>&#8221;\u00a0The real world as augmented through various AR systems and platforms can be referred to as the &#8220;<em><strong>augmented world<\/strong><\/em>.&#8221;\u00a0AR and the augmented world differs from &#8220;virtual reality&#8221; (VR) systems and platforms, such as the Oculus Rift and Google Cardboard, in that VR <em><strong>replaces<\/strong><\/em> the user&#8217;s view of the real world\u00a0with\u00a0a wholly digitally-created virtual world,\u00a0where AR <em><strong>augments<\/strong><\/em> the user&#8217;s view of the real world with additional digital data.<\/p>\n<p>&#8220;Passive&#8221; AR (what I call &#8220;first-generation AR&#8221;) is a fixed system &#8212; you receive augmented information but do not do so interactively, such as going through the Haunted Mansion ride or watching your television set.\u00a0The next generation of AR is &#8220;active,&#8221; meaning that AR will be delivered in a changing environment, and the augmented world will be viewed, through a device you carry or wear.\u00a0Google Glass and the forthcoming Microsoft HoloLens are examples of &#8220;active AR&#8221;\u00a0systems with dedicated hardware; when\u00a0worn,\u00a0the world is augmented with digital data superimposed on the real-time view of the world.\u00a0However, AR has found ways to use existing hardware &#8212; your smartphone.\u00a0HP&#8217;s Aurasma platform is an early example of an active AR system that uses your smartphone&#8217;s camera and screen to\u00a0create digital content superimposed on the real world. What AR has needed to go fully mainstream was a killer app that found a way for AR to appeal to the masses, and it now has one &#8212; Pok\u00e9mon\u00a0Go.\u00a0Within days of\u00a0its launch in early July, <a href=\"http:\/\/techcrunch.com\/2016\/07\/13\/pokemon-go-tops-twitters-daily-users-sees-more-engagement-than-facebook\/\" target=\"_blank\" rel=\"noopener nofollow\">TechCrunch reported<\/a> that Pok\u00e9mon\u00a0Go had an average daily user base of over <strong>20 million users<\/strong>.\u00a0Some declared it the biggest &#8220;stealth health&#8221; app of all time as it was getting users out and walking.<\/p>\n<p>Active AR has the capacity to change how people interact with the world, and with each other. It is\u00a0an immersive and engaging user experience. It has the capacity to change the worlds of shopping, education and training, law enforcement, maintenance, healthcare, and gaming, and others. Consider an AR system that shows reviews, product data, and comparative prices while looking at a shelf display; identifies an object or person approaching you\u00a0and makes it glow, flash, or otherwise stand out\u00a0to give you more time to avoid a collision;\u00a0gives you information on an artist, or the ability to hear or see commentary, while looking at a painting or sculpture; identifies to a police officer in real time whether a weapon brandished by a suspect is real or fake; or shows you in real time\u00a0how to\u00a0repair a household item (or how to administer emergency aid) through images placed on that item or on a stricken individual.\u00a0For some, the augmented world\u00a0will be life-altering, such as a headset as assistive technology which reads road signs aloud to a blind person or announces that a vehicle is coming (and how far away it is) when the user looks in the vehicle&#8217;s direction.\u00a0For others, the ability to collect, process and augment real-world data in real time could be viewed\u00a0as a further invasion of privacy, or worse, technology that could be used for illegal or immoral purposes.<\/p>\n<p>As\u00a0with any new technology, there will be\u00a0challenges from a legal and digital perspective. A well-known\u00a0example of this is\u00a0the Internet when the World Wide Web became mainstream in the mid-1990s.\u00a0In some cases, existing laws were interpreted to apply to the online\u00a0world, such as the application of libel and slander to online statements, the application of intellectual property laws to file sharing over peer-to-peer networks, and the application of contract law to online terms of use. In others, new laws such as the Digital Millennium Copyright Act were enacted to address shortcomings of the existing legal and regulatory landscape with respect to the online world. In some instances, the new technology led to a fundamental shift in\u00a0a particular area\u00a0of law, such as how privacy works in an online\u00a0world and how to address online identity theft and breaches of personal information. AR&#8217;s collection of data, and presentation of augmented data in real time, creates similar challenges that will need to be addressed. Here are some of the legal and privacy challenges raised by AR.<\/p>\n<ul>\n<li><em><strong>Rethinking a &#8220;reasonable expectation of privacy.&#8221;<\/strong><\/em>\u00a0A core privacy principle under US law is that persons have a <em>reasonable expectation of privacy<\/em>, i.e.,\u00a0a person can be held liable for unreasonably intruding on another&#8217;s interest in keeping his\/her personal affairs private.\u00a0However,\u00a0what is a &#8220;reasonable expectation of privacy&#8221; in a GoPro world? CCTV\/surveillance cameras, wearable cameras, and\u00a0smart devices already collect\u00a0more information about people\u00a0than ever before.\u00a0AR technology will continue this trend.\u00a0As more and more information is collected, what keeping &#8220;personal affairs private&#8221; looks like will continue to evolve.\u00a0If you know someone is wearing an AR device,\u00a0and still do or say something you intend to keep private, do you\u00a0still have a reasonable expectation of privacy?<\/li>\n<\/ul>\n<blockquote><p><em><strong>What is a &#8220;reasonable expectation of privacy&#8221; in a GoPro world?<\/strong><\/em><\/p>\n<p>&nbsp;<\/p><\/blockquote>\n<ul>\n<li><em><strong>Existing Privacy Principles.<\/strong><\/em> Principles of notice, choice, and\u00a0&#8220;privacy by design&#8221; apply to AR systems.\u00a0Providers of AR systems must\u00a0apply the same privacy principles to AR as they do to the\u00a0collection of\u00a0information through any other method.\u00a0Users should be given notice of what information will be collected through the AR system, how long it will be kept, and how it will be used. Providers should collect only information needed for the\u00a0business purpose, store and dispose of it securely, and keep it only as long as needed.<\/li>\n<\/ul>\n<p style=\"padding-left: 30px;\">AR systems add an additional level of complexity &#8212; they are collecting information not just about the user, but also\u00a0third parties. Unlike a cellphone camera, where the act of collecting information from third parties is initiated by the user, an AR system may collect information about third parties as part of its fundamental design. Privacy options for third parties should be an important consideration in, and element of, any AR system.\u00a0For example, an AR system provider could\u00a0ensure users have the ability to toggle\u00a0the blocking of third party personal data from being\u00a0collected or augmented, so personal\u00a0information is only augmented when the user wants it to be.\u00a0AR system providers may also consider an indicator on the outside of the device, such as an LED, to let third parties know that the AR system is actively collecting information.<\/p>\n<p style=\"padding-left: 30px;\">Additionally, AR may create interesting issues from a free speech and recording of communications perspective.\u00a0Some, but not all, court rulings have held that the freedom of speech guaranteed by the First Amendment extends to\u00a0making recordings of matters of public interest.\u00a0An AR system that is always collecting data will push the boundaries of this doctrine.\u00a0Even if something is not in the public interest, many states require the consent of both parties to record a conversation between them.\u00a0An AR system which persistently collects data, including conversations, may run afoul of these laws.<\/p>\n<ul>\n<li><em><strong>Children&#8217;s Privacy.<\/strong><\/em><strong>\u00a0<\/strong>It is worth a special note that AR creates an especially difficult challenge for children&#8217;s privacy, especially children\u00a0under 13.\u00a0The Children&#8217;s Online Privacy Protection Act (&#8220;COPPA&#8221;) requires operators of online services, including mobile apps, to obtain verifiable parental consent before collecting any personal information from children under 13. &#8220;Personal information&#8221; includes\u00a0photos, videos, and audio of a child\u2019s image or voice.\u00a0As AR systems collect and process data in real time, the passive collection of a child&#8217;s image or voice (versus collection of children&#8217;s personal information provided to a company through an interface such as a web browser) is problematic under COPPA.\u00a0AR operators will need to determine how\u00a0to ensure they are not collecting\u00a0personal information from children under 13.\u00a0I expect the FTC will amend the COPPA FAQ to\u00a0clarify their position on the\u00a0intersection of AR and children&#8217;s privacy.<\/li>\n<\/ul>\n<ul>\n<li><em><strong>Intellectual Property.<\/strong> <\/em>\u00a0Aside from the inevitable patent wars that will occur over the early inventors of AR technologies, and patent holders who believe their patent claims cover certain aspects of AR technologies, AR will create some potentially interesting\u00a0issues under intellectual property law.\u00a0For example, an AR system that records (and stores) everything it sees will invariably capture some things that are protected by copyright or other IP laws.\u00a0Will &#8220;fair use&#8221; be expanded in the augmented world, e.g., where an album cover is displayed to a user when a song from that is heard? Further, adding content to a copyrighted work in the augmented world may constitute a prohibited derivative work.\u00a0From a trademark perspective, augmenting a common-law or registered trademark with additional data, or using a competitor&#8217;s name or logo to\u00a0trigger an ad about your\u00a0product overlaid on the competitor&#8217;s name or logo,\u00a0could create issues\u00a0under existing trademark law.<\/li>\n<\/ul>\n<ul>\n<li><em><strong>Discrimination.<\/strong><\/em>\u00a0\u00a0AR systems make it easy to supplement\u00a0real-world information by\u00a0providing additional detail on a person, place or thing in real time. This supplemental data could intentionally or inadvertently be used to make\u00a0real-time discriminatory decisions, e.g., using facial or name recognition to provide supplemental data about a person&#8217;s arrest history,\u00a0status in a protected class, or other restricted information\u00a0which is used in a\u00a0hiring or rental decision. An AR system that may be used in a situation where data must be excluded from the decision-making process\u00a0must include\u00a0the ability to automatically exclude groups of data from the user&#8217;s augmented world.<\/li>\n<\/ul>\n<ul>\n<li><em><strong>Digital Marketing and Advertising. <\/strong><\/em>\u00a0The FTC has already stated that <a href=\"http:\/\/www.ftc.gov\/news-events\/media-resources\/truth-advertising\" target=\"_blank\" rel=\"noopener nofollow\">truth-in-advertising standards apply to the online\u00a0world just as they apply to the real world<\/a>.\u00a0The same standards will also apply to the augmented world. Augmented content, and the view of a product or other content through the augmented world, must be truthful and not misleading, must contain required disclaimers, etc.<\/li>\n<\/ul>\n<p style=\"padding-left: 30px;\">The world of online digital marketing and advertising will expand to include digital marketing and advertising in the augmented world.\u00a0Imagine a world where anything &#8212; and I mean <strong>anything<\/strong> &#8212; can be turned into a billboard or advertisement in real time.\u00a0Contextual ads in the augmented world can be superimposed anytime a user sees a keyword.\u00a0For example,\u00a0if you see a house, imagine if an ad for a brand of paint appears because the paint manufacturer has bought contextual augmented ads to appear in an AR system whenever the user sees a house through the augmented world.<\/p>\n<p style=\"padding-left: 30px;\">Existing laws will need to be applied to digital marketing and advertising in the augmented world.\u00a0For example, when a marketing disclaimer appears in the online world, the user&#8217;s attention is on the ad.\u00a0Will the disclaimer have the same effect in an augmented environment, or will it need to be\u00a0presented in a way that calls attention to it?\u00a0Could this have the unintended consequence of shifting the user&#8217;s attention away from something they are doing, such as walking, thereby increasing the risk of harm?\u00a0There are also some interesting theoretical advertising applications of AR in a negative context.\u00a0For example, &#8220;negative advertising&#8221; could be used to blur product or brand names and\/or to make others more prominent in the augmented world.<\/p>\n<ul>\n<li><em><strong>The Right of Publicity.<\/strong><\/em>\u00a0\u00a0The right of publicity &#8212;\u00a0a person&#8217;s\u00a0right\u00a0to control the commercial use of his or her name, image, and likeness &#8212; is also likely to be challenged by digital marketing in the augmented world.\u00a0Instead of actively using a person&#8217;s likeness to promote a product or service, a product or service could appear as augmented data next to a person&#8217;s name or likeness, improperly (and perhaps inadvertently) implying an endorsement or association.\u00a0State\u00a0laws governing the right of publicity will be\u00a0reinterpreted when applied to\u00a0the augmented world.<\/li>\n<\/ul>\n<ul>\n<li><em><strong>Negligence and Torts.<\/strong><\/em>\u00a0AR has the capacity to both further exacerbate the problem of &#8220;distracted everything,&#8221; paying more attention to your AR device than your surroundings, as <a href=\"http:\/\/www.washingtonpost.com\/news\/the-switch\/wp\/2016\/07\/08\/pokemon-gos-unexpected-side-effect-injuries\/\" target=\"_blank\" rel=\"noopener nofollow\">some users of Pok\u00e9mon Go have discovered<\/a>. Since AR augments the real world in real time, the additional information may cause a user to be distracted, or if the augmented data is erroneous could cause a user to cause harm to him\/herself or to others. Many have heard the stories of a\u00a0person <a href=\"http:\/\/bgr.com\/2016\/05\/17\/car-gps-mapping-directions-lake\/\" target=\"_blank\" rel=\"noopener nofollow\">dutifully following their GPS navigation system into a lake<\/a>.\u00a0Imagine an AR system identifying\u00a0a mushroom as\u00a0safe to eat when in fact it is highly poisonous. Just as\u00a0distracted driving and distracted texting can be used as evidence of negligence, a distracted AR user can find him\/herself facing a negligence claim\u00a0for\u00a0causing third party harm.\u00a0Similarly, many tort claims that can arise through actions in the real world or online world, such as liable and slander, can occur in the augmented world.\u00a0Additionally, if an AR system augments the real world in a way that makes someone think they are in danger, inflicts emotional distress, or causes something to become dangerous, the AR user, or system provider, could be legally responsible.<\/li>\n<\/ul>\n<ul>\n<li><em><strong>Contract liability<\/strong><\/em><strong>.<\/strong>\u00a0We will undoubtedly see providers\u00a0of AR systems and platforms sued for damages suffered by their users.\u00a0AR providers have and will shift liability to the user through contract terms.\u00a0For example, Niantic, the company behind Pok\u00e9mon Go, states in their Terms of Use that you must &#8220;be aware of your surroundings and play safely. You agree that your use of the App and play of the game is at your own risk, and it is your responsibility to maintain such health, liability, hazard, personal injury, medical, life, and other insurance policies as you deem reasonably necessary for any injuries that you may incur while using the Services.&#8221; AR providers&#8217;\u00a0success at shifting liability will likely fall primarily to tried-and-tested principles such as whether\u00a0an enforceable contract exists.<\/li>\n<\/ul>\n<p>None of the above challenges are likely to prove insurmountable and are not expected to slow the significant growth of AR.\u00a0What will be interesting to watch is how lawmakers\u00a0choose to respond to AR, and how\u00a0early hiccups are seized on by politicians and reported in the press. Consider automobile autopilot technology. The recent crash of a Tesla in Autopilot mode is providing bad press for Tesla, and fodder for those who believe the technology is dangerous and must be curtailed. Every new technology brings both benefits and potential risks.\u00a0If the benefits outweigh the risks on the whole, the public interest is not served when the legal, regulatory and privacy pendulum swings too far in response.\u00a0Creating a legal, regulatory and privacy landscape\u00a0that fosters the growth of AR, while appropriately addressing the risks AR creates and exacerbates, is critical.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>You&#8217;ve likely heard that\u00a0Augmented Reality (AR) is the next technology that will transform our lives. You may not realize that AR has been here for years. You&#8217;ve seen it on NFL broadcasts when the first down line and down\/yardage appear &hellip; <a href=\"https:\/\/ericlambert.net\/blog\/2016\/12\/13\/the-augmented-world-legal-and-privacy-perspectives-on-augmented-reality\/\">Continue reading <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4,8,12],"tags":[23,28,141,188,190],"class_list":["post-391","post","type-post","status-publish","format-standard","hentry","category-legal","category-nonlegal","category-technology","tag-ar","tag-augmented-reality","tag-privacy","tag-virtual-reality","tag-vr"],"_links":{"self":[{"href":"https:\/\/ericlambert.net\/blog\/wp-json\/wp\/v2\/posts\/391","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/ericlambert.net\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/ericlambert.net\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/ericlambert.net\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/ericlambert.net\/blog\/wp-json\/wp\/v2\/comments?post=391"}],"version-history":[{"count":0,"href":"https:\/\/ericlambert.net\/blog\/wp-json\/wp\/v2\/posts\/391\/revisions"}],"wp:attachment":[{"href":"https:\/\/ericlambert.net\/blog\/wp-json\/wp\/v2\/media?parent=391"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/ericlambert.net\/blog\/wp-json\/wp\/v2\/categories?post=391"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/ericlambert.net\/blog\/wp-json\/wp\/v2\/tags?post=391"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}