AP Computer Science Principles · Unit 5 lecture · Part 2 of 11 · 7 min

5.1 Unintended uses and responsibilityBuilt for one thing, used for another

Mr. Thompkins
Here's a fun fact with a point: the World Wide Web was built so physicists could share papers. Nobody planned online shopping, memes or video streaming. Innovations escape their creators all the time.

Computing innovations can be used in ways their creators had not originally intended. The CED gives three examples you should know. The World Wide Web was originally intended only for rapid and easy exchange of information within the scientific community. Targeted advertising is used to help businesses, but it can be misused at both the individual and group levels. And machine learning and data mining have enabled innovation in medicine, business and science, but information discovered in this way has also been used to discriminate against groups of individuals.

InnovationWhat it was built forWhat else happened
World Wide WebFast, easy sharing of information among scientists at CERNShopping, social media, news, streaming: almost everything
Targeted advertisingHelping businesses reach likely customersCan be misused on individuals and groups, for example to target the vulnerable
Machine learning and data miningFinding patterns in huge data sets: medicine, business, scienceDiscoveries can be used in ways that harm privacy
GPSNavigation for the U.S. militaryOpened to civilians: maps, ride apps, location tracking
What each innovation was built for, and what else it became.
?Wait, what's machine learning?
Machine learning is a way of building programs that learn patterns from lots of example data instead of following rules a programmer wrote out by hand. Data mining is searching huge data sets for patterns. You met the idea of finding patterns in data in Unit 2; machine learning automates it at enormous scale.

Advances in computing have also generated and increased creativity in other fields, such as medicine, engineering, communications and the arts, and many of those were unintended benefits. Computer-aided design changed architecture. Digital music tools let a teenager record an album in a bedroom.

Scale changes everything. Rapid sharing of a program, or running a program with a very large number of users, can result in significant impacts beyond the intended purpose or control of the programmer. A bug, a privacy hole or a harmful use that touches 50 people is a problem. The same thing touching 5 million people is a news story.

0246810020000400006000080000100000120000days after launchusers102,4003,200
A hypothetical app with 100 users that doubles every day. By day 10 it has over 100,000 users, faster than anyone can study its effects.
?Wait, why does doubling grow so fast?
Each doubling adds as many new users as there already were. After d days, 100 users become 100 × 2ᵈ. That's the same powers of 2 you saw with bits in Unit 2: 10 doublings multiply by 2¹⁰ = 1,024.

So what does a responsible programmer do? Programmers should consider the ways a computing innovation can be used beyond its intended purpose, along with the beneficial and harmful effects of those uses. Nobody can foresee every effect, but asking "how could this be misused?" before launch, and listening to users after launch, catches a lot.

Pause and think
A developer builds a free app for families to share their locations with each other, so parents know kids got home safely. Predict one way it could be used that the developer did not intend.
I thought about it. Show me
Someone could secretly turn on location sharing on another person's phone and track them, for example a controlling partner. The same feature that helps families can be used for stalking. That's why many location apps now send reminders that sharing is on.
Analyze this scenario
A photo-sharing app adds a feature that automatically tags people in photos using face recognition. It spreads to millions of users in a month. Explain how scale and unintended use could turn this convenient feature into a harm.
  1. Intended use: save users time by tagging friends automatically.
  2. Unintended use: anyone could upload a photo of a stranger, taken on a bus or at a protest, and learn who they are.
    Why?
    The feature works the same way no matter who uses it or why. That is exactly how innovations escape their creators.
  3. Scale: with millions of users, the app holds face data on millions of people, including people who never joined but appear in friends' photos.
  4. Conclusion: rapid sharing to a huge number of users means a privacy harm reaches far beyond the developer's control before it can be fixed.
    Why?
    This is the CED sentence about rapid sharing and large numbers of users, applied to a case.

Answer: Convenient tagging can be used to identify strangers, and at the scale of millions of users the face data reaches far beyond anyone the developer intended, including people who never joined.

Stuck? Get a hint
  1. What was the feature built for?
  2. Who else could use the same feature, and for what?
  3. What changes when there are millions of users instead of hundreds?
Check yourself
The World Wide Web is often given as an example of which idea?
  1. AAn innovation used in ways its creators did not originally intend
  2. BAn innovation with no harmful effects
  3. CAn example of the digital divide closing on its own
  4. DSoftware that was never shared beyond one lab
Show the answer

A. The Web was built for fast information sharing among scientists and grew into something its creator never planned. The second choice is false for every real innovation, and the fourth is the opposite of what happened.

Exam tip from Mr. T

If a question asks for an "unintended" effect, check the scenario for what the innovation was built to do. The right answer is a use or result outside that purpose, and it can be good or bad. Unintended does not mean harmful.

  • Innovations are often used in ways their creators never intended: the Web, targeted advertising, machine learning and data mining.
  • Computing has boosted creativity in medicine, engineering, communications and the arts, often unintentionally.
  • Rapid sharing and huge numbers of users can create impacts beyond the programmer's control.
  • Responsible programmers consider unintended uses and their effects, knowing they can't foresee them all.