Menu

Posts tagged “ai”

You have a machine voice

Tom Dart wrote a really interesting piece on how we change our accents when we talk to machines. From Y’all have a Texas accent? Siri (and the world) might be slowly killing it:

“Most people have what we would call a telephone voice, so they actually change away from their local family accent when they’re speaking on the telephone to somebody they don’t know,” said Alan Black, a Scottish computer scientist who is a professor at the Language Technologies Institute at Carnegie Mellon University in Pittsburgh.

They also have a “machine voice”, he said. “People speak to machines differently than how they speak to people. They move into a different register. If you’re standing next to somebody in an airport or at a bus stop or something, you can typically tell when they’re talking to a machine rather than talking to a person.”

This part on the design of Siri is really interesting:

Black speculated that “one of the reasons they designed Siri to be fundamentally a polite, helpful agent who isn’t your friend but works for you, is to encourage people to be somewhat polite and explicit to her, rather than being very colloquial. Because speech recognition is always hard when you drop into colloquialisms.”

The most dangerous thing about self-driving cars

Cliff Kuang makes some interesting points in his essay The Secret UX Issues That Will Make (Or Break) Self-Driving Cars:

Recall that first principle that [Brian Lathrop at Volkswagen] laid out for designing autonomous cars—that the driver has to know whether the car is driving itself. That harks to probably the oldest dictate in interface design; mode confusion causes 90% of airplane crashes, and that insight helped invent the field of human-computer interaction. Think about all the times you’ve heard news reports about a pilot being confused about whether the flaps of the wings were down, or whether to auto-pilot was properly set. If you’ve ever failed to realize that your car was in park when you hit the accelerator, or you’ve ever tried typing into the wrong window on your computer screen, you’ve been a victim of mode confusion.

So, the scariest thing about self-driving cars is not whether or not the car can drive safely, but whether it can effectively communicate when it is driving and when it is not. It’s the age-old Visibility of system status UI heuristic in action.

Automated empathy in healthcare

This is an interesting story on the topic of algorithmic empathy1. In Hospitals Employ Email ‘Empathy’ To Help Doctors And Patients Keep In Touch Barbara Feder Ostrov discusses a program that sends patients automated emails to ask them how they’re doing:

Doctors can send daily emails with information timed to milestones in surgery prep and recovery and ask patients or caregivers for feedback on specific issues patients may face during recovery.

The doctors may write their own email scripts, as Newport Orthopedics’ physicians did, or use the company’s suggested content. An online dashboard helps doctors and administrators keep track of which patients are doing well and who might need more follow-up care. Patients can also communicate with office staff about medications and office visits. Their responses to daily emails can trigger a call from the doctor’s office.

A patient might see this message: “How are you? Let me know so I can make sure you’re okay. I have four questions for you today.”

The program has had some promising results, but I’d be interested to know if patients are aware that the messages are automated. To put it another way, is it ethical for doctors to send automated, health-related messages that look like they’re individually crafted?


  1. See Personal AI assistants: the battle and the war

With self-driving cars cities will need 90% less parking

In An End to Parking? Clive Thompson writes about an aspect of self-driving cars that I haven’t seen before: the impact it will have on urban design. In particular, the amount of space we need for parking should change dramatically:

Robot cars could also drive much more closely to one another, packing far more vehicles onto a street. […]

What’s more, they’d never need to park. At the University of Texas-Austin, Kara Kockelman—a professor of transportation engineering—modeled the impact of autonomous ride-sharing vehicles and found that each one could replace up to a dozen regular cars. The robocars could drive all day long, stopping only to refuel or for maintenance; at night, when there was less demand, they could drive out to a remote parking spot on the outskirts of town. The upshot, Kockelman figures, is that if you shifted the entire city to autonomous cars, it would need a staggering 90 percent less parking than it needs today.

Personal AI assistants: the battle and the war

A friend once told me that for him, one of the weirdest moments as a parent was the realization that their kids have a relationship with each other, not just with him. That conversation always stuck with me, and when our own daughters started to have a bond with each other that’s completely separate from their bond with us, I understood what he meant. It’s just something that is, for some reason, very difficult to wrap one’s head around—these people you made, suddenly having lives apart from you. Today I’m thinking of that conversation again, but in a very different context—personal AI assistants, and what that means for how we design their interfaces.

But before I get there, let me take a step back and recap some of the recent conversations about personal AI. In The internet bundle is already here Dieter Bohn writes that AI personal assistants are a threat to net neutrality:

The bundle is already here, it came from places we haven’t been watching closely enough, and it has many names. There’s more than enough doomsaying about the issues related to Instant Articles, Internet.org, and Binge On. Instead, I’d like to take a minute to doomsay what could become the other opponents to the kind of free, transparent, and open internet we all want: Siri, Cortana, Alexa, Facebook M, and Google Now.

These intelligent assistants are great. I use them every day and expect I will continue to use them for, well, ever. But there’s a problem that’s built into them: they only seem to work with certain parts of the web and — here’s the real rub — certain apps.

Mark Wilson makes a similar argument in Why Every Gadget You Own Suddenly Wants To Talk To You, and then takes the argument further to imagine what happens when you have a bunch of non-neutral devices in your home:

But the problem with a scenario in which you can talk to anything is that you’re no longer talking to one thing. Only so many ears can live in one room. If I muse aloud that I need more shampoo in the shower, what hears me? Is it my iPhone sitting at the sink? Alexa networked in my apartment? Some new smart water nozzle from Kohler? […]

As consumers, we’re caught in the middle of the convenience. Do we choose to side with Siri, Alexa, or Cortana, and talk only to her, despite looming bias and the risk of growing dependent on a single voice—a voice that could take advantage of us? Or do we side with a free market that gives a voice to every stupid overzealous object in our lives, however confusing that may be, in a world where ordering milk becomes a bidding war on a commodities training floor?

Which future do you root for? They both sound horrible.

All of this is part of a big “the conversation is the interface” trend we’ve been seeing a lot of recently (see The search for the killer bot and 2016 will be the year of conversational commerce). From a design perspective the main challenge we seem to be thinking about is how to give these AI assistants the right personality (see The Next Phase Of UX: Designing Chatbot Personalities and The New Intimacy Economy). But I wonder if that’s the wrong AI design focus. I wonder if we should rather spend our time encouraging design for what Alan Cooper calls The Edges:

The difficulty in making these systems work smoothly comes from their edges, not from their centers. Each vendor builds a reliable and effective product, and through diligent testing assures that they meet high standards of performance. The only place where those standards fall is at the edges, where the maker is unsure of the requirements.

The edges are the interfaces with entities outside their control, outside their offices. Out there they are a little unsure of what they have to do and what forces affect them. Inside the company’s four walls they know exactly what they’re making, how it should behave, and what it should do. But for the entities outside those four walls, some measure of haziness creeps in, notably, the user.

Applied to AI assistants (and back to my parenting story), this means we need to start thinking about not just how humans interact with Siri and Alexa, but how Siri and Alexa interact with each other. There is, of course, a huge disconnect here between user needs and business goals. It would be very beneficial for users if different AI assistants could interact with each other, but that doesn’t help companies to strengthen their silos.

The trouble is that if we don’t figure out how to do this (and do it profitably), we might lose more than the battle of whose personal assistant wins. We might lose the war of personal AI getting any significant user adoption.

The internet of all the things

In Why Every Gadget You Own Suddenly Wants To Talk To You Mark Wilson imagines a scenario where every single thing in your home is always connected, always listening:

As consumers, we’re caught in the middle of the convenience. Do we choose to side with Siri, Alexa, or Cortana, and talk only to her, despite looming bias and the risk of growing dependent on a single voice—a voice that could take advantage of us? Or do we side with a free market that gives a voice to every stupid overzealous object in our lives, however confusing that may be, in a world where ordering milk becomes a bidding war on a commodities training floor?

Which future do you root for? They both sound horrible.

This is the current situation we are in—The Internet of Way Too Many Things. We’ll eventually figure it out and make useful connected products, but right now it’s just a race to be first, although no one really seems to know first at what.

Work and identity (and the machines)

Michael Sacasas has an interesting viewpoint on the “machines are taking our jobs” argument. In Machines, Work, and the Value of People he argues that since we’ve so closely linked our value as human beings to the work we do, the issue of machines taking over hits us pretty hard:

So, to sum up: Some time ago, identity and a sense of self-worth got hitched to labor and productivity. Consequently, each new technological displacement of human work appears to those being displaced as an affront to the their dignity as human beings. Those advancing new technologies that displace human labor do so by demeaning existing work as below our humanity and promising more humane work as a consequence of technological change. While this is sometimes true–some work that human beings have been forced to perform has been inhuman–deployed as a universal truth, it is little more than rhetorical cover for a significantly more complex and ambivalent reality.

Combinatorial innovation and the automation of jobs

John Naughton wrote another interesting “the machines are coming for our jobs!” article1. This one is from the angle of “combinatorial innovation”—the idea that innovation happens when a bunch of disparate advances in technology come together in an unexpected way. His point in We are ignoring the new machine age at our peril is that it’s hard to see the implications of this kind of innovation:

The implications of [the self-driving] vehicle stretch far beyond the future of the automobile industry or even the future of transport. What it signals is that vast swaths of human activity – and employment – which were hitherto regarded as beyond the reach of “intelligent” machines may now be susceptible to automation. So we need to revise our assumptions about the future of work in the light of combinatorial innovation.


  1. See, for example, The Machines are Coming and As Robots Grow Smarter, American Workers Struggle to Keep Up

Automation and the balance of power in workplaces

In The Machines Are Coming, Zeynep Tufekci talks about the kind of tasks that are being automated by machines:

Today, machines can process regular spoken language and not only recognize human faces, but also read their expressions. They can classify personality types, and have started being able to carry out conversations with appropriate emotional tenor.

Machines are getting better than humans at figuring out who to hire, who’s in a mood to pay a little more for that sweater, and who needs a coupon to nudge them toward a sale. In applications around the world, software is being used to predict whether people are lying, how they feel and whom they’ll vote for.

This is not a new topic. Back in 2012, Kevin Kelly proclaimed in Better Than Human: Why Robots Will — And Must — Take Our Jobs:

It may be hard to believe, but before the end of this century, 70 percent of today’s occupations will likewise be replaced by automation.

At the end of last year Claire Cain Miller wrote for the New York Times that As Robots Grow Smarter, American Workers Struggle to Keep Up:

Although fears that technology will displace jobs are at least as old as the Luddites, there are signs that this time may really be different. The technological breakthroughs of recent years — allowing machines to mimic the human mind — are enabling machines to do knowledge jobs and service jobs, in addition to factory and clerical work.

Who knows if this fear is going to turn into reality or not — there are lots of counter-arguments as well (For example, Nicholas Carr has a really interesting historical perspective in Should the Laborer Fear Machines?).

Still, I find the discussion fascinating — especially as it relates to the balance of power in workplaces. Tufekci continues:

Machines aren’t used because they perform some tasks that much better than humans, but because, in many cases, they do a “good enough” job while also being cheaper, more predictable and easier to control than quirky, pesky humans. Technology in the workplace is as much about power and control as it is about productivity and efficiency. […]

This is the way technology is being used in many workplaces: to reduce the power of humans, and employers’ dependency on them, whether by replacing, displacing or surveilling them.

Maybe that’s the real cause for concern here. Not that jobs might go away (although that’s certainly worrisome too), but that power will continue to shift to employers and away from employees.

Google's underlying strategy

Benedict Evans wrote a characteristically brilliant analysis in What does Google need on mobile? Here’s a taste of his conclusion about Google’s challenge going forward:

The key change in all of this, I think, is that Google has gone from a world of almost perfect clarity—a text search box, a web-link index, a middle-class family’s home—to one of perfect complexity—every possible kind of user, device, access and data type. It’s gone from a firehose to a rain storm. But on the other hand, no-one knows water like Google. No-one else has the same lead in building understanding of how to deal with this. Hence, I think, one should think of every app, service, drive and platform from Google not so much as channels that might conflict but as varying end-points to a unified underlying strategy, which one might characterize as ‘know a lot about how to know a lot’.

Don’t miss this article, the whole thing is great.