Tag Archives: consumers

Harms caused by persuasive technologies – what your nonprofit needs to know

Nonprofits, non-governmental organizations (NGOs), charities, government agencies, schools and other mission-based organizations, no matter what that mission is, needs to be aware of persuasive technologies and how that tech is being used to gather data and use it to target people to get them to buy or do something. You should even consider how you can educate your board, your other volunteers and your clients about persuasive tech and they can better recognize such.

This is from a recent email newsletter of the Center for Humane Technology:

We are as concerned as you are about the harms caused by persuasive technologies. A key lever in our theory of change at the Center for Humane Technology is applying pressure on technology companies by educating policy-makers. When government officials understand the harms more deeply, they can create guardrails to protect society.

On June 25, Tristan Harris, a co-founder of the Center for Humane Technology, testified on Capitol Hill in the U.S. Senate Commerce subcommittee hearing, “Optimizing for Engagement: Understanding the Use of Persuasive Technology on Internet Platforms” with Rashida Richardson (AI Now Institute), Maggie Stanphill (Google, Inc.) and Dr. Stephen Wolfram (Wolfram Research). Tristan’s opening statement argued that persuasive technology platforms have pretended to be in an equal relationship with users, while actually holding the upper hand in an asymmetric relationship. Paired with an extractive business model that is based on predicting and controlling people’s choices in the name of maximizing engagement, this inevitably causes serious harm. Algorithms like YouTube recommendations suggest increasingly extreme, outrageous videos to keep us glued to tech sites. In the hearing Tristan said, “Because YouTube wants to maximize watch time, it tilts the entire ant colony of humanity towards crazytown.” 

While many people feel they are opting in as an equal, in reality, algorithms hold asymmetric power over us — they know more about us than we know about ourselves — even predicting when we are going to quit our jobs or are pregnant. As platforms gain the upper hand over the limits of human brains and society, they cannot be allowed to have an extractive relationship but a “Duty of Care” or a “Fiduciary” relationship.

To learn more, check out CHT’s testimony, watch Tristan’s comments (17 min video) and read this Gizmodo article, “This is How You’re Being Manipulated.”

The Gizmodo article does a great job of showing that, the longer you spend in these social media ecosystems, “just scrolling”, the more machine learning systems learn about you. They build a profile of you, based on what you are looking at, what you have “liked,” what your friends have liked, etc. Think of that profile as an avatar – as, Tristan Harris, the executive director of the Center for Humane Technology, puts it, “a voodoo doll-like version of you inside of a Google server. And that avatar, based on all the clicks and likes and everything you ever made—those are like your hair clippings and toenail clippings and nail filings that make the avatar look and act more and more like you—so that inside of a Google server they can simulate more and more possibilities about ‘if I prick you with this video, if I prick you with this video, how long would you stay?’ And the business model is simply what maximized watch time…”

“Without any of your data I can predict increasing features about you using AI… All I have to do is look at your mouse movements and click patterns […] based on tweet text alone we can know your political affiliation with about 80-percent accuracy. [A] computer can calculate that you’re homosexual before you might know you’re homosexual. They can predict with 95-percent accuracy that you’re going to quit your job, according to an IBM study. They can predict that you’re pregnant.

Lawmakers weighed in on the issues as well:  

  • Sen. Schatz (D-Hawaii) “Companies are letting algorithms run wild and only using humans to clean up the mess. Algorithms are amoral. Companies designed them to optimize for engagement as their highest priority, and in doing so eliminated human judgment as part of their business model.”
  • Sen. Thune (R-South Dakota) “The powerful mechanisms behind these platforms meant to enhance engagement also have the ability, or at least the potential, to influence the thoughts and behaviors of literally billions of people.”
  • Sen. Tester (D-Montana) “I’m probably going to be dead and gone—and I’m probably thankful for it—when all this s— comes to fruition, because I think that, this scares me to death.”

So… what can you do?

  • Consider creating a workshop jointly with other agencies to educate volunteers and clients about how social media is used to gather information about them and their children, and how that technology is designed to encourage them into action and beliefs in ways they may never have realized.
  • Write your elected national representatives and tell them you believe these companies should be required, by legislation, to do a better job of talking about how they target users to keep them engaged.
  • Create a written social media policy that makes a commitment to never “like” or share any information on social media that does not fit absolutely into the mission of your organization and that cannot be verified. Know what your social media manager is doing (watch, don’t just ask). If a board member or prominent volunteer asks you to share something via the organization’s social media account that you feel does not meet that criteria, be prepared to explain to that board member why you will NOT be sharing such.
  • Create a page on a private GoogleDoc or a public web page that has a list of links to the Facebook pages you want to check in regularly regarding news and updates instead of liking those pages on Facebook (I have a private page where I have listed the Facebook pages of all of the city and county governments of my area, political groups I support, nonprofits I want to keep an eye on, sports teams I like, etc.). Any time you want to get an update, you just go to that page you’ve created and click on the link of any group or office you are interested in. Unlike every Facebook page except those you want to publicly, officially endorse by doing so. The result: you are more likely to get the updates you want from the groups you most want, because you aren’t relying on Facebook to show such in your timeline.
  • Get rid of your Facebook group for volunteers, clients, etc. Facebook data mines every post made to these groups, even if you set the account to private. Also, not everyone wants to use Facebook, because of its data-mining/profile-building and selling practices. Free alternatives include YahooGroups, Groups.io, and MeWe. Or consider making the investment for a completely private platform to create an online space for working with your volunteers or clients – my favorite is Basecamp.
  • Be flexible about how you communicate directly with volunteers and clients online and be ready to use whatever tool they seem most engaged in – and be ready to change as they change. That may mean using WhatsApp for a year or two to send direct messages to volunteers or clients and then switching to Telegram because that’s what your volunteers or clients are switching to.
  • Keep using Facebook if its proven to be a good way to get your message out and engage with others, but never use it as your only avenue for online outreach: your web site should be always up-to-date, you should post to Twitter and create content for YouTube, and you should post information, as appropriate, to online communities on other platforms, like Reddit and even Craigslist. I find places to potential new places online to post information by asking clients or volunteers where they are getting ANY information.

Also see:

If you have benefited from this blog or other parts of my web site and would like to support the time that went into researching information, developing material, preparing articles, updating pages, etc. (I receive no funding for this work), here is how you can help