Menu

Posts tagged “technology”

Easier blog post image management with Dropshare and Amazon S3

I’m always on the lookout for faster ways to upload and insert images into blog posts. It’s the part of the blogging workflow that I dislike the most. Up to now I’ve used a pretty convoluted combination of Amazon S3 buckets and Transmit. But over the weekend, while moving hosting providers1, I finally came up with a really simple image upload workflow that I thought I’d share in case it helps anyone else.

This workflow lets you drag and drop an image to a menu bar icon on your Mac, and then immediately paste a secure, custom domain URL for that image wherever you need it.


Step 1 - Create S3 bucket

Create an Amazon S3 bucket for your image uploads. It doesn’t matter what you name the bucket, but do not add a . to the name. This creates some weird SSL certificate errors later in the process that you don’t want to deal with.

Also make sure you set the bucket to be publicly accessible via the Permissions tab, otherwise you’ll get read errors for your files.

Step 2 - Create CloudFront distribution

Create an Amazon CloudFront distribution for the S3 bucket you just created, so that you can use a custom URL for your images, and make use of Amazon’s Content Delivery Network (CDN) capabilities.

When you go through the flow of adding a distribution for your S3 bucket, leave the “Distribution Settings” section blank at first — we’ll come back to that.

CloudFront settings

Step 3 - Add custom domain for your images

Back on the main Distributions screen, note the CloudFront domain name that was created for your bucket. It’s going to be in the format ***************.cloudfront.net. Go to your DNS provider and add a CNAME for the custom domain you want to use for your images.

In my case, cdn.elezea.com points to my CloudFront distribution at d26fqxuc6*****.cloudfront.net, which in turn links to the S3 bucket I set up earlier.

Step 4 - Add SSL certificate to CloudFront distribution

Now go back to your Distribution Settings in CloudFront. Add your CNAME information, and then click the button to “Request or Import a Certificate with ACM”.

This will take you through the process of generating a free SSL cert to be used with your CloudFront distribution. This is essential if you serve your site over https. If you don’t do this, your images will be served over http and you will get “mixed content” warnings when you embed images in your site.

Change your settings to “Custom SSL Certificate”, and you’re good to go.

CloudFront settings

Interlude - take a breath

If you’ve successfully completed these steps, here’s where you’ll be. Whenever you upload an image to your S3 bucket, you will be able to serve that image via your custom URL over https, and as an added bonus, you’ll be using Amazon’s CDN for super fast delivery.

Now we need to figure out the fastest way to get images into that bucket of yours.


Step 5 - Download and set up Dropshare

There are many sophisticated ways to manage your S3 buckets. But when it comes to uploading an image and getting a URL for it, I haven’t found anything that’s simpler than Dropshare.

In short, Dropshare allows you to establish connections to all your S3 buckets. It lets you upload files by dragging them to the Dropshare menu bar icon, and then the URL for that image is automatically copied to your clipboard. So to add an image to this blog post, for example, I just drag the image to the menu bar icon, then come back to where I’m writing and ⌘-V to insert the link. It couldn’t be easier.

I have a bunch of S3 buckets linked up in Dropshare:

Dropshare

In the case of the bucket I use for this site, note that I entered the bucket name, the domain alias (the CNAME you added earlier), and that I have the “Use SSL” box checked:

Drophsare

This makes the workflow for adding images an absolute breeze. Drag and paste. That’s it.

When you upload an image, Dropshare lets you choose the bucket you want to upload to, as well as if you want to add a landing page and/or use a URL shortener (which I usually don’t, but it’s nice to have the option).

Drophsare

Dropshare is useful for other things too. I have a keyboard shortcut that takes a screen shot, automatically uploads it to an S3 bucket, and copies the URL to the clipboard. That’s great for sharing screen shots in Slack, for example.


I’m not sure how many people have this need to shave a few minutes off their image workflow. But I hope this post is useful for the few of you who do obsess about things like this, like I do. And please let me know if you think this flow can be improved even more!


  1. I’m now with DreamHost and much happier. 

The weird future of facial recognition

This story by Rene Chun about China’s New Frontiers in Dystopian Tech is wild:

Don’t even think about jaywalking in Jinan, the capital of Shandong province. Last year, traffic-management authorities there started using facial recognition to crack down. When a camera mounted above one of 50 of the city’s busiest intersections detects a jaywalker, it snaps several photos and records a video of the violation. The photos appear on an overhead screen so the offender can see that he or she has been busted, then are cross-checked with the images in a regional police database. Within 20 minutes, snippets of the perp’s ID number and home address are displayed on the crosswalk screen. The offender can choose among three options: a 20-yuan fine (about $3), a half-hour course in traffic rules, or 20 minutes spent assisting police in controlling traffic. Police have also been known to post names and photos of jaywalkers on social media.

I can’t help but be reminded of that “biometric advertising” scene in Minority Report:

Minority Report

Facebook is not honoring its side of the data deal with users

I think everyone has “Facebook Article Exhaustion” right now. But Brian Barrett’s Facebook Owes You More Than This makes a somber, important point:

This is not a screed about deleting your Facebook account. It’s not a rant about online ads. It is an argument, though, that Facebook has been a poor steward of your data, asking more and more of you without giving you more in return—and often not even bothering to ask. It has repeatedly failed to keep up its side of the deal, and expressed precious little interest in making good.

If you feel exasperated by the whole Facebook privacy debacle, I think this article will help make sense of some of those feelings. One more quote:

But as Facebook collects more and more data, and offers advertisers more and more tools to monetize it, the benefit to you seems not to have grown in kind. You get an ever-shifting algorithm designed to keep you scrolling, which the company’s own research suggests can leave you “feeling worse afterward.” You get dozens of Russian propagandists flooding millions of News Feeds with high-emotion content designed to undermine US democracy, with slow and incomplete disclosures about the impact. And you get ads for the same pair of shoes—that you already bought—trailing you for months.


Also check out the always excellent Paul Ford’s Facebook Is Why We Need a Digital Protection Agency, in which he calls for a digital equivalent of the Environmental Protection Agency. His reasoning:

The activist and internet entrepreneur Maciej Ceglowski once described big data as “a bunch of radioactive, toxic sludge that we don’t know how to handle.” Maybe we should think about Google and Facebook as the new polluters. Their imperative is to grow! They create jobs! They pay taxes, sort of! In the meantime, they’re dumping trillions of units of toxic brain poison into our public-thinking reservoir. Then they mop it up with Wikipedia or send out a message that reads, “We take your privacy seriously.”

Spotify and the business of making hits

Spotify has been in the news quite a bit recently, especially since their IPO announcement. The best article I’ve read so far about Spotify’s business model (and challenges) is Ben Thompson’s Lessons from Spotify:

Spotify’s margins are completely at the mercy of the record labels, and even after the [lower royalties] rate change, the company is not just unprofitable, its losses are growing, at least in absolute euro terms.

Ben goes further to explain how difficult it would be for Spotify to cut out record labels completely:

Notice how little power Spotify and Apple Music have; neither has a sufficient user base to attract suppliers (artists) based on pure economics, in part because they don’t have access to back catalogs. Unlike newspapers, music labels built an integration that transcends distribution.


Profitability aside, it’s fascinating and kind of scary to get a sense of the oversized role that Spotify plays in deciding what becomes a hit song. Austin Powell digs into the details in his article Inside the booming black market for Spotify playlists:

The biggest of those playlists can essentially manufacture hits. A single add to Spotify’s influential RapCaviar, which boasts more than 8 million followers, can result in hundreds of thousands of streams, depending on where it’s placed and how long it stays there. RapCaviar has been credited, for example, with making Smokepurpp’s “Audi” go gold, with 68 million streams and counting.


But wait, there’s more (as the say). Some of Spotify’s biggest playlists are owned by none other than the record labels themselves. From Liz Pelly’s The Secret Lives of Playlists:

On other playlists, you’ll occasionally notice different logos: the thick cursive word Filtr, the all-caps logo for Topsify, or simple rounded text reading Digster. These are the playlisting brands owned by the major labels: Filtr by Sony, Topsify by Warner, and Digster by Universal.

What does this mean?

Outside of the Spotify staff-curated playlists, those curated by Filtr, Digster and Topsify have more visibility on the Browse pages than any other playlisting brands, individuals or labels. With these playlists, employees of Filtr, Digster and Topsify can simply log in and add tracks.

“Things like Topsify, Digster and Filtr remain good resources, especially for [major label] developing artists,” says Jeff. “I know that I can plug in such-and-such track to five [of our] playlists and start to rack up some plays, some revenue for that artist, get it in front of some new listeners, and you also get some algorithmic stuff going. Like Release Radar and Discover Weekly.” By using Filtr, Topsify and Digster playlists to generate activity on their own material, the majors effectively use these playlists to pump their artists into Spotify-owned algorithmic playlists.

The musical world belongs to the “curators” and algorithms. We’re just listening in it. And the company that has the most control over it all is not even close to being profitable.

How YouTube leads viewers down a rabbit hole of extremism

Two related articles about YouTube caught my eye over the past few days. The first, Zeynep Tufekci’s YouTube, the Great Radicalizer explains how YouTube’s algorithms almost always lead people to conspiracy theory videos:

It seems as if you are never “hard core” enough for YouTube’s recommendation algorithm. It promotes, recommends and disseminates videos in a manner that appears to constantly up the stakes. Given its billion or so users, YouTube may be one of the most powerful radicalizing instruments of the 21st century. […]

What we are witnessing is the computational exploitation of a natural human desire: to look “behind the curtain,” to dig deeper into something that engages us. As we click and click, we are carried along by the exciting sensation of uncovering more secrets and deeper truths. YouTube leads viewers down a rabbit hole of extremism, while Google racks up the ad sales.

This is bad enough, but then there’s James Cook’s article YouTube suggested conspiracy videos to children using its Kids app, in which he explains how not even the YouTube Kids app is immune to this:

YouTube’s app specifically for children is meant to filter out adult content and provide a “world of learning and fun,” but Business Insider found that YouTube Kids featured many conspiracy theory videos which make claims that the world is flat, that the moon landing was faked, and that the planet is ruled by reptile-human hybrids.

I try not to be too quick to call technology evil, but this is definitely not a “all technology is neutral” situation. Product managers and developers have the power to stop this kind of escalation from happening.

Innovation consequences: it’s complicated

In Airbnb and the Unintended Consequences of ‘Disruption’ Derek Thompson uses Airbnb as an example to explain how it’s not as easy to call tech innovation a good or a bad thing. It’s complicated…

Airbnb lowered prices for tourists, supplemented the income of renters, and simply made travel to major cities more fun. But upon inspection, it shares some things in common with more-controversial companies—albeit with less grave implications. Facebook and Twitter design for attention, but incidentally encourage mendacious outrage and trolling. eBay and Amazon design for open marketplaces, but incidentally encourage the frenzied resale of bulk-ordered toys around Christmas. Airbnb was supposed to challenge hotels by letting tourists pay renters. But its platform is unwittingly producing a subsidy of tourists, paid for by nonparticipating urban dwellers, who bear the cost of higher rental prices.

How Facebook realized that it’s more than a platform

Nicholas Thompson and Fred Vogelstein has a gripping feature in Wired called Inside Facebook’s Two Years of Hell. It’s long, but very much worth reading. It takes us through a journey that starts with Facebook’s years of denial:

It appears that Facebook did not, however, carefully think through the implications of becoming the dominant force in the news industry. Everyone in management cared about quality and accuracy, and they had set up rules, for example, to eliminate pornography and protect copyright. But Facebook hired few journalists and spent little time discussing the big questions that bedevil the media industry. What is fair? What is a fact? How do you signal the difference between news, analysis, satire, and opinion? Facebook has long seemed to think it has immunity from those debates because it is just a technology company—one that has built a “platform for all ideas.”

And it ends at the point they are at now: starting to realize that they can’t hide behind the “we’re just a platform” excuse any more.

How smartphone usage affects teens’ mental health

I should start by stating the obvious: I like technology and phones, and I think it’s essential for kids to be exposed to it so that they can be prepared for the future ahead. That said, despite its click-bait title, Jean Twenge’s Have Smartphones Destroyed a Generation? really got to me. She studied how teens tend to spend their time, and how it affects their mental health, and came to some alarming conclusions:

More comfortable in their bedrooms than in a car or at a party, today’s teens are physically safer than teens have ever been. They’re markedly less likely to get into a car accident and, having less of a taste for alcohol than their predecessors, are less susceptible to drinking’s attendant ills.

Psychologically, however, they are more vulnerable than Millennials were: Rates of teen depression and suicide have skyrocketed since 2011. It’s not an exaggeration to describe iGen as being on the brink of the worst mental-health crisis in decades. Much of this deterioration can be traced to their phones.

I know that sounds a bit like fear-mongering—and maybe it’s not as bad as Jean makes it sound. But it’s still worth reading the article and making up your own mind based on the data presented.

The ethics of “conquering” other planets

I’ve been knee deep in hard sci-fi stories like Red Mars and Babylon’s Ashes over the past few months, so I have a special affinity for stories about space colonization at the moment. David H. Grinspoon’s The logistics and ethics of colonizing the red planet is a really interesting take on the ethics of colonizing a new planet:

Today on Earth we are grappling with the fact that you cannot “conquer” a planet, even if — especially if — it is your home and your life support system. If we go to Mars with the idea that we can charge ahead and subdue a new world, our efforts are doomed. We should rather study how we might learn to help cultivate a Martian Biosphere that is balanced and self-sustaining, as is the Earth’s.

Rogue One as a story about engineering and design ethics

Spoilers abound so proceed with caution, but Rogue One: an ‘Engineering Ethics’ Story is so very good:

What Galen Erso does is not simply watch a system be built and then whistleblow; he actively shaped the design from its earliest stages considering its ultimate societal impacts. These early design decisions are proactive rather than reactive, which is part of the broader engineering ethics lesson of Rogue One.

The exploration of how Galen didn’t just walk away but took an active role in the destruction of the Death Star is interesting and highly relevant to what I consider an “ethical awakening” in our use of technology. It’s one thing to #DeleteUber — and those campaigns can certainly be effective, in that case to the tune of 500,000 accounts. It’s quite another to “infiltrate” your company and basically sabotage its technology because you believe it’s ethically dubious. The really complicated question is who gets to decide whether or not a company’s “ultimate societal impact” is good or bad. And, of course, who watches the watchers…