The Community Of Over 578,000

Home ›› Business Value and ROI ›› 6 Key Questions to Guide International UX Research ›› small_16 ›› Why PBS Uses Data to Drive Continuous Design

Why PBS Uses Data to Drive Continuous Design

by Matt McManus
Share this post on
Share on twitter
Tweet
Share on linkedin
Share
Share on facebook
Post
Share on reddit
Share
Share on email
Email
Share on print
Print

Save

An agile production shop that combines continuous design and data-driven design lets PBS provide accessible content across a growing number of platforms.

At PBS, we strive to provide viewers with their favorite content wherever and whenever they want, which is becoming an increasingly hard problem to solve, given the frequency at which new platforms emerge. In 2010, PBS had a website and an iPad app to deliver video, our primary content offering. By the beginning of 2014, there were eight platforms. This year will see that number double.

For that reason we need to be able to quickly identify the biggest opportunities and deliver new applications, while retaining our brand presence on diverse platforms. PBS has long been an agile development shop—it offers the flexibility to incrementally and simultaneously build for multiple platforms, while tracking and prioritizing cross-team dependencies. We further refined the standard agile processes by enacting Kanban, a system of continuous code deployment. To allow us to double our platform offerings in the space of a year, we have extended the agile process through the principles of data-driven and continuous design.

With Continuous Design, You’re in the Business of Change

Continuous design has two main principles. The first requires you to abandon the long-held concept of “final” designs. Designers must be involved throughout the entire product development process, not just at the beginning. The second mandates designers create reusable front-end code, or interactive prototypes, instead of document-based deliverables like PSDs.

To facilitate the continuous design process, PBS Digital created a cross-product design team of UX, UI, and front-end designers who are responsible for delivering reusable HTML/CSS/JS designs. On our native mobile app projects, the design team takes advantage of tools such as Flinto to deliver interactive prototypes that can be installed on actual mobile devices. The prototypes include important design details such as screen transitions, which are difficult to illustrate in a static document. In both scenarios, the design team isn’t just producing documents to “throw over the wall”—instead, the team remains actively engaged throughout the entire build cycle and is able to respond quickly to changes.

Holding Yourself Accountable to Data

Before designers design, they need a direction. Data-driven design provides the orientation for creating and evolving products based on collected data about how current designs are performing in the market. To paint the full picture, we treat each major release as an experiment and collect both quantitative and qualitative data. Our analytic arsenal contains a swath of tools we find indispensable, including Splunk, which measures video streaming data from the server’s point of view; Google Analytics, for mass anonymous usage data; ForeSee, for customer satisfaction surveys; UserTesting.com, to conduct user tests; App Store reviews; Twitter buzz; and a few others.

Collecting data is not hard; collecting the right data—relevant data—and drawing the necessary insights is. But even good data and good analysis does not ensure correct decisions. That requires the institutional holds itself accountable to the data. For example, PBS recently decided to move away from building HTML5-hybrid apps after analyzing data collected from an experiment with our iPhone app.

Collecting data is not hard; collecting relevant data and drawing the necessary insights is

Beginning in the summer 2013, PBS experimented with a hybrid iPhone app, releasing a native “wrapper” for our responsive video portal. By all measures, quantitative and qualitative, the hybrid approach left PBS consumers less satisfied than the previous native app experience. There was a quantitative drop in app engagement, measured by video streams, and qualitative drop in user satisfaction, as noted in app store reviews and users surveys.

The experiment, on a lesser-used platform, led PBS to conclude that hybrid (or wrapped) apps were not a viable long-term strategy. (We are not the only ones to have reached this conclusion.) It is not easy to design a single site that satisfies both app and web users across all mobile and desktop platforms. Despite the investment of time and design resources in pursuing the hybrid strategy, the data showed it was not the correct direction. Objectively reviewing the data, and holding ourselves accountable, was an important step in the right direction, and serves as an example of incremental, data-driven design.

Tools Are Not Solutions

Data-driven design and continuous design are not universal solutions. Understanding their value led PBS Digital’s product team to fully integrate the principles into standard workflows. As with any tool or process, however, you need to make sure it is the correct one for the job. Regardless of your current design process, there are elements of data-driven and continuous design from which you may benefit.

post authorMatt McManus

Matt McManus,

Matt McManus a Director of Product Management at PBS. He looks after all of the PBS and PBS KIDS video streaming applications including PBS KIDS for iOS, PBS for iOS, PBS for Apple TV and multiple other applications scheduled for launch in 2014. Matt is a highly motivated digital media enthusiast who takes pride in delivering best-in-class products to the market from concept through commercialization.

Share on twitter
Tweet
Share on linkedin
Share
Share on facebook
Post
Share on reddit
Share
Share on email
Email
Share on print
Print

Related Articles

Building digital products for the web’s next billion users
  • Connectivity issues are further inflated by accessibility gaps. This, in turn, undermines user experience and creates obstacles for the wider use of digital products.
  • When designing for users, it’s worth considering such issues as poor connectivity, accessibility constraints, levels of technological literacy within different countries and cultural barriers.
  • In order to satisfy the needs of the next 3 billion users, it’s vital to build inclusive and accessible products that will provide solutions to the critical problems the next generation will face.
Share:Building digital products for the web’s next billion users
The Liminal Space Between Meaning and Emotion
  • To innovate well is to search for meaning behind the innovation first. This requires investing time into discovering what users need and think of unique ways to serve them and better solve their problems.
  • Emotions are widely misunderstood in UX design and often manipulation is used to predict user behavior. However, a much better approach to UX design is storyscaping, which aims at empowering users, rather than controlling them.

Read the full article to learn more about liminal space and how to apply this thinking to your design.

Share:The Liminal Space Between Meaning and Emotion

Stop frustrating your users. Invest in notification strategy instead.

The UX of Notifications | How to Master the Art of Interrupting
  • As part of UX, notifications are key to leading the user to a better interaction with the product. Therefore, notification strategy should have a central role in UX design.
  • A good starting point is to create a user’s journey map and identify major pain points. This should serve to understand when and where notifications might be of help, rather than create confusion.
  • It’s a good practice to use a variety of notifications and provide the user with opt-outs so they don’t feel overwhelmed.
Share:The UX of Notifications | How to Master the Art of Interrupting

This website uses cookies to ensure you get the best experience on our website. Check our privacy policy and