I give dozens of workshops, webinars, and conference keynotes each year. Which means I receive dozens of evaluation surveys each year.

After my sessions, the clients who sponsored the workshop ask their participants to rate my session. Sometimes the satisfaction surveys are electronic. Other times, the satisfaction surveys are conducted with good ol’ paper and pencil. The paper surveys get scanned and a software program automatically compiles the results.

Survey software tools have come a long way. During college, I spent ten soul-crushing hours each week entering data from paper surveys into SPSS in exchange for course credit. I paid the university for the privilege of entering data! (And yes, I learned a ton along the way, and still use those statistics and research methods skills daily.) When I was a research assistant, the survey scanning tools hadn’t been invented yet. Nowadays, research assistants probably have more meaningful tasks than data entry. It’s a different world.

I’m grateful for this automated reporting technology. But, at the same time, survey scanning tools drive me crazy. Their designs still live in the dark ages—it’s 2018 software with a 1998-era knowledge of graphic design and brain science.

Before

Here’s the most recent survey report that I received. The four-page report comes from a Dashboard Design workshop that I led at a conference last fall.

Here’s the most recent survey report that I received. The 4-page report comes from a Dashboard Design workshop that I led at a conference last fall.

This software program’s design drives me crazy because:

  • The title—Integrated Item Analysis Report—is a mouthful. Yes, I know what an item analysis is. I took an entire graduate course about psychometrics. There were dozens of workshop instructors at this conference. We came from a variety of academic backgrounds. Let’s not assume that everyone knows what an item analysis is.
  • It’s dense. There are borders and outlines around everything. There are even double outlines around the open-ended comments. There’s almost no white space. The information is straightforward—here’s how people responded to each survey question—but the dense design makes it feel more complicated than it is.
  • The colors and fonts are lacking a soul. The conference had its own logo, fonts, and colors. The organization that sponsored the conference had its own logo, fonts, and colors. Let’s breathe some life and identity into this report.
  • So many decimal places. I would never change my workshop approach because a tool told me that 88.89% of people answered a certain way. That’s 89%. I’m the audience for this report. I know exactly what’s useful for me and what isn’t. Decimals won’t change my life.

Let’s revamp this report. Tiny edits will make a big difference. This is the step-by-step process that I teach in all of my Dashboard Design workshops, and today I’m sharing the process with you, too.

 

Start with a Table

Tables are the heart of every quantitative report. We tabulate our numbers and build visuals from those tables. I re-typed the survey questions and the responses into my spreadsheet.

Make sure that you declutter your table by removing unnecessary ink. Tables rarely need all the borders, horizontal lines, and vertical lines that we’re accustomed to seeing. Sometimes I add a few horizontal lines back at the very end of the design process.

I ignored the mean values for each of the survey questions. Agree/disagree scales are ordinal. We can only calculate means for interval or ratio variables.

I also ignored the Neither Agree Or Disagree category. I’m the audience for this report. I won’t change my workshop content based on a middle category. Here’s how I read this report: “Did anyone hate the workshop? Are there disagree responses? Darn, one person disagreed with every statement. Curmudgeon Effect? A handful of people will be dissatisfied no matter what I do. Maybe that person was having a bad day. Or, maybe they accidentally checked the strongly disagree boxes instead of the strongly agree boxes? I’ll never know for sure. Okay, let’s move on. Did anyone love the workshop? Are there any strongly agree responses? Phew, that’s almost everyone. So now I need to compare the agree and the strongly agree responses. What was holding someone back from checking the strongly agree box? How can I go from good to great?” In most projects, participants tend to be satisfied, so we’re usually comparing the top two choices. The middle categories rarely matter.

Start with a Table Tables are the heart of every quantitative report. We tabulate our numbers and build visuals from those tables. I re-typed the survey questions and the responses into my spreadsheet. Make sure that you declutter your table by removing unnecessary ink. Tables rarely need all the borders, horizontal lines, and vertical lines that we’re accustomed to seeing. Sometimes I add a few horizontal lines back at the very end of the design process. I ignored the mean values for each of the survey questions. Agree/disagree scales are ordinal. We can only calculate means for interval or ratio variables. I also ignored the Neither Agree Or Disagree category. I’m the audience for this report. I won’t change my workshop content based on a middle category. Here’s how I read this report: “Did anyone hate the workshop? Are there are disagree responses? Darn, one person disagreed with every statement. Curmudgeon Effect? A handful of people will be dissatisfied no matter what I do. Maybe that person was having a bad day. Or, maybe they accidentally checked the strongly disagree boxes instead of the strongly agree boxes? I’ll never know for sure. Okay, let’s move on. Did anyone love the workshop? Are there any strongly agree responses? Phew, that’s almost everyone. So now I need to compare the agree and the strongly agree responses. What was holding someone back from checking the strongly agree box? How can I go from good to great?” In most projects, participants tend to be satisfied, so we’re usually comparing the top two choices. The middle categories rarely matter.

Add Visuals

There are several ways to visualize agree/disagree scales, like stacked bar charts, diverging stacked bar charts, or even waffle charts. The existing bar charts would be easiest to automate across dozens of workshop evaluation surveys, so we’ll keep them.

This example contains miniature within-cell bar charts called data bars. You can make data bars in good ol’ Excel with just a few clicks.

Add Visuals There are several ways to visualize agree/disagree scales, like stacked bar charts, diverging stacked bar charts, or even waffle charts. The existing bar charts would be easiest to automate across dozens of workshop evaluation surveys, so we’ll keep them. This example contains miniature within-cell bar charts called data bars. You can make data bars in good ol’ Excel with just a few clicks.

Write a Title and Subtitle

One of the most common mistakes that I see among aspiring data visualizers is a lack of text. People get really excited about data visualization. They start churning out more (and better!) visuals than ever before. Sometimes they forget that text still plays an important role. At the top of your report, add plain language that introduces your viewers to what you’re about to show them.

For the title, I changed “Integrated Item Analysis Report” to “Dashboard Design with Ann K. Emery.” At this particular conference, there were dozens of workshops and dozens of evaluation survey reports. The title’s job is to distinguish one report from another. The contents of the report are an item analysis (a question-by-question analysis). But the title of the report needs to contain the workshop’s name and the instructor’s name.

For the subtitle, I wrote, “This report shows the results from the Dashboard Design workshop evaluation survey. If you have questions about this report, please contact So-in-So.” I typically keep my dashboard subtitles to two sentences. The first sentence tells you what you’re about to learn. The second sentence tells you who to contact if you want to learn more.

Write a Title and Subtitle One of the most common mistakes that I see among aspiring data visualizers is a lack of text. People get really excited about data visualization. They start churning out more (and better!) visuals than ever before. Sometimes they forget that text still plays an important role. At the top of your report, add plain language that introduces your viewers to what you’re about to show them. For the title, I changed “Integrated Item Analysis Report” to “Dashboard Design with Ann K. Emery.” At this particular conference, there were dozens of workshops and dozens of evaluation survey reports. The title’s job is to distinguish one report from another. The contents of the report are an item analysis (a question-by-question analysis). But the title of the report needs to contain the workshop’s name and the instructor’s name. For the subtitle, I wrote, “This report shows the results from the Dashboard Design workshop evaluation survey. If you have questions about this report, please contact So-in-So.” I typically keep my dashboard subtitles to two sentences. The first sentence tells you what you’re about to learn. The second sentence tells you who to contact if you want to learn more.

Apply a Text Hierarchy

A text hierarchy tells your viewers which text is at the top of the food chain. The title should be large, dark, and bold so that it instantly grabs your viewers’ attention. You could also apply ALL CAPS to the title or section headers. Use ALL CAPS sparingly, please. It takes longer for our brains to read ALL CAPS than Sentence case or Title Case. We like having a mix of tall and short letters. This is especially true for people with learning disabilities.

I also made each of the survey questions bold. Later on, I tweaked the font sizes and colors again. The idea is the same. The important information needs to stand out in large, dark, and bold text.

Apply a Text Hierarchy A text hierarchy tells your viewers which text is at the top of the food chain. The title should be large, dark, and bold so that it instantly grabs your viewers’ attention. You could also apply ALL CAPS to the title or section headers. Use ALL CAPS sparingly, please. It takes longer for our brains to read ALL CAPS than Sentence case or Title Case. We like having a mix of tall and short letters. This is especially true for people with learning disabilities. I also made each of the survey questions bold. Later on, I tweaked the font sizes and colors again. The idea is the same. The important information needs to stand out in large, dark, and bold text.

Brand with Customs Colors and Fonts

Another common mistake that I see among aspiring data visualizers is when people think that adding their logo will sufficiently brand their document. Sure, you can add your logo to your report. Just make sure to place your logo in the lower corner—not in the top—so that it doesn’t distract from the report’s contents. In addition to using logos, your fonts and can reinforce your brand.

For fonts, I’m using a combination of Lato Heavy and Lato Light. You would use your own fonts.

You would also use your own colors, not mine. Learn how to read your organization’s style guide, locate your color codes with an eyedropper, or locate your color codes with Microsoft Paint. Then, enter your color codes in Excel or in Tableau.

Brand with Customs Colors and Fonts Another common mistake that I see among aspiring data visualizers is when people think that adding their logo will sufficiently brand their document. Sure, you can add your logo to your report. Just make sure to place your logo in the lower corner—not in the top—so that it doesn’t distract from the report’s contents. In addition to using logos, your fonts and can reinforce your brand. For fonts, I’m using a combination of Lato Heavy and Lato Light. You would use your own fonts. You would also use your own colors, not mine. Learn how to read your organization’s style guide, locate your color codes with an eyedropper, or locate your color codes with Microsoft Paint. Then, enter your color codes in Excel or in Tableau.

Re-Arrange Until Everything Fits on the Page

This step is more of an art than a science…

I opted for a landscape layout instead of portrait layout. I reserve portrait layout for materials that are going to be printed. Are workshop facilitators printing out documents like this? I doubt it. I won’t. Landscape layout is best for documents that are going to be read on-screen because our computer monitors are already landscape-shaped. You open the document and it just fits so nicely. No wasted space around the margins.

I adjusted row heights and column widths to get the page breaks just right.

I merged a few cells. When you’re working in spreadsheets, don’t merge cells together too early!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! You’ll kick yourself. Unmerging cells is drudgery.

I added page numbers. My report was designed entirely within Excel, but it would get shared with others as a PDF. Page numbers make my “spreadsheet” feel more like a regular document.

I added horizontal lines so that readers could across the rows more easily. The lines are light gray, not black. They don’t distract from the more important information.

And speaking of lines… I removed the double outlines (!!!) around the open-ended responses. This is one of my favorite parts of the makeover. Now, we can actually see the comments because they aren’t competing with the outlines for attention.

I color-coded the report by category. The introductory section is purple, the closed-ended questions are blue, and the open-ended questions are turquoise. I wanted readers to know when a new topic was starting.

Finally, for bonus points, I added icons. Michelle Borkin and her team found that icons make graphs more memorable, so I add icons whenever I can. I’ll teach you how to add icons in a future post.

Here’s the full makeover. I hope you like it.

Here's the first page of the finished makeover.

Here's the second page of the finished makeover.

Here's the third page of the finished makeover.

Within minutes, we’ve provided workshop facilitators with useful information without burning their eyeballs.

 

Learn More in the Free Course

Want to see additional before/after data visualization makeovers? Sign up for my brand new online course. It’s free!!! There are seven lessons with seven videos. You’ll learn my favorite techniques for soaring beyond the Dusty Shelf Report. Sign up for the free course.

 

Purchase the Template

Want to explore my survey report makeover in more detail? See how I arranged the text, graphs, and icons. Or, get ideas from the template to use in your own project. You can purchase the template below.


Purchase the Dashboard Template ($10)