Statistics for UX | NN/g Training Course (2024)

When research data should be trusted; what statistics to use when

In UX, we often collect and report numbers: how many people completed the tasks, what the mean satisfaction rating was, how many users converted with design A compared with design B. But what’s in a number? And how much can we trust these numbers in the first place? This class will teach you the statistics needed to understand and analyze the numbers you get from UX research, and the types of inferences you can draw from such numbers.

This seminar is ideal for experienced UX practitioners who are planning on designing and analyzing their own quantitative usability studies or have already run such studies. You should NOT take this course if you don’t foresee working on a quantitative project in the immediate future and if you lack any background in quantitative methodologies.

"This class is a great overview of methods you should know, whether you work with data analysis yourself or have coworkers that do the crunching for you. Great way to get a realistic view of how much you do and do not know. Very knowledgeable instructor."

Grace Buenrostro

Topics

Topics

  • Why a design may not be better than another even though its metrics look better
  • True-score theory and measurements errors
  • Center and variability of a distribution
  • Continuous and binary variables
  • Confidence intervals:
    • What they are
    • How to compute them
  • Statistical significance and analyzing differences between designs
  • Comparing with a benchmark
  • Statistical tools for analyzing self-reported metrics
    • Single-Ease Question, SUS, NPS
  • Statistical tools for analyzing performance metrics
    • Success rates and conversion rates
    • Task times
  • How quantitative-study design impacts measurement error
    • Internal vs. external validity
    • Independent vs. dependent variables
    • Between-subjects designs vs. within-subjects designs
    • Number of participants needed for quantitative studies

Format

Format

The basis of the course is a lecture format with individual hands-onexercises to reinforce statistical methods. Most activitiesinvolve using Excel or statistical calculators in order to analyze specific datasets.

The course also includes:

  • Examples of quantitative studies and relevant analyses
  • Examples of how to report quantitative data
  • Reflection questions
  • Opportunities to ask questions and get answers

Prerequisites

Prerequisites

This class is a collection of statistical methods that can be used for analyzing data from a quantitative study. If you do only qualitative research, this class will likely not be useful.

  • We strongly recommend that you take our more general, introductory class Measuring UX and ROI before signing up for this course.
  • This class willbe most useful if youeither have run a quantitative study in the past 6 months or plan to run one in the next 6 months.
  • Some fluency with Excel (e.g., knowledge of how Excel formulas work) is highly recommended.
  • Comfort with math and ability touse basic math functions are also highly recommended

Materials Needed

Materials Needed

  • A larger monitor or two monitors so you can easily juggle multiple windows
  • Microsoft Excelshould ideally be installed on your computer. If you don't have Excel on your device, you will still be able to do the activities using the online version of Excel provided in class. Note that usingGoogle Sheets orNumbers won't work forthe activities.
  • Excel function language (for formulas) should be set to English. You may not be able to participate in all exercises if you don't have the English version of Excel.

UX Certification Credit

UX Certification Credit

Attending this course and passing the exam earns 1 UX Certification credit, which also counts towards the optional UX Research Specialty.

Learn more about NN/g's UX Certification Program.

Statistics for UX | NN/g Training Course (1)

Participant Comments

Participant Comments

"Everyone who is looking at numbers from user research should take this class. Researchers, designers, product managers. It drives home the fact that you can't take numbers at face value; you need to figure out if you can trust them. Great class with a fantastic professor."

Patricia Urso, Travelers Insurance, Hartford, CT

"I think this is a spectacular course that should be taken by anyone interested in diving into statistical analysis of UX. This one course probably saved me months of effort self-teaching. Raluca was a very knowledgeable, engaging instructor who was able to provide clear explanations on a wide range of concepts. There was nothing I disliked about the course. In fact, I wished it was longer so I could have learnt more from her."

Melanie, Toronto, Canada

"If you want your team to look at the underlying reasons why a number is the way it is, this is the right course!"

Abdelrahman Gemei, Property Finder

"I have been taking statistics/data analysis courses on other sites that are more generalised. It was SO helpful to learn about it directly through a UX lens. There were examples and connections made that I had never considered."

Kelly Payne, ExperienceLab, London, UK

More Participant Comments

"Learned an amazing amount. This is key for anyone who takes the usability test course. This is important for anyone who is charged with evaluating the impact of UX work pre- and post- enhancements."

Subha Desikan, Western Union

"If you want to dive deep into UX numbers and understand why numbers don't say much by themselves and how you can make them more helpful — this is definitely useful.

P. Lieske, InVision

"The best course so far. She used very simple understandable language."

Naghmeh Nouri

"This is a great course for UX Researchers wanting to get relevant statistical aid in their practice."

Renee, Intuit, California

"Really good refresher on basic statistics: This is helpful in thinking about how to present data to internal stakeholders in product development and process."
"I am happy to be more confident in front of the product manager and team leader when talking about numbers."

Lina Tegel, InVisionAg

"Material covered was very relevant and I'm looking forward to appplying these concepts in my current role."
"Very insightful! I'm not a data person but I do enjoy numbers & learned alot today."

Heidi Roux

"Great course to get clear understanding of how you should approach numbers to make sure you report truthful aud actionable data."

Aleksandra, booking.com

"This course was the perfect level for me working with UX research but without stats background."

Daniel Vincent, SEGA

"The course was really useful, I learned a lot about statistics. It was a bit complicated to understand at the beginning, but it's really valuable in the end. The instructor was also really clear and helpful."

Magali Fatome, Greenpeace International, Amsterdam

"Raluca covered the concepts needed to question, measure and articulate numbers in UX research. She did it in a way that I finally felt confident in my grasp of these concepts and ability to apply them to my practice."

Ginny Hong, Centene, Washington, DC

"This was a harder course for me, since I have no previous knowledge of statistics, but I found Raluca's ability to explain and provide examples extremely helpful. It will take more studying and practical experience to fully grasp the new knowledge acquired, but I'm starting with a very solid footing."

Aime Menendez, Davenport, FL, United States

"This is an exercise/activity heavy course but you benefit from the amount of practical examples used. This is a topic that seems to always confuse researchers but it was explained in a way that made things very clear and easy to understand."
"I would recommend it to those who are entry-level or newer in their role in UX, product management, or data. I was introduced to many concepts I was unfamiliar with, which will help in communicating with my teammates, planning usability tests, and justifying my decisions."

Grant Galtney, Shipt, San Francisco

"I would refer people to this as a great introduction to Stats for UX! I'm already a Data Scientist but in an Operations setting. This course gave me insight into the applications of quantitative data in UX problem domains which is exactly what I was looking for."

Nitin Jain, Brooklyn, USA

"This course was a good review of statistical methods, and an excellent detailed overview of when to apply particular methods to different situations. I will be able to apply what I have learned immediately in my job."

Amanda Muller, Northrop Grumman, Arlington, Viriginia, USA

"It's very challenging to learn new terms but the math isn't especially hard since Excel does all the work. If you stay focused on the logic of it all, you'll be fine."

Jillian Hudson, XPO Logistics, Charlotte, USA

"I understood much better a lot of concepts and learned some new ones. I think its a must-take course."

Joana Marta Laranjeira de Faria Pais, OutSystems, Lisbon, Portugal

"I definitely benefitted from it. I did learn a lot of this material in school, but it was helpful to review it and complete the exercises/understand the case studies. It was also helpful to hear other's questions and learn from them. I think this course is good for beginners as well as professionals."

Ayan Ahmed, Endurance Group, Waltham, MA USA

"Raluca took something that's very complex and always kind of mystified me and made it applicable to what I do as a UX practitioner. I appreciated she was responsive to the comments in real-time as some of the stuff was tricky to understand and it built on itself as we went. Raluca very clearly knows her stuff and, more importantly here, was able to distill it in a way those of us without a PhD could understand. =) If you enjoy doing user research and user testing activities - which I do - and have struggled to understand "statistical significance" - which I have - this course is totally worth it. 💯"

Jason Ober, Promega, Madison, Wisconsin, USA

"If you are familiar with quantitative research and want to level up with the critical analyses applicable to most UX research, this will consolidate a lot of info, and provide resources that are immediately actionable. Great mix of interaction and instruction. Highly recommend."

Mary McInnis, University of Idaho, Moscow, ID, USA

"I think it's so great for someone who wants to get a quantitative perspective on UX. I'm a qualitative researcher and signed up because I wanted a refresher on the statistics I learned in college that would be relevant to future quantitative studies I may run."

Lauren Guldan

"I highly recommend this course for product owners, product managers and user researchers. Before this course I never considered running statistical procedures with my studies, this is very good tools and skillet and mindset to have. I do find this course very difficult tho."

Cheer Huang, Accenture, London, UK

"There is much more behind a number! Good in-depth course about data analysis. Looking forward to apply the learnings in practice. Good follow-up to the course Measuring UX & ROI."

Rémon van den Bergh, Online Department, Rotterdam, Netherlands

"I learnt a lot from this course. Many NN/g courses I've done have been great reinforcement or extension of some knowledge I already had but this one was quite a lot of new ground. Great to have the course so tailored to the kind of activities UX researchers need to do and the answers they need to find."

Keryn Christiansen, Clubware, Auckland New Zealand

"Learned a lot, well structured content. Very helpful class."

Divine Lakshmi, Dell Technologies, Austin

"Best stat course I have taken. Just the right amount of information for ux professionals."

Chloe Benaroya, Manulife, Canada

"Absolutely take it. There is a LOT to learn, but take your time getting to the exam and don't let yourself be intimidated by the subject matter."

Sarah Larkin, Independence Blue Cross, Philadelphia, PA USA

"I already knew it was going to be a very technical course and full of numbers and that was why I signed up :)! I would say that the course did not fall short of expectations, Raluca did an excellent job, considering the difficulty of the subject and even more, taught online. What I like the most about this course is the topic in itself and the knowledge Raluca have shown in this topic. I benefit a lot, because it's a topic that I think most ux-researchers in different companies in different countries don't take into attention. Conducting tests, everyone can do that. conducting tests and interpret the results statistically is another and completely different thing."

João Matos, EY, Lisboa, Portugal

"For the people who talk with numbers and blindly report, It's one of the most beneficial courses to understand numbers and what's behind the scenes."

Hussein, Tremoloo, Cairo Egypt

"I loved this course. It's essential knowledge for anyone analyzing or communicating research data - UX or marketing."

Eileen Thornton, PwC, Tampa, FL, USA

"I definitely benefited from it and would recommend it to a colleague or friend. It covers a lot of the 'mystery' behind what our analytics partners are doing in their mathematical worlds."

Judy Reiter, Cohesive Whole & QVC, Wayne, PA - USA

"Great class! If you're wanting to learn how to really dig deeper, understand and make sure you are looking at the right things in your study."

Jon Möller, Arbetsförmedlingen, Stockholm, Sweden

"This class was extremely useful, but definitely not a beginner level type of course. I loved the quizzes and the types of examples we were given, but I think it definitely will be tested when it comes to real-world application."

Anne C, New York, USA

"If you need to be able to objectively validate the need for UX, this class is a must!"

Mike Sukow, Accenture, Chicago, USA

"One of the best courses I took at NN/g. It is a must for anyone who does research."

Rute Frias, Körber Digital, Porto, Portugal

"I think this was a very helpful, informative course. It was very intense on the statistics, so definitely a more niche course. But if you need this type of content, I'd say it's more than worth it."

Amber, Infotech, Gainesville, USA

"Very interesting - The moderator used real life examples and analogies to understand statistical concepts. Made it really simple to understand and register in my mind. The best out of the 3 classes I've attended. Additionally, the multiple activities on calculations, helped keep my focus and attention."

Zaneta, Nielsen, Dubai, UAE

"This class is an intermediate level, not very difficult, not very easy, but it's good to have some prior knowledge of basics of statistics, it helps with better following the course material."

Elham Beheshti, New York Hall of Science, New York

"This is very engaging course that takes challenging statistics concepts and breaks it down into an easy-to-understand and digestible way. The instructor did a great job explaining the various stats and providing ample examples so the class can understand. It was a tough course, but in a very good way. It refreshed my stats knowledge, and I learned a lot."
"I would tell someone who was thinking of taking this course that it's pretty complex but applying the concepts taught here will give you a new level of certainty when analyzing research data. The tools provided mean you don't have to do a lot of math - you just have to learn which analysis method to apply. This course will definitely level up your research skills and enable you to speak with authority about your findings."

Charles Wyke-Smith, Doxy.me - telemedicine for all, Charleston, SC, USA

"The course is rich in knowledge, examples and varied exercises. It is demanding, but it also brings a lot of satisfaction at the thought of how you can use the knowledge you have learned from it. The best course I've ever been to. Every UX designer should be able to take part in it because it connects many dots."

Kamil, Dynatrace, Gdansk, Poland

"I definitely would recommend this course to anyone who's interested in quant research."

Yakari Van Dessel, Prophets, Antwerp, Belgium

"I would recommend the course to people who run quantitative research or simply just to increase data literacy."

Guannan Li, Alef Education, Dubai UAE

"She opens with the advice that, if you aren't going to do a quantitative study SOON, you probably shouldn't take the course. And she's right. The course is packed with information, but it comes at you like a firehose. Take the Adderall, fill the jug with espresso, lock the door and eliminate EVERY distraction for this class. It's no joke. Hardest one I've taken at NNG by far."

Alison Ruge, Colorado CodeCraft, Denver

"I recommend this course to individuals that wanting a deeper dive into the statistics that UX Designers & Researchers should take into consideration when faced with numbers."

Nic Gray, Optum, Raleigh, NC, USA

"It's a must if you have a role related to UX Research. Learning this context of interpreting quantitative data is key for ones success!"

Aurora Cotto, Abarca Health LLC, San Juan, Puerto Rico

"It will enhance your knowledge in analyzing data."

Rohani Sinambela, Ministry of Finance, Jakarta, Indonesia

"This course will give the tools you need to have a solid quantitive research processes and by critical about data findings, essential for informed decisions."

Diego Parra, Vest Inc, Mexico City, Mexico

"The course introduced me to a lot of new tools and concepts that I perceived will be extremely helpful for me to improve how we look at numbers from now on. I'm eager to start looking into metrics and can't wait to share what I've learnt with the rest of the team."

Tony Low, GovTech Singapore, Singapore

"Highly encourage people who are interested in building their confidence in understanding statistics and numbers for quantitative research methods to attend this course. Even though I was initially worried about not being able to grasp the content, Dr Budiu is amazing at explaining concepts and terms in a way that is easy to digest, and the activities we did were also really practical and useful!"

Liting Kway, Singapore

"I understand the statistics better. I like it that I can get a chance to do the hands-on calculation in Excel myself. I like the quiz in the middle of the course with the elaboration on why a certain answer is wrong."

Nicole Li, Govtech, Singapore

"This course was amazingly helpful - I learned so much and feel better prepared to design, analyze, and share quantitative work."

Rachel Arsenault, WillowTree, Durham, NC

"A must for anyone in the research field! It's another great opportunity to discover how much you don't know! If you want to understand numbers, this is the class for you!"

Simina Megyes, Bitdefender, Timisoara, Romania

"The most difficult course I've ever taken through NN/g. Wow! Very impressed with Raluca's ability to teach such difficult concepts."

Amy Allar, Pennsylvania Interactive, NIC Division of Tyler Technologies, Harrisburg, USA

"It's dense. It's brilliant. It's a terrific accompaniment to Quantifying the User Experience which is a book I suggest to a lot of people. Be prepared for a bit of overwhelm, and then settle back into the cheat sheets that make it easy to flow through which experiments to use and how to easily determine statistical significance."

Meghan Dove, MDove Design, Montreal

"It is a very good introduction course to quantitative analysis of data, but is not appropriate for advanced quantitative researchers."

Guillaume Mallette-Vanier, CBC / Radio-Canada, Montreal

"Really important information for anyone who reports on quantitative studies/results! Numbers and statistics are all too often thrown around and used to justify UX decisions that they don't really back up, and this course really shows you why that is a problem and how to avoid it."

Anne Cremin, Parliamentary Digital Service, London

"A must for anyone who conducts user research! In the search for true scores you don't want to be wrong in your approach or interpretation. And unless you take this course you just might be!"

Bill Bone, Welsh Government

"The information and resources provided in this course enables those of us that are not statisticians to be able to support our research using statistics and understand the importance of doing so."

Karen Young, UPMC, Pittsburgh USA

"This course is fantastic. For people with little knowledge in statistics as me it was enlightening!! Raluca is a very good and patient speaker."

Natalile Galindo

"Really strongly recommend people who are performing and communicating UX research to join this course. The course does a really excellent job breaking down the core statistical concepts we need to consider and calculate when working the the numbers. I really liked how the course explained the different types of metrics and provided resources (Excel & online) that can be used to perform the necessary calculations and how we could best communicate them to stakeholders."

Scott Rippon, Kmart Australia, Melbourne, Australia

"Before this course, I was analyzing data and presenting numbers, but I was honestly just going with my gut when it came to statistical significance. (Sounds terrible, but it's true!) Having taken the course, I can obviously now calculate statistical significance, but perhaps more importantly, I also have a bunch of cheat sheets and course materials that I can refer to later. I have a feeling that some of the things I learned are going to leave my noggin at some point, but I feel confident that I have everything I need to refresh my memory."
"I highly recommend taking the course if you plan on running a quantitative study in the near future."

Jenna Martin, iCircle, Rochester, New York, USA

"Love how practical and informative this course is!!"

Miaoxin Wang, Seattle, United States

"I would strongly encourage my colleagues who want to learn more about quant studies, especially experiment designs and how to properly report numbers and explain them to stakeholders, to take this. No hesitation. No dislikes. Extremely impressed with the takeaway screencasts, which was a huge added bonus and the calculators!"

Emily Yang, Mach49, Singapore

"I love that it both validated things I already knew (but didn't know I knew or couldn't express) and provided a host of new information that will increase my confidence in the future."

Mary Aviles, Detroit Labs, Detroit United States

"Loved the exercises, very practical and helped a lot understand many things. Videos as future reference are amazing and the quizzes should be a must have in all classes, super helpful to understand where you need to improve and internalize particular concepts!"

Camila Belmonte, IBM, Sao Paulo, Brazil

"Out of all the courses I have taken so far, How to interpret UX numbers is the course I would recommend by far. The amount I learned from Raluca during the session is really quite amazing. Her ability to easily explain such complex topics in an easily digestible way is incredible."

Braden Buchanan, Roche, Indianapolis

"The last time I learning statistics was 10 years ago, but this statistics specific for UX could immediately gathering all the methodology and mathematical back, just keep been a number detectives and you can't find there's anyone else teaching statistics the way as NN/g does!"

Yvonne Lee, Psychological therapy center, Taiwan

"Don't be afraid of numbers. It's the understanding or interpretation that counts — sorry for the pun."

Helen Oake, The National Archives

Instructors

Instructors

Caleb Sponheim

Caleb Sponheim Ph.D. is a User Experience Specialist with Nielsen Norman Group. A former computational neuroscientist, his expertise includes quantitative user experience research, statistics, analytics, and data science.

Raluca Budiu

Raluca Budiu is the Senior Director of Data Strategyat Nielsen Norman Group, where she uses her data-analysis expertise to drive strategic decisions. She consults for clients from a variety of industries and presents tutorials on mobile usability, designing interfaces for multiple devices, quantitative usability methods, cognitive psychology for designers, and principles of human-computer interaction. She also serves as editor for the articles published on NNgroup.com. Raluca coauthored the NN/g reports on tablet usability, mobile usability, iPad usability, and the usability of children's websites, as well as the book Mobile Usability. She holds a Ph.D. from Carnegie Mellon University.

Statistics for UX | NN/g Training Course (2024)
Top Articles
Latest Posts
Article information

Author: Tish Haag

Last Updated:

Views: 5885

Rating: 4.7 / 5 (47 voted)

Reviews: 86% of readers found this page helpful

Author information

Name: Tish Haag

Birthday: 1999-11-18

Address: 30256 Tara Expressway, Kutchburgh, VT 92892-0078

Phone: +4215847628708

Job: Internal Consulting Engineer

Hobby: Roller skating, Roller skating, Kayaking, Flying, Graffiti, Ghost hunting, scrapbook

Introduction: My name is Tish Haag, I am a excited, delightful, curious, beautiful, agreeable, enchanting, fancy person who loves writing and wants to share my knowledge and understanding with you.