Why Screen Size Matters for Doing Behavioural Research Online
Using recent sample UK online panellists (N=3810), we analyse the most popular screen sizes and discuss possible impact of screen sizes on designing and conducting online behavioural research
There is a number of elements that needs to be considered for building experimental protocols and successfully conducting behavioural experiments online. Some of those elements may have impact on the internal validity of your research studies and possibly reduce noise in data.
Undoubtedly, there are key elements of experimental protocol such as participation fees, randomization, length of the study, stratifications or choice of online panel provider etc. However, some of elements may be hidden though their importance should not be underestimated. One of those elements is a screen resolution of participant’s PC, laptops, tablets and other devices on which experiment is going be completed. Knowing screen sizes may help to improve internal validity of the experiments and get stronger effects.
Screen resolution defines how much actual space if visible to participants on the screen. Image below demonstrates the difference on how many elements of the same size (like images or lists of questions) fit to 2 screens with different screen resolutions. We are not talking about really small screen resolutions that are used on older computers. Here we show the difference for 2 of the top 5 most popular screen resolutions.
Figure 1. Screen Resolution and Look of an Experimental Page
One of the important implications of the difference in the screen size is the time needed for completing experimental page (text) and the way the information on the page is processed by your participants.
It has been already demonstrated that the time needed to complete reading or answering page increases when there are less words visible (Creed, Dennis, & Newstead, 1988; de Bruijn, de Mul, & van Oostendorp, 1992; Reisel & Shneiderman, 1987) and processing of text is enhanced on large screens (de Bruijn, de Mul, & van Oostendorp, 1992; Dillon, Richardson, & McKnight, 1990)
Lower screen resolution requires more time to read
Finally, knowing screen resolution of the participants of your online panel may assist you in adapting the design of the study and potentially improving internal validity by understanding what exactly participants of your experiment will see on their screens.
Since information about screen resolutions of participants of online panels is not readily available (I would not be surprised if it is not recorded in general), we have decided to share some insights on what screens people in UK use for completing online experiments and surveys for 2 different panel providers in United Kingdom. The data comes from the online study completed in the Summer 2014 in UK (N=3810)
The majority of the UK online panellists have 1366 wide by 766 pixel height screen resolutions (see Figure 2). One of the possible explanation is that Microsoft Windows 8 is optimized for exactly this resolution. Figure 4 demonstrates the fact that Google Chrome is the most preferred Internet Browser for participants of our experiment, however the number of Chrome users is not that far from Internet Explorer users. Firefox is holding 3rd place.
Figure 2. Mapping of the Most Popular Screen Resolutions Among UK Online Panel Participants (Darker – more popular)
Figure 3. Most Popular Screen Resolutions Among UK Online Panel Participants, Share
Figure 4. Most Popular Internet Browsers Among UK Online Panel Participants
Our data is comparable with global stats that are collected by W3School (From Wikipedia: W3Schools is a web developer information website, with tutorials and references relating to web development topics such as HTML, CSS, JavaScript, PHP, SQL, and Jquery) about dominant screen resolution of general global population.
Knowing screen resolution and adapting layout of experimental page accordingly is important. However, browser window is another important aspect to keep under control in the experiment. Some (including myself) simply do not keep windows of different programs including Internet browsers maximized to the full width and height of desktop. Instead, browser’s windows occupy just a fraction of the desktop space. Figure 5 below demonstrates the impact of reduced browser window on the layout of the experimental page with images and questions.
Figure 5. Internet Browsers Open at 100%, 75% and 50% Width of Desktop on the Most Popular 1366×768 Screen
The key message is quite simple. If you plan to conduct an experiment or behavioural study using online panel, it is it worth adjusting the design of your experimental pages and questionnaires to the currently dominant 1366×768 screen resolution for both Windows and Mac computers.
Moreover, for all the studies that our team runs, we recommend not only adjusting design of the experimental pages to dominant screen resolutions, but also enforce minimal width of the Internet browser window to have more comparable experience of participants of online panel.
Need any advice and recommendations from our technical team – just get in touch with us (here) and we will be happy to answer your questions on how to make these screen resolution checks and browser adjustments for your experiments.
Uri Gneezy is Renown scholar in individual decision-making and behavioral economics fields the Epstein/Atkinson Endowed Chair in Behavioral Economics and Professor of Economics & Strategy at the Rady School of Management, UC San Diego
Uri Gneezy is Renown scholar in individual decision-making and behavioral economics fields the Epstein/Atkinson Endowed Chair in Behavioral Economics and Professor of Economics & Strategy at the Rady School of Management, UC San Diego The Barcelona Graduate School of Economics, commonly referred to as Barcelona GSE, is an independent institution of research and graduate education located in Barcelona, in Catalonia, Spain. Banco Sabadell is the fourth-largest banking group funded by private Spanish capital. It includes several banks, brands, subsidiary and holding companies spanning the whole range of financial business.
Video presentation of the key design features of the project “Study on online gambling and adequate measures for the protection of consumers of gambling services”
Expilab has found its new independent home, inheriting the expertise and team from Gravitas Research's Behavioral and Experimental Research group. Reflecting on our journey, including significant projects like NHS Choices with top institutions, we're proud of our growth and achievements. Last year, Expilab conducted large-scale experiments for the European Commission, engaging over 30,000 participants across 13 EU member states. Now, as a smaller, more flexible team, we look forward to innovative research and engaging with you through our new website and blog. Join us in exploring the future of behavioural research.
After the announcement of WhatsApp on its new terms of use of users’ data, we feel that somehow full transparency of privacy concerns is not always the best strategy to gain credibility.
How companies can increase personal data consent? Consumers’ reluctance to reveal their personal information is primarily triggered by the lack of adequate info, so companies can address that by providing clear and direct information of destination and purpose of data collected.
Movers & Shakers interview with Dr. Heather Kappes (LSE) about how people spend, what economic research and economic experiments have taught us, and which research findings might be relevant for post COVID19 life.
“Game of Life”, an interactive spending game played at Science Museum (London) build by Expilab investigates how and why we spend our money the way we do
The European Union (EU) began the implementation of the GDPR (General Data Privacy Regulation) in May 2018 with the aim of developing a legal framework that provides more control over the use of personal data obtained through online services or databases. Today, the discussion has begun in countries such as Brazil with the aim of providing users with greater security and knowledge of their actions, and to avoid repeating episodes such as Cambridge Analytica and Facebook
La Unión Europea dio inicio a la implementación del GDPR (General Data Privacy Regulation) en mayo de 2018 con la que busca crear un marco jurídico que brinde más control sobre el uso que se dan a los datos personales obtenidos a través de servicios en línea o bases de datos. Hoy en día, se ha iniciado la discusión en países como Brasil con el objetivo de brindar a los usuarios mayor seguridad y conocimiento de sus acciones en el tema y a su vez, evitar que se repitan episodios como el de Cambridge Analytica y Facebook.
This article presents the results of a laboratory experiment and an online multi-country experiment testing the effect of motor vehicle eco-labels on consumers. The laboratory study featured a discrete choice task and questions on comprehension, while the ten countries online experiment included measures of willingness to pay and comprehension. Labels focusing on fuel economy or running costs are better understood, and influence choice about money-related eco-friendly behavior. We suggest that this effect comes through mental accounting of fuel economy. In the absence of a cost-saving frame, we do not find a similar effect of information on CO2 emissions and eco-friendliness. Labels do not perform as well as promotional materials. Being embedded into a setting, which is designed to capture the attention, the latter are more effective. We found also that large and expensive cars tend to be undervalued once fuel economy is highlighted.
Our approach combines the power of Behavioural Science and Human-Centered Design to craft innovative products and experiences that resonate with what people truly want and need.
Get started now: Share your ideas for a no-obligation and friendly chat with us!
We deliver end-to-end 360-degree research solutions, managing everything from programming complex behavioural experiments to recruitment of participants and statistical analysis.
Tell us how we can help you. We can confidentially discuss your ideas without any obligations from your side!
Do you need participants for your experiments? We have access to 100M+ participants (panelists) from 100+ countries in the world.
assist@expilab.com
