Skip to content
A picture of Urska
Urska
User researcher

15 min read

Follow Paper on LinkedIn

User research with key workers in the pandemic

It’s now a year since the UK went into its first lockdown and we are still fighting COVID with social restrictions and now thankfully with the national roll out of vaccines. Although we all entered the new year with optimism the first months of 2021 have been anything but easy.

We are all going through this in different ways but it’s all happening in the present time, this means we have to react quickly so it’s important that we plan for different possibilities, opportunities and outcomes. However even doing all of that there is always a possibility of what is an ok plan today might change and not be an ok plan tomorrow.

I want to talk about my personal experience of being a user researcher on a project whose main users are school workers (key workers). How we tackled research through school closures, lockdowns, restrictions, tiers and the pressure of a ministerial commitment to offer the service to the schools in September.

My colleague Beth has written an article about our experience of recruitment in the pandemic throughout this project.

The project

The Buying for School project is where we work with the Department for Education (DfE) to help schools, more specifically people who are responsible for buying in their schools or trusts also known as School Buying Professionals (SBPs) get better procurement deals for their schools. We were particularly focusing on bigger procurements like cleaning, catering, construction and ground maintenance. Our main users SBPs were busy with COVID restrictions (school closure, COVID testing, remote schooling, extra cleaning and purchasing of PPE) on top of their normal overwhelming amount of work. With that in mind we knew there wasn’t really any time for SBPs to also squeeze research sessions into their schedule by default. Yet that is exactly what we had to do.

Preparation

Our project started in July last year when we were already working from home and therefore we knew that we will need to be considerate to the current and unknown environment and how it affects our research and more importantly our users.

We started with desk research as we wanted to be aware of how we can support, help and limit the burden on people who are participating in our research as well as being mindful of our researchers’ wellbeing too.

We wanted to also inform ourselves about what are the potential biases, signs and reactions that could reflect current situations and not peoples pre-covid reactions. We had to make sure we could take that into consideration when we are presenting the insights back to the team and using them to develop our service.

From the desk research we came with this guidance that we used throughout our research sessions:

Safeguarding

We have done and keep on doing our best to create a safe as possible environment for our research participants.

We have done this by:

  • Letting participants know that we can stop the research at any point
  • Inform participants that they don’t have to answer any questions that they don’t want to answer
  • We always inform participants that our session is not a test
  • We will ensure their anonymity by pseudonymising everything they say in our notes and recordings to ensure their privacy

Researchers wellbeing

We can’t forget about our own wellbeing as well. Is not easy to be a user researcher and we too often neglect our own needs and limits. It’s not just our users that get affected by the current environment, we all are living through this and coping in different ways. That’s why more than ever we need to make sure that we feel we are ok to conduct the research sessions.

These are the things that we took into a consideration around our wellbeing:

  • Research is not an individual but a team sport

    There should be 2 people from the team in every user research session. One observing and one (User researcher) facilitating the session

  • Researchers who are facilitating should always feel that it is ok to say that they don’t feel like they can facilitate the session

    Facilitation is not easy and takes a lot of energy. We have to make sure someone doesn’t put the pressure on themselves if they don’t feel they have the headspace that day. We always made sure that facilitation was equally spread out between the two researchers that were on the project.

  • Regular check ins with each other

    We made sure that we check in with each other every day to see how we are and what do we need from each other or our work environment

  • Rest time between sessions

    On days where there are research sessions we don’t participate in any other meetings, we make sure that the facilitator role in sessions is changing between two researchers. When the researcher isn’t facilitating we make sure they are resting away from sessions and ask someone else from the team to observe.

  • Saying no

    It is hard but is important for our well being to say no and stick to what was agreed in our research plan that was prepared within the time limits. There will always be something more the team or stakeholders would want to gain from the user research which is good as they are prioritising the users and their needs. However that does not mean that user researchers need to take everything into account and do it straight away. Research takes time. We need to be more firm of what we can and can’t do. I definitely know I should be doing a better job in saying no more often.

COVID-19 Biases

Biases are constantly present not just in our research but also in our life. We have been monitoring what potential biases we have observed in the research sessions:

  • Uncertainty of the future
  • Feeling that they have less control over their lives
  • Prioritisation and attention span might be affected by COVID-19
  • May be more emotional and worried
  • Might be experiencing extreme isolation or be under extra pressure (additional work, child care, care for relatives and friends)

We always have a debrief with the facilitator and observer after a research session, where we always ask ourselves if the participant has shown or mentioned anything that would or could be an effect of, or reaction to, the current environment.

We capture COVID-19 related biases through all our research sessions which helped us to have better understanding of our users and their lives in the current environment as well as make sure that we can monitor that we are supporting them and what we could potentially do better in upcoming research sessions.

Research

Methodology

The first thing we had to consider was what methodologies of research would be appropriate for conducting our research and in that we have considered 3 elements:

  1. The needs of our project

    Our service is a service that would be used to support its users for a longer period of time and couldn’t be used and completed in one sitting. That means that we had to consider longitudinal studies as our preferred methodologies for our project.

  2. The guidance and regulations that we got from DfE

    DfE policy was to not increase the workload of school workers any further or burden them. That meant shorter contacts, less emailing back and forth, the time of engagement with the participants.

  3. The availabilities of our users to participate in our research

    With the new workload and overwhelming existing workload the time that our participants could give was already limited and we needed to take that into consideration, think about what time would be most appropriate and how we can offer them options of times that would work with their busy schedules.

We decided on a methodology of 45 minute remote interviews (user research or usability testing) at a users preferred time (we offered a time slot from 8:00 in the morning to 20:00 in the evening and Calendly was a great tool we used for sessions booking).

The decision wasn’t the best for the requirements of our project however the need of our users and DfE guidance informed the chosen methodology for our project.

Research Death

Because of the COVID-19 environment we were aware that we were limited in user research and testing methodology (as mentioned above). In order to avoid research death (things that we know we are required to do but couldn’t do because of the current environment) we decided on the following processes that will mitigate the situation.

  1. What is asked of us to do

    What we would need to do if we wouldn’t be in a covid environment.

  2. What are the restrictions we need to consider that will affect what we needed to do

    Have an awareness of research that is at risk of not being done because of COVID-19, for example, research with people who have lower digital inclusion or have digital accessibility requirements can be harder to obtain

  3. How are we mitigating them

    See what research can be adapted to research currently being done

  4. What is going into the backlog for future research because it couldn’t be researched in the current environment.

    Capture research that couldn’t be done or had to be adopted for later sprints or phases of the project based on how the situation evolves.

Research methods and tools we have used

We had our research methodology, we knew what we could and couldn’t do, so then it was time to put it into the research guidance. We wanted to make sure we aren’t burdening people, even more as well as to make sure that they weren’t too busy and just being too polite to say no to our research request. We also needed to make sure that people knew that we can end the session at any time with no further explanation if we feel that is best for us and / or them.

We included this into our research guide and prepared a check in that helped us make sure we checked in on participants wellbeing in between our sessions.

Check in and check out

At the beginning of our session we checked in with our participants by first of all thanking them for agreeing and taking their time to participate in our research. We told them how valuable it is for us to speak to them and that our priority in the session is their time, wellbeing and their frame of mind. We reassured them that they weren’t being tested, and could end the session at any point without any reason needed (that goes for us as well), and that we hoped they were feeling safe speaking to us. We also reassured them that we could listen if they needed or wanted to share with us, but we couldn’t offer advice as we aren’t experts and can only offer our understanding for the current situation of schools and the pressure they may be facing. After this we asked them if they would be willing to check in with us. We repeated a similar process at the end of our session asking them how they were feeling to assess how we were leaving our participants.

Adjustments to the testing

Because all of the sessions were conducted remotely we had to rely on participants’ technology. Luckily our users had adjusted to remote working themselves so the technology and programs that they were using were able to accommodate our sessions needs. When it came to the core part of our sessions (parts where we looked at or tested the service we were working on) we made sure we took parts of the service to test in a time that we could still get insights from the 45 minutes long sessions. We were aware that our service would be used for a longer period of time and none of our users could go through the service in only a 45 minutes time frame.

There was still a project need of longitudinal studies which we tried to mitigate by asking the participants who we had already spoken to if they would be willing to stay in touch with us for further longitudinal studies. We only asked if they had self expressed an interest to keep being involved in our research.

We are aware of the risk of having people who have already been involved in our studies back. The situation is not the best and we are still looking for a better solution for how we can engage with people in longitudinal studies without burdening them or interacting with people who we spoke to already. This is our current plan, but as I said previously - we currently live in an environment where today’s ok plan can not be an ok plan tomorrow and this one is definitely a work in progress.

Our insights:

Our project is still ongoing and we are learning everyday. It’s not been easy, especially because there is more time spent on planning and preparing different scenarios. However I have always enjoyed a challenge and I’m enjoying working on a project where there are so many different aspects that we need to consider through our project.

We now focus more on:

  1. Planning Different scenarios, of what could happen and what can we do with different options that we have at our disposal

  2. Put mindfulness and people’s wellbeing at the highest priority No matter what, our highest priority is still our users and us. Theirs and our well being comes first and it always did, but now even more than ever.

  3. Tracking We track and record what is happening. When we make a plan we go through the plan at the end of our research cycle to check what worked, what hasn’t worked to know how we can improve things and be better prepared for the next round of research and recruitment.

  4. Mitigating If something can’t be done right now we note it down with what we tried to do and what we have gained from that. This way things don’t get lost and can be looked at when there is an opportunity to do so. We remind ourselves that it is ok if we couldn’t do everything, we didn’t brush it under the rug, and we are open about what we could and couldn’t do in our recruitment and research.

As I have mentioned, this is still an ongoing project and we are learning every day. As much as research in the current environment is challenging, I personally enjoy seeking out different ideas, plans, scenarios and preparing how we can still go forward and as well learning when we need to pause, rethink and make sure we are doing the best for our users and ourselves.

A big part of why I personally feel we can do this is because there is an amazing team that I’m lucky enough to be surrounded with. Although I’m writing these words it is our team effort, work, and passion that produced the essence of this post. Shona - Thank you for being such an amazing team member. I know it wasn’t the easiest of times but I’m extremely grateful and honoured to be working with you. The thank you is not excluding other team members (Beth, Kath, Dave, Jag, Faye, Quay, F, Pete, Rhianna, Hans, Tom, Nick, Lorna, Cam, Mark, Jon, Rachael, Tom Adams and Charly) who have all been amazing and supportive of us and hopefully we of them. Thank you all from the bottom of my dark heart - it truly grew two sizes while working with all of you (there is still some leftover Christmas spirit in me that needs to get out).

I hope that this post will be helpful for other user researchers and hope we can learn from each other therefore please don’t hesitate to get in touch if you want to speak about research in COVID times with us. As well as mentioned at the beginning of the post if you want to learn more about recruitment in COVID times please see Beths article on the topic.