WEBVTT Kind: captions; language: en-us NOTE Treffsikkerhet: 86% (HØY) 00:00:03.700 --> 00:00:11.450 Okay, and here we are. So I can't see you at the moment so just interrupt me when I'm too fast 00:00:11.450 --> 00:00:17.600 or when things go wrong or you've got a question or whatever. Yeah, please do. So we're going to 00:00:17.600 --> 00:00:22.600 talk about literature and we've got two lectures and somewhere in between will stop. But because I'm 00:00:22.600 --> 00:00:29.900 not sure how fast we go I just combined the handouts. So literature reviews 00:00:29.900 --> 00:00:34.050 what we're going to talk about. We are going to talk about -- I'll give NOTE Treffsikkerhet: 82% (HØY) 00:00:34.050 --> 00:00:40.100 quick update, introduction different literature reviews -- that different types, different sorts, 00:00:40.100 --> 00:00:45.000 we willtalk about the difference between a literature review 00:00:45.000 --> 00:00:50.900 versus or narrative versus a systematic review, because systematic review is really something 00:00:50.900 --> 00:00:58.000 special. We talk about the literature databases, how to perform systematic searches, and we talk 00:00:58.000 --> 00:01:03.750 very briefly about that when we talk about this seminar NOTE Treffsikkerhet: 87% (HØY) 00:01:03.750 --> 00:01:09.500 and how to report on reviews. This is all for today and I hope to finish this in two lectures, but I 00:01:09.500 --> 00:01:17.300 think we're fine. So let's start with what is actually a literature review. Well, it's been 00:01:17.300 --> 00:01:23.600 there for a long time. And the reason is, of course, that we publish more and more and there's no 00:01:23.600 --> 00:01:29.200 way keeping in touch with all the literature. So summaries like literature reviews are quite 00:01:29.200 --> 00:01:33.800 useful. I use them a lot. Now, if I look at Wikipedia, NOTE Treffsikkerhet: 82% (HØY) 00:01:33.800 --> 00:01:39.300 which you're not allowed to do but we all do, is a literature review, is a scholarly paper. 00:01:39.300 --> 00:01:46.400 It summarizes the current knowledge and it is as well theoretical and methodological contributions to 00:01:46.400 --> 00:01:51.800 a particular topic. Well fine, what you need to know however, its secondary sources because you 00:01:51.800 --> 00:01:59.100 don't do something new, you summarize existing or original research, but many of us use literature 00:01:59.100 --> 00:02:03.750 reviews as a basis as always. Also, when you for instance, you write a NOTE Treffsikkerhet: 87% (HØY) 00:02:03.750 --> 00:02:09.800 an application, a grant application, you've got this introduction and it's so easy to refer to 00:02:09.800 --> 00:02:15.000 reviews that actually summarize the knowledge in a certain area ''because of all the prevalence of this 00:02:15.000 --> 00:02:23.000 problem is blah'' or ''the most frequent interventions are this''. And then it's good to refer to 00:02:23.000 --> 00:02:32.000 recent reviews, not old ones, you need recent ones. Okay. So why do we do systematic reviews? 00:02:32.000 --> 00:02:33.750 So what does it do? There are many NOTE Treffsikkerhet: 85% (HØY) 00:02:33.750 --> 00:02:41.400 different reasons why a literature review can be useful. It can be for identifying gaps in 00:02:41.400 --> 00:02:48.600 knowledge. You don't want to reinvent the wheels. If someone already did it, why would you reinvent 00:02:48.600 --> 00:02:53.800 it and do it again? Unless there is doubt about it and you want to make sure that you can confirm 00:02:53.800 --> 00:03:03.250 results. It builds a knowledge database. If you want to know about who's doing work in my area... 00:03:03.250 --> 00:03:03.750 As you can see NOTE Treffsikkerhet: 82% (HØY) 00:03:03.750 --> 00:03:11.000 there is a lot out there. But again, usually literature reviews are used like if you want 00:03:11.000 --> 00:03:18.500 to have a summary of what's out there in a certain area, or as basis, for instance, for your master 00:03:18.500 --> 00:03:25.100 thesis, or for a research proposal, because you can't just start writing, you need to know what's out 00:03:25.100 --> 00:03:32.600 there. There's too much literature. There's no way of keeping up with the explosive development of 00:03:32.600 --> 00:03:34.450 the research at this moment. NOTE Treffsikkerhet: 79% (HØY) 00:03:34.450 --> 00:03:40.300 Now this is level of evidence. You will see this more often. It's different study designs. 00:03:40.300 --> 00:03:44.300 Again, we will talk to hours just about study designs. NOTE Treffsikkerhet: 75% (MEDIUM) 00:03:45.300 --> 00:03:53.100 Then as you can see, at the bottom of level, the lowest level of evidence is case report or case series 00:03:53.100 --> 00:04:00.150 or multiple case series. It is actually not a real design. It's just report on one or more 00:04:00.150 --> 00:04:07.100 patients are children. Can be interesting, but it is low level of evidence. If we look at the next step 00:04:07.100 --> 00:04:14.900 is observational studies, could be a whole cohort or you want to observe all students from born in 00:04:14.900 --> 00:04:15.650 1963 or whatever, NOTE Treffsikkerhet: 91% (HØY) 00:04:15.650 --> 00:04:23.100 it's a big group or you just want to observe two groups; typically developing 00:04:23.100 --> 00:04:29.600 versus an intervention group or just actually intervention group and observation group, one is 00:04:29.600 --> 00:04:35.700 student smoke and one group is students not smoking, but you are not really intervening, whereas 00:04:35.700 --> 00:04:41.600 these are more the experimental ones, the randomized controlled trials, but also you've got that, 00:04:41.600 --> 00:04:45.550 the secondary literature. Meaning, the secondary NOTE Treffsikkerhet: 91% (HØY) 00:04:45.550 --> 00:04:52.400 research is it's based on original research by others. And that is the systematic reviews. And if you 00:04:52.400 --> 00:04:58.700 do, for instance, systematic reviews on the highest level of evidence that is RCTs, randomized 00:04:58.700 --> 00:05:04.549 control trials, you can perform something like meta-analysis. We talk about that later. 00:05:04.549 --> 00:05:13.100 Meta-analysis is you combine smaller studies. You try to combine them and rerun their stats to 00:05:13.100 --> 00:05:15.500 come up with an overall answer. NOTE Treffsikkerhet: 90% (HØY) 00:05:15.500 --> 00:05:21.600 You've got five studies, two are in favor of your intervention, three are not, you combine the data, 00:05:21.600 --> 00:05:28.500 Meaning if there are more participants involved that will weigh heavier. You combine the data and 00:05:28.500 --> 00:05:35.400 rerun stats, that is actually meta-analysis. 00:05:35.400 --> 00:05:41.100 Now, on top of that you've got clinical 00:05:41.100 --> 00:05:45.400 guidelines or practice guidelines and they are NOTE Treffsikkerhet: 91% (HØY) 00:05:45.400 --> 00:05:50.500 based on what's out there and very often they are based on the best reviews there are. So this is 00:05:50.500 --> 00:05:56.300 the whole pyramid of levels of the evidence, the higher, the stronger, the evidence from that 00:05:56.300 --> 00:05:58.100 research. NOTE Treffsikkerhet: 91% (HØY) 00:05:58.200 --> 00:06:06.000 Okay. So these are the primary studies. As you can see, it's the observational studies but also the 00:06:06.000 --> 00:06:14.900 ICT's etc., and on top you've got the secondary or filtered research. Now, how do you do a 00:06:14.900 --> 00:06:20.100 review? This is the quick and easy bit, you see you choose a topic. That's number one. Number two, 00:06:20.100 --> 00:06:25.900 you identify your databases and resources. You need to refine your search. You search, you refine a bit, 00:06:25.900 --> 00:06:27.299 you read, you write. NOTE Treffsikkerhet: 71% (MEDIUM) 00:06:27.299 --> 00:06:33.200 Alright, that's very quick and easy. In real life it's a little bit more complex. You've got your 00:06:33.200 --> 00:06:38.700 question. Then you need to have a look at how does that work within my discipline? Because 00:06:38.700 --> 00:06:46.550 if you do a review in speech-language pathology that will be very different than a review in mathematics. 00:06:46.550 --> 00:06:52.400 So it really depends on your discipline. You need to search literature 00:06:52.400 --> 00:06:57.299 but also within your discipline you need to identify which databases NOTE Treffsikkerhet: 91% (HØY) 00:06:57.299 --> 00:07:03.300 are relevant. There are hundreds of databases. If you are more in the Medical Sciences, you always 00:07:03.300 --> 00:07:09.650 use PubMed and MBase, but if you are more in education, you may want to use things like ERIC or 00:07:09.650 --> 00:07:16.200 sometimes Web of Science, depends. So it really depends. And how do you know which 00:07:16.200 --> 00:07:22.200 databases are useful? One way of looking at it is look at reviews in your area. What databases 00:07:22.200 --> 00:07:25.350 they used when they did systematic reviews? NOTE Treffsikkerhet: 80% (HØY) 00:07:25.350 --> 00:07:31.400 And then you need to manage your references and that is where endnote or other reference programs 00:07:31.400 --> 00:07:39.500 come in. If you do a review, I strongly suggest to use a reference software program. But again, I 00:07:39.500 --> 00:07:44.600 know some of you won't but I really, really would suggest you do it because it is you spend some 00:07:44.600 --> 00:07:50.800 time at the beginning. But in the end, you'll win so much time. It's so much easier, using endnote or 00:07:50.800 --> 00:07:55.350 something like that, linking it to your word document and you do not need NOTE Treffsikkerhet: 84% (HØY) 00:07:55.350 --> 00:08:02.100 worry anymore about moving references because it all is automated. Once you've got them in your 00:08:02.100 --> 00:08:10.600 in your reference software program, it's so easy to include, insert, 00:08:10.600 --> 00:08:17.600 manuscript or delete or move around. It's so easy. Really I can't tell you how much property 00:08:17.600 --> 00:08:24.050 will have from that. And then so you've done your rewiev, you've got your endnote, whatever you take... 00:08:24.050 --> 00:08:25.250 You need to do NOTE Treffsikkerhet: 90% (HØY) 00:08:25.250 --> 00:08:32.200 a critical appraisal of your literature, which means you use a so-called CAT, critical appraisal 00:08:32.200 --> 00:08:38.600 tool. And we talked about that during another lecture and CATs are meant to evaluate the 00:08:38.600 --> 00:08:45.700 methodological quality of your articles. If an article is weak, it's got bias, it's got problems in 00:08:45.700 --> 00:08:52.600 the methods... You actually are not interested in it's outcome, so you excluded from your synthesizing 00:08:52.600 --> 00:08:55.300 the literature. And synthesizing could NOTE Treffsikkerhet: 87% (HØY) 00:08:55.300 --> 00:09:01.350 be narratated but it also could mean that's why they are meta-analysis are, if you were to do that. 00:09:01.350 --> 00:09:08.400 Then finally, you need to write up. This is still pretty quick and easy, but we also got these 00:09:08.400 --> 00:09:14.300 evidence-based practice circles and it's kind of overlapping with what we do. You acquire, you 00:09:14.300 --> 00:09:20.800 appraise, you apply and you analyze, you will see these five steps of evidence-based, practice more 00:09:20.800 --> 00:09:25.200 often. It's all a bit related. Just to let you know that the review NOTE Treffsikkerhet: 83% (HØY) 00:09:25.200 --> 00:09:33.600 is not quick and easy. Okay. Now if you talk about terminologies, these are just some terminologies 00:09:33.600 --> 00:09:38.400 and are way more and it's very confusing. So we're are going to have a little bit of a talk about 00:09:38.400 --> 00:09:43.950 that but I'm not gonna explain all these different terms. If you want to know which term means what 00:09:43.950 --> 00:09:49.500 there is a lot of research out there, but I'll give you the main differences that you need to be 00:09:49.500 --> 00:09:55.300 aware of when talking about reviews. So let's move on to different NOTE Treffsikkerhet: 91% (HØY) 00:09:55.300 --> 00:10:00.900 yypes of literature reviews, because that is important to understand the difference 00:10:00.900 --> 00:10:09.200 between systematic reviews or narrative, etc. Now, this time? Melissa: Just really 00:10:09.200 --> 00:10:19.400 quickly about your cycle of synthesis. So, I read an article and part of the participants had 00:10:19.400 --> 00:10:25.200 to undergo an exam for literacy and then they NOTE Treffsikkerhet: 84% (HØY) 00:10:25.200 --> 00:10:34.200 omitted a group of kids who scored lower than what they expected. Would you consider that review to 00:10:34.200 --> 00:10:42.500 be a little bit skewed? Renee: I think what you're saying is, if you perform a review, you 00:10:42.500 --> 00:10:52.600 usually define your in and exclusion criteria, if I do a review on children with a ADHD, then I 00:10:52.600 --> 00:10:55.400 probably will say well, I'm only interested in a certain NOTE Treffsikkerhet: 78% (HØY) 00:10:55.400 --> 00:11:03.500 age limit, kids between six and twelve, or I'm only interested in kids in Norway. So it is normal, 00:11:03.500 --> 00:11:09.250 because otherwise you will be swamped by literature. You've got a number of inclusion criteria 00:11:09.250 --> 00:11:16.100 and exclusion criteria. So that is okay. What you don't want is that you've got too many 00:11:16.100 --> 00:11:22.200 hits, like you've got a hundred articles. That's really too much. You will be swarmed, or that 00:11:22.200 --> 00:11:25.250 you are so rigid in your exclusion criteria NOTE Treffsikkerhet: 90% (HØY) 00:11:25.250 --> 00:11:30.500 that you end up with less than 5, which is well, that's too little. So it depends on the 00:11:30.500 --> 00:11:37.599 area, but you always formulate your in and exclusion criteria. 00:11:37.599 --> 00:11:42.700 And I'll give you examples later on, but it's a good question. Because indeed, where do you 00:11:42.700 --> 00:11:49.900 start and how much do you include or exclude. You need later on, very often during 00:11:49.900 --> 00:11:55.250 the process of a review, you will define your criteria. ''Actually I've got NOTE Treffsikkerhet: 91% (HØY) 00:11:55.250 --> 00:12:02.100 too many of these children in pre-kindergarten. Maybe I only want to focus on primary school. '' That's 00:12:02.100 --> 00:12:08.000 okay. As long as you've got a reason to. You need your criteria needs to have a rationale. 00:12:08.000 --> 00:12:13.200 You can't just say, ''oh, I've got too much. Let's use a time limit. '' No. You need to 00:12:13.200 --> 00:12:20.300 have a reason. You can use the time limit, if it is useful. For instance, we did a review in oncology. And we 00:12:20.300 --> 00:12:25.150 said, well treatments older than 20 years are so different from NOTE Treffsikkerhet: 91% (HØY) 00:12:25.150 --> 00:12:31.400 nowadays that has no useful comparing that with the more reason treatments. So then you've got a 00:12:31.400 --> 00:12:36.900 rationale, you can't just say I've got too many hits. That's not good enough. I hope you understand 00:12:36.900 --> 00:12:45.250 that. Okay, so types of literature review. So we've got traditional reviews, 00:12:45.250 --> 00:12:53.000 that gives some an overview about what's going on. It's not systematic. You've got critical reviews. 00:12:53.000 --> 00:12:54.700 That actually are more NOTE Treffsikkerhet: 88% (HØY) 00:12:54.700 --> 00:13:01.800 about that they want to examine critically what's out there but it's not necessarily including 00:13:01.800 --> 00:13:07.500 all the literature in a certain area. And then you've got things like systematic reviews. But just to 00:13:07.500 --> 00:13:12.400 give you an example, I'm not going to read all of this, there is all kinds of reviews that are 00:13:12.400 --> 00:13:19.200 slightly different formulated, different purposes. Someone do a meta-narrative 00:13:19.200 --> 00:13:25.200 analysis, someone to combine data, and do a meta-analysis NOTE Treffsikkerhet: 77% (HØY) 00:13:25.200 --> 00:13:31.100 so combining stats, some are about critical appraisal. Well, what's out 00:13:31.100 --> 00:13:34.050 there to give you a start, but NOTE Treffsikkerhet: 91% (HØY) 00:13:34.050 --> 00:13:40.650 if you want to know more about she listed all but it's quite a bit. 00:13:40.650 --> 00:13:47.500 What I want you to know in short, there's a big big difference between so-called literature reviews, 00:13:47.500 --> 00:13:56.400 that's on the left and what we say is a systematic review. And based on systematic reviews you can 00:13:56.400 --> 00:14:02.000 do meta-analysis. So a literature review that you can see the hyphens because it's still a very 00:14:02.000 --> 00:14:03.900 broad term and don't get NOTE Treffsikkerhet: 80% (HØY) 00:14:03.900 --> 00:14:11.900 mixed up in all these terminologies, but systematic reviews you only use for a certain 00:14:11.900 --> 00:14:18.500 type of use. So, on the left literature reviews, the orange column. It is broad, it wants to give 00:14:18.500 --> 00:14:24.900 an introduction or summary in a certain topic. It is qualitative, not quantitative. It doesn't have 00:14:24.900 --> 00:14:34.250 anything like meta-analysis. It may use by sources and it is not very precise in NOTE Treffsikkerhet: 81% (HØY) 00:14:34.250 --> 00:14:40.200 defining what is going to be included and excluded. But if I look at a systematic reviews, it's got 00:14:40.200 --> 00:14:46.800 a very specific clinical questions or behavioral question. For instance, using PICO, we get that in 00:14:46.800 --> 00:14:51.500 the next slide. So give me a sec for Pico, but it really defines Patient Intervention 00:14:51.500 --> 00:14:57.700 Comparison Outcomes. It defines a specific search strategy. What do you include? What do you 00:14:57.700 --> 00:15:04.400 exclude? You've got these criteria, very precise. And you could include a meta-analysis but not NOTE Treffsikkerhet: 73% (MEDIUM) 00:15:04.400 --> 00:15:11.200 necessary because that depends on the literature that you will review, that you retrieved. 00:15:11.200 --> 00:15:16.700 So meta-analysis, the blue column is you've got, you've done your systematic review and you actually 00:15:16.700 --> 00:15:25.000 come to realize that you can combine, you've got five studies on shy children 00:15:25.000 --> 00:15:30.650 at primary school and the intervention, and it is an RCT and say, well, 00:15:30.650 --> 00:15:34.250 we can combine that. You combine the data, you NOTE Treffsikkerhet: 86% (HØY) 00:15:34.250 --> 00:15:40.200 run the stats and you look at the overarching effect instead of all these small studies. You try 00:15:40.200 --> 00:15:46.600 to come with an overarching effect. That is meta-analysis. So that is really a step ahead, ,t's 00:15:46.600 --> 00:15:52.000 complex. So you re-run stats, I'll show you examples of that as well, you've got the literature 00:15:52.000 --> 00:15:59.200 reviews, that more narrative. It's an introduction. Systematic review, very special, there are rules 00:15:59.200 --> 00:16:04.300 and guidelines around that and you've got possibly meta analysis based on NOTE Treffsikkerhet: 78% (HØY) 00:16:04.300 --> 00:16:11.500 systematic rewiev. Now, this is the so-called PICO model. It camefrom medicine, but it's also 00:16:11.500 --> 00:16:17.900 being used in social sciences, patient-client intervention comparison outcome. So you define 00:16:17.900 --> 00:16:24.300 a question in terms of a problem and you will try the clinical relevant evidence in the 00:16:24.300 --> 00:16:30.800 literature. Now, it helps your research question. So this is how it looks, patient is the P 00:16:30.800 --> 00:16:34.250 intervention for I, C is comparison, NOTE Treffsikkerhet: 84% (HØY) 00:16:34.250 --> 00:16:42.100 O is outcome. Now, the first one is, how would you describe a group of patients? What is the main 00:16:42.100 --> 00:16:49.200 intervention? What are they doing? Is there a comparison group? And what can 00:16:49.200 --> 00:16:55.900 I hope to accomplish a measure? Which outcome? Now, just to give you an example. This is about P, 00:16:55.900 --> 00:17:01.700 inclusion in intervention for children with ADHD, and it was a systematic review and we performed a 00:17:01.700 --> 00:17:04.300 meta-analysis. It's just an example. So, if we NOTE Treffsikkerhet: 91% (HØY) 00:17:04.300 --> 00:17:13.500 go back then to this Pico. Then the P would be children with ADHD. The I would be peer interventions 00:17:13.500 --> 00:17:20.700 to improve social functioning. We were looking at RCTs, randomized control trials. The 00:17:20.700 --> 00:17:28.800 comparison was no peer inclusion or no intervention. And the outcome was the efficacy of pair 00:17:28.800 --> 00:17:34.250 inclusion interventions for children ADHD. This is how you use a NOTE Treffsikkerhet: 85% (HØY) 00:17:34.250 --> 00:17:42.100 a PICO in research. Now, there are many other examples about what type of reviews there are, so if 00:17:42.100 --> 00:17:47.800 you are interested, just have a look there. Now. What do you do? Once you've got your 00:17:47.800 --> 00:17:53.650 articles, you can't just say ''okay, these are that, this is it'' You need to synthesize. You need to 00:17:53.650 --> 00:17:59.400 summarize. So what did you find? Also, if you don't use meta analysis, you still need to do 00:17:59.400 --> 00:18:04.250 something like a meta synthesis to combine. So, like ''Most of the literature says NOTE Treffsikkerhet: 81% (HØY) 00:18:04.250 --> 00:18:12.500 blah. '' or whatever you find. It's non-statistical meta-synthesis. Synthesis is 00:18:12.500 --> 00:18:20.300 non-statistical, but it integrates, it evaluates, it interprets. Its overarching your findings from 00:18:20.300 --> 00:18:28.550 these multiple usually qualitative research studies. You try to identify their core elements. You 00:18:28.550 --> 00:18:34.199 may use these grounded theory. So ethnographic studies. That is more qualitative NOTE Treffsikkerhet: 75% (MEDIUM) 00:18:34.199 --> 00:18:41.000 research that is, Luca Tateo will more talk about things like that. It involves analyzing 00:18:41.000 --> 00:18:48.100 and synthesizing that what you consider to be key in your review. So again, you've got your 00:18:48.100 --> 00:18:53.300 individual findings, but you need to do something with it. Just listing them, and I've seen that 00:18:53.300 --> 00:19:00.200 people doing a review and then just summarizing ten papers. That is not a review. That's the basics, 00:19:00.200 --> 00:19:04.250 you want overarching. So you need to tell me what did you NOTE Treffsikkerhet: 91% (HØY) 00:19:04.250 --> 00:19:11.000 find, what is the overarching idea. Now, I'll give you an example of a synthesis. This was about the 00:19:11.000 --> 00:19:16.000 effects of problem-based learning on Nurse competency and it was a systematic review. So it was 00:19:16.000 --> 00:19:24.100 systematic, but they use meta synthesis because you can't always rerun sets. Here we go. This is 00:19:24.100 --> 00:19:29.600 just an example. So what they did, you can see here that the emetic findings and they try to group 00:19:29.600 --> 00:19:34.150 that into categories. So they found feelings of contrast changing NOTE Treffsikkerhet: 84% (HØY) 00:19:34.150 --> 00:19:40.200 thinking nurse practice information, soaring heart, Etc. What you do when you read your 00:19:40.200 --> 00:19:46.600 articles, you're very often use coding to identify themes, later on you try to combine the themes 00:19:46.600 --> 00:19:52.000 and then you can see here the synthesized finding so per category, you try to say ''Well, did 00:19:52.000 --> 00:20:01.300 they find something? Do we have an overall conclusion? '' That is where a meta synthesis stops. NOTE Treffsikkerhet: 85% (HØY) 00:20:01.300 --> 00:20:12.300 Now meta-analysis is different. Meta-analysis is rerunning stats. It is form of review and it takes 00:20:12.300 --> 00:20:19.200 several studies as a set together and you use standardized statistical procedures. You use software 00:20:19.200 --> 00:20:24.800 for that and the different types of software. It is to if you need help if you're going to do 00:20:24.800 --> 00:20:30.200 this, but it's also to understand and reading meta-analysis why I talked about this. So you 00:20:30.200 --> 00:20:31.150 integrate NOTE Treffsikkerhet: 83% (HØY) 00:20:31.150 --> 00:20:36.800 findings from different studies into one and you try to rerun it. Now I'm going to give you an 00:20:36.800 --> 00:20:45.400 example about bully children and psychosomatic problems. And it's a meta-analysis. And this is how 00:20:45.400 --> 00:20:50.700 it looks but I'll talk you through this. So don't get lost. On the left are the studies 00:20:50.700 --> 00:20:57.600 that were apparently retrieved in this systematic review. This is about stats, the red one, just 00:20:57.600 --> 00:21:01.300 ignore it for now and here, we've got that picture. The forest plot. NOTE Treffsikkerhet: 88% (HØY) 00:21:01.300 --> 00:21:06.900 And the forest plot always gives you gives you immediately information about what's going on. Now. 00:21:06.900 --> 00:21:12.600 Let's have a better look at that forest plot there. You can see the individual studies and the 00:21:12.600 --> 00:21:18.700 symbols, these squares, you can see this is a smaller square than that one, meaning this study had 00:21:18.700 --> 00:21:25.300 more participants and this one at even more and you weighed studies. The more participants the 00:21:25.300 --> 00:21:31.150 stronger it will be weighed more, it will have tronger impact on the final outcome. NOTE Treffsikkerhet: 90% (HØY) 00:21:31.150 --> 00:21:38.000 Now. The effect sizes are in this case expressing odds ratio. Now you 00:21:38.000 --> 00:21:43.100 haven't had that yet at stats, but you need to have a, of course, an effect size and this is an 00:21:43.100 --> 00:21:50.050 effect and this odds ratio is just one of those, and it is a statistic that quantifies the strength. So the 00:21:50.050 --> 00:21:56.550 higher you are on the right, the more you are on the right, the higher the effect is there. Now, 00:21:56.550 --> 00:22:01.199 the question is does bullying lead to psychosomatic problems? That's NOTE Treffsikkerhet: 91% (HØY) 00:22:01.199 --> 00:22:08.900 Overall question. Now odds ratio is this. If it's below 1, that means it favors the 00:22:08.900 --> 00:22:15.800 control. Bullying does not lead to psychosomatic problems. If you are in the red, lots of odds 00:22:15.800 --> 00:22:22.600 ratio, oh, are higher than one, it favors the victims. Now, look for the diamond there. It is in 00:22:22.600 --> 00:22:29.750 the red. So your overall meta-analysis is yes, bullying, does lead to psychosomatic problems. 00:22:29.750 --> 00:22:31.000 This is how you NOTE Treffsikkerhet: 82% (HØY) 00:22:31.000 --> 00:22:37.900 read Forest Plots. I hope this a little bit clear to everybody. You will see them if you look at 00:22:37.900 --> 00:22:43.800 systematic reviews and they perform meta-analysis, ninety-nine out of a hundred, you will see these 00:22:43.800 --> 00:22:50.000 Forest plots. So, this is just how to read, so don't get lost in stats. Just try to understand how to 00:22:50.000 --> 00:22:56.100 read and were to look for the overall conclusion. And this is green again, favors controls, nothing 00:22:56.100 --> 00:23:01.199 happens, but this is in the victims they do get NOTE Treffsikkerhet: 76% (HØY) 00:23:01.199 --> 00:23:06.650 psychosocial problems, because that was the question of your review. NOTE Treffsikkerhet: 90% (HØY) 00:23:06.650 --> 00:23:14.400 Okay, I'm going to talk you through a few examples here. I'm just checking the time and I think 00:23:14.400 --> 00:23:20.700 we're doing fine. We've got still a few minutes for these examples. So this is a review and that was 00:23:20.700 --> 00:23:26.500 the peer inclusion intervention for children ADHD, systematic review, meta-analysis. And the 00:23:26.500 --> 00:23:32.200 objective was to assess the effectiveness of peer inclusion in interventions to improve social 00:23:32.200 --> 00:23:37.449 functioning of children with ADHD. That is within our area. Okay, here we go. NOTE Treffsikkerhet: 91% (HØY) 00:23:37.449 --> 00:23:43.600 We had RCTs, randomized control trials only and quasi-experimental study. So, we had the 00:23:43.600 --> 00:23:49.600 higher level of evidence included in our review. Now, this was -- and I know it's small --but this was 00:23:49.600 --> 00:23:54.300 the results. Now, how do you look at this one again? This is the forest plot. I'll talk you through. 00:23:54.300 --> 00:24:01.300 These are the included studies. This is your stats. That is your 00:24:01.300 --> 00:24:07.050 Forest plot. Okay. Focus on Forest plots there. You can see green NOTE Treffsikkerhet: 85% (HØY) 00:24:07.050 --> 00:24:16.200 and red and you can see green is favors the control and red favors the intervention. Where is my 00:24:16.200 --> 00:24:23.900 diamond? There is my diamond, favors the intervention. Significant effect, favoring the intervention. 00:24:23.900 --> 00:24:26.199 That's how you read it. NOTE Treffsikkerhet: 80% (HØY) 00:24:26.199 --> 00:24:32.300 By the way, just for your information here the effect size was a 00:24:32.300 --> 00:24:38.600 head G, but whatever the effect size is you read the forest plot in the same way. We 00:24:38.600 --> 00:24:44.900 had a odds ratio, we have now a heads G, you can't know all the sets but you do you can learn 00:24:44.900 --> 00:24:50.300 how to read these forest plants. That's why I give you a few examples. Okay? Stick with me. We've 00:24:50.300 --> 00:24:55.650 got another one. It doesn't matter what the topic is, I'm just going to show you a 00:24:55.650 --> 00:24:57.050 forest plot. NOTE Treffsikkerhet: 84% (HØY) 00:24:57.050 --> 00:25:06.500 And again, same way, reading studies, stats, forest plot. Now. What is happening? Here we can see 00:25:06.500 --> 00:25:17.700 green and red. And so green was there is my my overall diamond. Meaning, it's now on the left of my 00:25:17.700 --> 00:25:23.900 picture. And here I've got a significant effect favoring the control group. NOTE Treffsikkerhet: 90% (HØY) 00:25:24.200 --> 00:25:33.300 I'll give you one more, last one, again, studies, my stats, whatever, it is a my first plot. Now, I can 00:25:33.300 --> 00:25:41.000 see that my diamond is on top of that vertical line. It touches that vertical line. And that means 00:25:41.000 --> 00:25:47.600 the overall combined result is not statistically significant, even though it is more in the green, 00:25:47.600 --> 00:25:54.000 it's not statistically significant. So overall outcome in the intervention group is much the same NOTE Treffsikkerhet: 91% (HØY) 00:25:54.000 --> 00:25:59.800 in the control group. So your result is no significant effect. So, of course, I could give you the 00:25:59.800 --> 00:26:06.300 whole background, is just to give you a little bit of idea how you usually look at these forest plots. 00:26:06.300 --> 00:26:15.500 Okay? That was about the introduction. Now it leaves me the literature review. What about 00:26:15.500 --> 00:26:20.800 literature review versus systematic review, and I think actually that this is a good time to have 00:26:20.800 --> 00:26:23.850 a break. So I would like to see you. NOTE Treffsikkerhet: 85% (HØY) 00:26:23.850 --> 00:26:31.100 At 9:15 unless there is a question at this moment. Is there a question? NOTE Treffsikkerhet: 91% (HØY) 00:26:31.100 --> 00:26:34.500 Everything is clear so far? NOTE Treffsikkerhet: 91% (HØY) 00:26:34.900 --> 00:26:39.800 Okay. NOTE Treffsikkerhet: 84% (HØY) 00:26:40.300 --> 00:26:49.200 Okay, this is what we were going to talk about, literature review versus a systematic 00:26:49.200 --> 00:26:56.300 review, and little bit more into detail. Now, you get a couple of slides here. I don't want to read 00:26:56.300 --> 00:27:02.100 them all and learn by heart because you will be dead by the end up finish this one. And I want to do 00:27:02.100 --> 00:27:08.000 a little bit of practice as well. But on the left every time, what we call a literature review and 00:27:08.000 --> 00:27:11.250 on the right, what makes something a systematic review. NOTE Treffsikkerhet: 83% (HØY) 00:27:11.250 --> 00:27:18.800 So literature review is usually qualitative summaries. It is more informal. On the right, systematic 00:27:18.800 --> 00:27:26.500 review high level overview of primary research, has got a very focused question. It is got criteria. 00:27:26.500 --> 00:27:29.300 It is very systematic. NOTE Treffsikkerhet: 75% (MEDIUM) 00:27:29.600 --> 00:27:36.800 If we look on the left topics, may be broad. If you look on the right, you've got these in exclusion 00:27:36.800 --> 00:27:44.699 criteria, a very well-defined research question. And, as I said, it could be refined during your 00:27:44.699 --> 00:27:50.700 review. That you see if I run into too many articles, then you need to add additional exclusion 00:27:50.700 --> 00:27:58.900 criteria, but the aim is to find all existing evidence in a certain area. It also is reproducible. 00:27:58.900 --> 00:27:59.500 Meaning you need NOTE Treffsikkerhet: 83% (HØY) 00:27:59.500 --> 00:28:07.200 to report in detail. So if you do a systematic review in theory, I could repeat your review and 00:28:07.200 --> 00:28:12.600 get the same results. That's the idea of a systematic review. And that is very hard on the left with 00:28:12.600 --> 00:28:20.600 the literature reviews. Searches on the left, maybe a bit at ...., not really systematic. Whereas on 00:28:20.600 --> 00:28:27.300 the right it's extremely detailed. You can repeat it, you need to report on it. You need to report 00:28:27.300 --> 00:28:29.450 on every single bit of your search. NOTE Treffsikkerhet: 78% (HØY) 00:28:29.450 --> 00:28:33.700 It's well documented and reported. NOTE Treffsikkerhet: 78% (HØY) 00:28:34.500 --> 00:28:41.700 So on the left, it's not very clear sometimes why certain studies were included and excluded. 00:28:41.700 --> 00:28:48.000 Whereas on the right you've got these very black-and-white in exclusion criteria that actually are 00:28:48.000 --> 00:28:54.600 based on the research question. You can add and refine. But in the end, what you've got in the end, 00:28:54.600 --> 00:29:03.300 the included studies, that is what you need to explain. Now on the left very often, the 00:29:03.300 --> 00:29:04.900 methodological study called NOTE Treffsikkerhet: 84% (HØY) 00:29:04.900 --> 00:29:10.200 not addressed. Whereas on the right if you've got your articles retrieved from the 00:29:10.200 --> 00:29:16.700 literature, each article needs to be assessed for methods. So you want to know is the bias in 00:29:16.700 --> 00:29:24.300 these articles, are there problem with recruitment, selection, bias or reporting bias. So that is what 00:29:24.300 --> 00:29:30.300 you do. You use a critical appraisal tool for that. And again we talk about that later. So on the 00:29:30.300 --> 00:29:35.200 left, you see, that's not happening. On the right, you need to do that. NOTE Treffsikkerhet: 82% (HØY) 00:29:35.500 --> 00:29:42.900 So conclusions on the left are also what qualitative and not necessarily based on study quality, 00:29:42.900 --> 00:29:49.800 it's a summary. It's a summary of the literature on a topic. On the right, it is the quality. It's 00:29:49.800 --> 00:29:57.700 based on the quality of the study. So strong high-level quality studies with good level of evidence 00:29:57.700 --> 00:30:05.100 with minimal bias are more important there and it provides actually recommendations for practice 00:30:05.100 --> 00:30:06.550 like this intervention NOTE Treffsikkerhet: 82% (HØY) 00:30:06.550 --> 00:30:13.900 is working and that intervention does not to seem work working or it identifies gaps. Knowledge 00:30:13.900 --> 00:30:19.300 gaps. That is says, well actually we haven't got enough evidence. We need more research to be able 00:30:19.300 --> 00:30:26.600 to confirm that the certain intervention is effective or not. It supports evidence-based practice. 00:30:26.600 --> 00:30:28.800 So, that is really on the right. NOTE Treffsikkerhet: 91% (HØY) 00:30:28.800 --> 00:30:36.300 Now, that is just a very brief summary. The differences between a literature review and what we call 00:30:36.300 --> 00:30:38.650 a systematic review. NOTE Treffsikkerhet: 89% (HØY) 00:30:38.650 --> 00:30:46.800 Now, the next step will be need to know is. Okay. What about these literature databases? And where 00:30:46.800 --> 00:30:52.300 do we start? Well, first of all, we had a very short chat yesterday about it. You go to the 00:30:52.300 --> 00:30:58.800 University Library. That's where you log in. And this is, of course, the library. And if you look, 00:30:58.800 --> 00:31:06.300 there is Oria. So the Oria is what you need to do, you go to the library and you go to Oriya. And 00:31:06.300 --> 00:31:08.550 the next step, what you can do is you look for your NOTE Treffsikkerhet: 83% (HØY) 00:31:08.550 --> 00:31:14.200 databases. As I said already if you go into the databases, there are many many different 00:31:14.200 --> 00:31:21.500 databases and you need to do your homework little bit beforehand. And if you want to know what kind 00:31:21.500 --> 00:31:27.200 of databases are relevant, then if you're reading up a little bit in your area, you probably also 00:31:27.200 --> 00:31:34.000 see if you look at some reviews in your area, you you can check what databases do they use. 00:31:34.000 --> 00:31:38.950 So again, I very often I use PubMed and Mbase but there are few more. NOTE Treffsikkerhet: 85% (HØY) 00:31:38.950 --> 00:31:46.300 So commonly used databases PubMed and Mbase, but it's rather Medical. But still also, in social 00:31:46.300 --> 00:31:53.900 sciences I always include those two. In addition you've got ....., Eric is education, psycinfo 00:31:53.900 --> 00:32:01.600 psychology, web of science. Those are really quite commonly used databases. Now, the Cochrane 00:32:01.600 --> 00:32:06.800 database is a little bit special. It's a database, including systematic review. NOTE Treffsikkerhet: 83% (HØY) 00:32:08.500 --> 00:32:14.400 And again, in the selection of your databases depends on the topic and that is really you need to do 00:32:14.400 --> 00:32:21.150 your homework. If you select the wrong databases (Usually you need to use more than one) 00:32:21.150 --> 00:32:27.500 You will have an incomplete review. So that is not okay because you can't find your literature. 00:32:27.500 --> 00:32:33.000 Now back to that Cochrane Library. So this is the database, the website. You can try it later on. 00:32:33.000 --> 00:32:38.650 It's a gold standard for meta-analysis. It's medical science mainly NOTE Treffsikkerhet: 86% (HØY) 00:32:38.650 --> 00:32:44.400 but I still want to tell you because there is an overlap. It's support evidence-based, clinical 00:32:44.400 --> 00:32:51.000 decision-making. And there is a whole database with all these reviews, and you can just look into 00:32:51.000 --> 00:32:57.000 it. There's also a handbook from the Cochran, which with a lot of information and it's 00:32:57.000 --> 00:33:02.900 freely available. I can see chat and I just see it by accident. NOTE Treffsikkerhet: 89% (HØY) 00:33:04.800 --> 00:33:11.750 Someone is asking what databases did I use. Okay, let's go back here. So this is actually what I 00:33:11.750 --> 00:33:14.300 mainly use are here. NOTE Treffsikkerhet: 75% (MEDIUM) 00:33:14.300 --> 00:33:22.100 These are what I always use is PubMed and Embase and depending on whether I work with some 00:33:22.100 --> 00:33:28.500 colleagues in social sciences I very often includes CINAHL and psycinfo so very often. If I do, 00:33:28.500 --> 00:33:39.000 systematic, reviews and social sciences I will use all of those and I combine 00:33:39.000 --> 00:33:44.699 them. I show you that later as well. But if I'm a little bit NOTE Treffsikkerhet: 89% (HØY) 00:33:44.699 --> 00:33:51.800 to the web of science because the way it's structured and the way you search in that one, web of 00:33:51.800 --> 00:33:59.500 science doesn't have so-called subject headings. Only you need to use free text and it usually 00:33:59.500 --> 00:34:05.250 you retrieve quite a few hits. So if it needs to be feasible, I would be a little bit 00:34:05.250 --> 00:34:11.800 careful with that one. But these are the databases that I usually use and other people as 00:34:11.800 --> 00:34:14.649 well. Okay, let's go back to the Cochrane. NOTE Treffsikkerhet: 77% (HØY) 00:34:14.649 --> 00:34:21.699 And and let's go into Cochrane. So this is, if you go to the Cochrane Library, this is how you get 00:34:21.699 --> 00:34:30.400 into their website and there if I type there, for instance, ADHD as a keyword, it just gives me a 00:34:30.400 --> 00:34:40.000 whole list of systematic reviews in that area. So, there are apparently 22 reviews that 00:34:40.000 --> 00:34:44.800 have ADHD. You can see, 22 reviews that have ADHD in the title. NOTE Treffsikkerhet: 85% (HØY) 00:34:44.800 --> 00:34:51.000 I can just scroll down and see what this anything that might be interesting to you or that is 00:34:51.000 --> 00:34:57.700 overlapping with what you intended to do and you don't want to repeat it unless it is an old review 00:34:57.700 --> 00:35:07.000 and you want to do an update. I most certainly do not do updates, when the review is younger more 00:35:07.000 --> 00:35:13.100 than five years. I think is very doubtful, that is useful to do an update. You could do it, 00:35:13.100 --> 00:35:14.649 but you must have good reasons NOTE Treffsikkerhet: 78% (HØY) 00:35:14.649 --> 00:35:20.900 for that. And often you don't have good enough reasons. So, a review that is ten year or older, 00:35:20.900 --> 00:35:28.700 yes you can do an update. Between five and ten, a bit doubtful. Depends. Okay. This is the handbook. 00:35:28.700 --> 00:35:34.300 Again, it is freely available. It's got quite a few bits of interesting information about how to 00:35:34.300 --> 00:35:41.800 perform systematic reviews, etc. It's just useful to download it and as background information. NOTE Treffsikkerhet: 91% (HØY) 00:35:41.800 --> 00:35:44.700 Any questions so far? NOTE Treffsikkerhet: 89% (HØY) 00:35:47.100 --> 00:35:54.000 Then I just continue. Okay. So let's do some searching because that is actually what I wanted to do 00:35:54.000 --> 00:36:01.100 today as well. So let's go for a systematic search. Now, there is some terminology that I need to 00:36:01.100 --> 00:36:08.750 discuss with you. So first of all, we talked about subject headings before. Subject headings are 00:36:08.750 --> 00:36:16.100 different in databases, because in every database is subject headings are different. It tags in term 00:36:16.100 --> 00:36:17.750 the articles about the NOTE Treffsikkerhet: 86% (HØY) 00:36:17.750 --> 00:36:24.200 spesific subject, so if you use a certain subject heading and you ask the machine the database ''give 00:36:24.200 --> 00:36:30.300 me all the articles linked to this topic.'' It immediately will give you that. It's organized in a 00:36:30.300 --> 00:36:37.300 hierarchical structure and means you can have an overall something like ADHD and then you've got 00:36:37.300 --> 00:36:46.300 maybe ADHD diagnosis or ADHD treatment. It's kind of a tree structure. NOTE Treffsikkerhet: 83% (HØY) 00:36:46.300 --> 00:36:54.000 Now, the other things that you also need to be aware of is free text, and that is for instance when you need 00:36:54.000 --> 00:37:00.300 to use sometimes free text, when there are no existing subject headings. And I always use my own name 00:37:00.300 --> 00:37:06.000 as an example. Of course, there is no subject heading using my last name Speyer, but if you want to 00:37:06.000 --> 00:37:13.899 know what's been out there using my name, then you need to use free text. But on many many more 00:37:13.899 --> 00:37:16.700 times that you really need to use free text is because NOTE Treffsikkerhet: 91% (HØY) 00:37:16.700 --> 00:37:23.800 there are no subject headings in that particular database. Again this is what I said that's why 00:37:23.800 --> 00:37:29.800 I'm not too fond of web of science because it does not have subject headings at all. Google Scholar 00:37:29.800 --> 00:37:35.700 also doesn't have subject headings, which makes life a little bit more difficult because you 00:37:35.700 --> 00:37:45.200 can have many many wrong hits. What you also can do if you 00:37:45.200 --> 00:37:46.350 perform a NOTE Treffsikkerhet: 86% (HØY) 00:37:46.350 --> 00:37:55.300 subject heading search, there is a delay as you can see in free text, if you 00:37:55.300 --> 00:38:00.900 use free text, you can sort out the delay. What I'm saying is subject headings there may 00:38:00.900 --> 00:38:08.700 be a delay in assigning subject headings to an article. And free text you can sort that. There's no 00:38:08.700 --> 00:38:15.900 delay. So sometimes you do a subject heading search and you do a free text in addition to retrieve 00:38:15.900 --> 00:38:16.649 the most NOTE Treffsikkerhet: 84% (HØY) 00:38:16.649 --> 00:38:23.700 recent articles. However, this is less and less important. The delays are pretty good nowadays. 00:38:23.700 --> 00:38:26.300 I see there is a chat again. NOTE Treffsikkerhet: 83% (HØY) 00:38:27.900 --> 00:38:35.500 Who can see your messages? I've got no idea. Can you see my messages now? NOTE Treffsikkerhet: 79% (HØY) 00:38:36.300 --> 00:38:45.300 Could someone tell me? Student: Yeah, we can see the chat. 00:38:45.300 --> 00:38:48.400 Renee: if I do this, can you see the chat still? NOTE Treffsikkerhet: 79% (HØY) 00:38:48.500 --> 00:38:54.300 Student: Nope, I can't see anything that you wrote. Renee: Okay, because someone is asking, I think it's 00:38:54.300 --> 00:39:00.900 about privacy that so I'll keep it on. Okay. If you send a 00:39:00.900 --> 00:39:05.500 chat to me, personally, I can only see it but that's a little bit difficult if you do that because 00:39:05.500 --> 00:39:10.900 then I need to that because I don't know how to reply to you. If you ask in person, if you know what I 00:39:10.900 --> 00:39:17.850 mean. If you understand that this is NOTE Treffsikkerhet: 87% (HØY) 00:39:17.850 --> 00:39:25.700 you can send chats to everybody that everybody can see your chat, and you can send it personaly 00:39:25.700 --> 00:39:31.300 but that I got a problem answering because I don't have time to answer by chat personal emails in 00:39:31.300 --> 00:39:37.900 between or personal chats. I've seen you a question. ''If you are researching something in Norwegian 00:39:37.900 --> 00:39:44.800 should be then look into research done in the Norwegian as well? '' There is not a specifically database 00:39:44.800 --> 00:39:46.200 in Norwegian. NOTE Treffsikkerhet: 81% (HØY) 00:39:46.200 --> 00:39:54.200 Research is usually published in English. If people publish in Norwegian, I'm not sure where we will find 00:39:54.200 --> 00:40:00.000 it in the database. And so if you are looking more for policy documents, etc., you need to look more 00:40:00.000 --> 00:40:07.800 into Google or other ways. Databases, these are really mainly research-based or in the conference 00:40:07.800 --> 00:40:16.350 abstracts. I hope that is good enough answer. If someone publishes NOTE Treffsikkerhet: 86% (HØY) 00:40:16.350 --> 00:40:24.000 Norwegian, it's minimal. What you can do is you can give it a try, open up 00:40:24.000 --> 00:40:31.300 PubMed and use the language filter Norwegian, but you will see that you will lose a lot. 00:40:31.300 --> 00:40:36.400 Okay, back to what we were doing here. So I just hope that you understand the difference between 00:40:36.400 --> 00:40:45.300 subject heading and free text and of course, I'm going to give you plenty of our examples. Okay, let's 00:40:45.300 --> 00:40:46.350 see what we are going NOTE Treffsikkerhet: 89% (HØY) 00:40:46.350 --> 00:40:53.050 to do. I'm going to give you an example so that you know what I mean with mesh terms. 00:40:53.050 --> 00:40:59.400 We're going to look for the mesh terms and I'm doing, we did this actually, 00:40:59.400 --> 00:41:08.100 we published something about shyness, and I had to know the mesh terms for shyness. So you go to 00:41:08.100 --> 00:41:14.900 PubMed and use the scroll down. So, to enter the mesh database, or you use that one, the two 00:41:14.900 --> 00:41:16.300 ways of getting into mesh. NOTE Treffsikkerhet: 80% (HØY) 00:41:16.300 --> 00:41:22.700 But you need to use one of those and I just type in shyness and you get into the mesh term. Now if 00:41:22.700 --> 00:41:26.700 you click on that, you can see now that NOTE Treffsikkerhet: 84% (HØY) 00:41:27.000 --> 00:41:34.400 right here, there's the other one. But again, I'm sorry, I want the next one actually. If you go to 00:41:34.400 --> 00:41:40.600 these database, you will retrieve any mesh term there is. Now, if you want to retrieve terms, you 00:41:40.600 --> 00:41:49.100 need to start with semantic related terms. Meaning not just shyness, but any term related to that. 00:41:49.100 --> 00:41:53.700 And that's what you need experts that help you out. So you've got to shyness, introvert 00:41:53.700 --> 00:41:58.050 introversion, social withdrawal. All these terms on the left... NOTE Treffsikkerhet: 73% (MEDIUM) 00:41:58.050 --> 00:42:08.100 Student: What does the mesh mean? 00:42:08.100 --> 00:42:17.400 Renee: I'm sorry, mesh is this one. We got subject headings and in databases, they've got 00:42:17.400 --> 00:42:24.500 different terms and in PubMed subject headings are called mesh. And another databases they may be different. 00:42:24.500 --> 00:42:27.550 I'm sorry. I forgot to tell you that. NOTE Treffsikkerhet: 83% (HØY) 00:42:27.550 --> 00:42:34.200 Okay, so we are looking now in PubMed and PubMed, not my fault, they call it mesh. 00:42:34.200 --> 00:42:40.600 That is a subject heading. So to retrieve those subject headings, you need to have a list of 00:42:40.600 --> 00:42:49.100 related terms. Then in PubMed these are the so-called and this by the way, no PubMed but there's no 00:42:49.100 --> 00:42:54.450 database. You can tell this is not mesh. This is an error, but I'm sorry, but you've retrieve the 00:42:54.450 --> 00:42:57.700 subject headings in a database. I'll give you other examples, very quick. NOTE Treffsikkerhet: 80% (HØY) 00:42:57.700 --> 00:43:02.200 This is the slide I was looking for yesterday. I couldn't find it. This is not PubMed. This is 00:43:02.200 --> 00:43:09.400 another database, but the same thing, this is I retrieved the subject headings and you get for each 00:43:09.400 --> 00:43:15.900 of these terms. You get subject headings, you need to do that for each database. Meaning in this 00:43:15.900 --> 00:43:22.300 case I combine the terms with or and all of this is just linked to shyness. NOTE Treffsikkerhet: 80% (HØY) 00:43:22.300 --> 00:43:29.600 I'll give you another example. I've got here prevalence. I went to different databases. I tried to 00:43:29.600 --> 00:43:36.800 find the subject headings. You can see the previous one was MH in denial. They use a different way 00:43:36.800 --> 00:43:43.400 of writing. Don't get upset. It's a machine doing it. This is where you see prevalence mesh. 00:43:43.400 --> 00:43:49.200 So these are subject heading in PubMed, you call the mesh. In Embase I can recognize them by 00:43:49.200 --> 00:43:52.550 that Slash. NOTE Treffsikkerhet: 80% (HØY) 00:43:52.550 --> 00:43:58.700 In other one they write an H in front of it. That is what the machine does. But these are subject headings I 00:43:58.700 --> 00:44:05.900 retrieved by looking for prevalence, incidence, related terms to prevalence. And this was what I could 00:44:05.900 --> 00:44:12.900 find per database. Now, free text would be just prevalence or incidence of frequency. And I use 00:44:12.900 --> 00:44:17.600 again that extracts, we seen that. So prevalence and prevalences in case of that would be 00:44:17.600 --> 00:44:22.500 interesting or frequency, frequencies, if you just use that from it, NOTE Treffsikkerhet: 83% (HØY) 00:44:22.500 --> 00:44:30.800 it used its the truncation. Now a few more tricks and we'll do this more in practice. So we will 00:44:30.800 --> 00:44:37.400 have a look at it, but we can see here truncation to therapy. That will retrieve therapy, 00:44:37.400 --> 00:44:44.000 therapies, etc. If you make it too short, you may end up getting all these terms 00:44:44.000 --> 00:44:50.100 that are not relevant. So be careful. You don't want to make it too short, you get also an explosive 00:44:50.100 --> 00:44:52.550 number of hit. NOTE Treffsikkerhet: 88% (HØY) 00:44:52.550 --> 00:44:57.800 Swallow, swallowing. But I also get irrelevant hits, nothing you can do about it. 00:44:57.800 --> 00:45:04.100 I get the birds, you know, swallow birds. You get those as well. There's no way of deleting 00:45:04.100 --> 00:45:12.400 them if I use with free text. Furthermore, check spelling tumor. That means tumor and tumors, but 00:45:12.400 --> 00:45:19.800 it will not retrieve the tumor with OU. So you need to, if you do this tumor or tumor with OU, you 00:45:19.800 --> 00:45:22.450 get all four options. That's how you play NOTE Treffsikkerhet: 85% (HØY) 00:45:22.450 --> 00:45:31.200 with truncation. Now, we also looked at Boolean operators. There is an OR which expands, there's an 00:45:31.200 --> 00:45:39.800 end which only looks at the overlap here and then there's the not I want disability, but I don't 00:45:39.800 --> 00:45:47.800 want the overlap the deafness. So that's how you exclude it. And then finally, we looked at so called 00:45:47.800 --> 00:45:52.399 quotation marks, difference a little bit but database, sometimes you need to check that. NOTE Treffsikkerhet: 85% (HØY) 00:45:52.399 --> 00:46:01.400 But most databesesuse these thingies, these quotation marks, and it will only then include this 00:46:01.400 --> 00:46:07.100 combination. And otherwise, if you don't do that, it will look for end risk but also for factor. And 00:46:07.100 --> 00:46:13.400 then you get way more hits. Whereas you are only interested in risk factor and optional you can 00:46:13.400 --> 00:46:17.300 add that asterisks so combine that with truncation. NOTE Treffsikkerhet: 87% (HØY) 00:46:17.300 --> 00:46:25.100 Just a little trick. We also had a look at filters. You can use for instance, publication 00:46:25.100 --> 00:46:31.100 dates. If you say, well, I really don't want it should be 4000, you can say if you want are 00:46:31.100 --> 00:46:38.400 looking for just some introductory literature are very often use the article type one. 00:46:38.400 --> 00:46:45.000 In PubMed you've got systematic reviews and reviews are very often used both. You can use a language 00:46:45.000 --> 00:46:47.600 filter. For instance, if you want to know what is out there NOTE Treffsikkerhet: 73% (MEDIUM) 00:46:47.600 --> 00:46:54.100 that in Norwegian, but if you want to look for introductory literature in general please don't select 00:46:54.100 --> 00:46:59.700 just Norwegian, because you will get so selected restricted information. That is not a 00:46:59.700 --> 00:47:06.800 good introduction for general topic. Age, that can also be like school-age children, kindergarten, 00:47:06.800 --> 00:47:14.950 adolescent. They're all these possibilities. Just have a look and play with it. Another thing. 00:47:14.950 --> 00:47:17.550 And again, we will do all of this with later. Another NOTE Treffsikkerhet: 74% (MEDIUM) 00:47:17.550 --> 00:47:25.100 way of selecting literature is when you use free text, I very often use the 00:47:25.100 --> 00:47:33.850 combination title or abstract that if I do a quick search, you say '' Okay, I want ADHD or kindergarten 00:47:33.850 --> 00:47:40.300 age and I look in title or abstract. '' So that gives me a good first draft like is there anything out there. 00:48:33.100 --> 00:48:39.000 Of course you can do snowballing and we just read up and that's what we all do. 00:48:39.000 --> 00:48:45.600 But if you're doing a systematic research or if you want to know in a systematic way what's out 00:48:45.600 --> 00:48:47.600 there, then this is the way. NOTE Treffsikkerhet: 91% (HØY) 00:49:17.500 --> 00:49:23.700 There are many databases and that's why you need to 00:49:23.700 --> 00:49:28.700 look if you do a systematic search. You need to look in different databases. There's always a risk 00:49:28.700 --> 00:49:33.400 that you missing something, always. Because you're not going to look at every single 00:49:33.400 --> 00:49:39.600 article but if you use your search is right, if you write the good searches, you will find the best 00:49:39.600 --> 00:49:45.400 hits. So, if you say, ''well, this is really an important article'', it should have 00:49:45.400 --> 00:49:47.700 been there. It should have been in your search. NOTE Treffsikkerhet: 90% (HØY) 00:49:47.700 --> 00:49:53.800 Actually, if you've got a major article that is not in your searches, you may have written wrong 00:49:53.800 --> 00:49:55.400 searches. NOTE Treffsikkerhet: 91% (HØY) 00:49:55.400 --> 00:50:02.750 Does that give an answer to your question? Kine: I think so. Yeah, because if the article was not in any 00:50:02.750 --> 00:50:09.900 database that's not good for the article, it may mean it's not good. 00:50:09.900 --> 00:50:17.200 Renee: It would be quite unusual if you've got a strong good article 00:50:17.200 --> 00:50:21.500 that would not be in the databases. But what could happen is that you are looking in the wrong 00:50:21.500 --> 00:50:26.100 database. That's one, or that you've got something in your search strategies NOTE Treffsikkerhet: 80% (HØY) 00:50:26.100 --> 00:50:32.200 actually excluding it. So there's probably a problem or an error in your searches. But in 00:50:32.200 --> 00:50:38.500 general, using searches is the best way to find the most relevant literature. 00:50:38.500 --> 00:50:45.700 Kine: If I find some article on my own, 00:50:45.700 --> 00:50:54.100 would there be a reason for also checking if it was in a database or would that be just 00:50:54.100 --> 00:50:56.050 waste of time if I had already found it? NOTE Treffsikkerhet: 80% (HØY) 00:50:56.050 --> 00:51:02.000 Renee: If you've got an article that was not in your searches, what you could do is you go 00:51:02.000 --> 00:51:06.800 to that article in that particular database and you see if that article is actually there or you 00:51:06.800 --> 00:51:11.300 could try and see what kind of subject headings are linked to this article. Why did I not 00:51:11.300 --> 00:51:15.300 retrieve it? So there's several ways of dealing with that. NOTE Treffsikkerhet: 90% (HØY) 00:51:15.400 --> 00:51:22.400 So I hope by giving you some more information, we're doing this lecture so that 00:51:22.400 --> 00:51:28.000 you get a better idea of what you can do and what you cannot do. But I can 00:51:28.000 --> 00:51:32.100 never give you a hundred percent. I'll tell you. You've never got hundred percent because then 00:51:32.100 --> 00:51:38.600 you need to read all articles. I'm gonna give you 00:51:38.600 --> 00:51:44.550 more examples. Okay, we're here, so we set these filters NOTE Treffsikkerhet: 88% (HØY) 00:51:44.550 --> 00:51:50.000 and I said well, title or abstract is a very good one to reduce numbers. So again, I'm going to give 00:51:50.000 --> 00:51:57.200 you some more examples here. So let's go for suppose my topic is a systematic review of pragmatic 00:51:57.200 --> 00:52:03.800 in language interventions for children with autism spectrum disorders. Okay. So what I do 00:52:03.800 --> 00:52:12.300 now is I go to psycinfo for example, and I retrieved all these, these are subject headings and I 00:52:12.300 --> 00:52:14.800 know that because that thingy that's NOTE Treffsikkerhet: 91% (HØY) 00:52:14.800 --> 00:52:21.300 in psycinfo subject headings are identified by a slash and they have called thesaurus. But that's 00:52:21.300 --> 00:52:26.900 just the way it is. Then I also have another string so we need to decide how many strings. 00:52:26.900 --> 00:52:34.200 The first string is terms related to autism because that is one of the major concepts. 00:52:34.200 --> 00:52:41.400 The second string is about pragmatics. So I want terms related to pragmatics in psycinfo, I ran 00:52:41.400 --> 00:52:44.850 into pragmatics so I've got now two strings. NOTE Treffsikkerhet: 85% (HØY) 00:52:44.850 --> 00:52:54.600 And I combine both strings with an end. So all these ASD related terms and anything I've 00:52:54.600 --> 00:53:01.700 got there. So this is a two string search using subject 00:53:01.700 --> 00:53:04.800 headings. Is that clear? NOTE Treffsikkerhet: 91% (HØY) 00:53:04.800 --> 00:53:15.300 Hana: Just a question. Yeah, would you be showing an example of doing it in the psycinfo? 00:53:15.300 --> 00:53:20.700 Renee: We are going to do. I'll give you some example. We will not going to all the database but we will today 00:53:20.700 --> 00:53:26.500 also do some searching in the databases. I want to get you 00:53:26.500 --> 00:53:31.700 through some background information. Then we go to the database and then you I can show you that 00:53:31.700 --> 00:53:34.150 this is where you find it. And this is what goes wrong or... Okay? NOTE Treffsikkerhet: 85% (HØY) 00:53:34.150 --> 00:53:43.150 And you remind me if I don't give enough examples. 00:53:43.150 --> 00:53:52.700 Just to give you an idea. So this is psycinfo, and to make you miserable, this is PubMed. One string 00:53:52.700 --> 00:53:59.400 on a is ASD and one string on pragmatics. The only reason why I do this is sometimes life is not that 00:53:59.400 --> 00:54:04.250 simple. In every database. You need to have your entry term. So these semantic NOTE Treffsikkerhet: 86% (HØY) 00:54:04.250 --> 00:54:12.600 related terms and see what pops up and apparently in PubMed 00:54:12.600 --> 00:54:19.800 it's endless one string. 00:54:19.800 --> 00:54:25.950 The autism one is pretty simple. But the other one is... 00:54:25.950 --> 00:54:31.200 That is the way it is, you can't do anything. That is how the databases work. I'm going to give you another 00:54:31.200 --> 00:54:32.350 example. NOTE Treffsikkerhet: 86% (HØY) 00:54:32.350 --> 00:54:38.800 We were looking at, we did reliability of peer assessment, in medical education is actually one that 00:54:38.800 --> 00:54:46.100 I wrote, reliability of peer assessment. The first thing you need to decide is how many strings. And I 00:54:46.100 --> 00:54:51.200 say well, I think medical education is one. There's medical education and the other one is about 00:54:51.200 --> 00:55:00.100 peer review. This was about is that reliable or not. Now, you can decide to add a third one, 00:55:00.100 --> 00:55:02.400 reliability. NOTE Treffsikkerhet: 88% (HØY) 00:55:02.400 --> 00:55:08.000 But the more strings, the more problems you may run into. If you can do with fewer strings, 00:55:08.000 --> 00:55:15.500 start with fewer strings. Every time you add a string , you may lose also articles. And I decide I 00:55:15.500 --> 00:55:23.300 need all these four databases. No this is simplified just for the lecture, what I had 00:55:23.300 --> 00:55:30.000 was these four databases and I had these strings with terms related and on PubMad you can 00:55:30.000 --> 00:55:32.350 see they had more strings, NOTE Treffsikkerhet: 78% (HØY) 00:55:32.350 --> 00:55:38.100 more terms. And my free text down there because that was also what I need is the first 00:55:38.100 --> 00:55:44.600 string, medical education, medicine, or student. I don't need the hyphens here because this is 00:55:44.600 --> 00:55:52.000 just one term. So it will look for this combination or medicine or that combination. The other terms 00:55:52.000 --> 00:55:59.100 that I use are peer review ,peer assessment, period valuation Etc. So that's how you write, 00:55:59.100 --> 00:56:02.400 and then you can combine this into NOTE Treffsikkerhet: 80% (HØY) 00:56:02.400 --> 00:56:11.600 subject heading, strings and surges. And I had free text strings. This is another one. 00:56:11.600 --> 00:56:17.500 So this is just to get the hang of. How do you search if I were to say questionnaire on voice problems in 00:56:17.500 --> 00:56:23.200 children? How many strings? What strings you will need have a look at it? NOTE Treffsikkerhet: 91% (HØY) 00:56:23.200 --> 00:56:30.600 And I'm going to give you the answer. Of course, the strings would be questionnaires, voice problems 00:56:30.600 --> 00:56:36.300 and child. Now you can decide how to deal with child because there are different ways of 00:56:36.300 --> 00:56:41.250 dealing with that. The first string would be questionnaire. NOTE Treffsikkerhet: 80% (HØY) 00:56:41.250 --> 00:56:50.700 And what you going to do is you go to PubMed, you search for mesh, you put the word questionnaire in, 00:56:50.700 --> 00:56:55.300 and if it's right, that should pop up. I suggest I'm going to do that right now. I'm checking 00:56:55.300 --> 00:57:03.600 the time. How about we do that? So I will go to PubMed. NOTE Treffsikkerhet: 90% (HØY) 00:57:06.700 --> 00:57:14.500 Here we are. Why don't you all try to go to PubMed through UiO? NOTE Treffsikkerhet: 86% (HØY) 00:57:29.550 --> 00:57:35.400 Library. That's not the quickest way. I'm trying to find What's the quickest way for you. Well, I 00:57:35.400 --> 00:57:43.050 am in the library now. Sofia: Can I say something? If you just write to the Google ''UB UiO'' 00:57:43.050 --> 00:57:48.200 that's how you get to the library the fastest. 00:57:54.300 --> 00:57:59.600 Renee: Okay, you need to go to Oriya. Is everybody in there? NOTE Treffsikkerhet: 77% (HØY) 00:58:00.300 --> 00:58:06.650 Does everybody know where the databases are, that is what I want to know. Then you go to database, 00:58:06.650 --> 00:58:17.950 click on that one. Go to PubMed. We are still sharing, I hope. Yes it's okay. And here you should see 00:58:17.950 --> 00:58:28.100 the P, scroll down to PubMed, or just type it. 00:58:28.100 --> 00:58:30.950 There we are. View online. NOTE Treffsikkerhet: 83% (HØY) 00:58:30.950 --> 00:58:38.000 Has everybody now in PubMed through this way? Because the reason you can go to PubMed just without going 00:58:38.000 --> 00:58:43.400 to the university, but for the other databases you need to go through the university. So I want to 00:58:43.400 --> 00:58:50.600 make sure that everybody knows how to get there. Do you know? Yeah. Yeah, if you don't know, just 00:58:50.600 --> 00:58:57.750 let me know. Okay. Now this is what I said, if you see this one, the different ways of how it looks... NOTE Treffsikkerhet: 87% (HØY) 00:59:01.050 --> 00:59:06.800 Kine: I didn't know I could go there through the library. So I just used to go there on my own, 00:59:06.800 --> 00:59:13.300 I did not understand how where that was. Renee: If you go through UiO, 00:59:13.300 --> 00:59:21.000 go to the library and then you need to come under database page. 00:59:21.000 --> 00:59:27.200 Okay, then this is what you do, right? I'll get the exact same page. 00:59:41.950 --> 00:59:49.600 It is re why does not give me my read more. NOTE Treffsikkerhet: 73% (MEDIUM) 01:00:50.600 --> 01:00:57.200 You need to do that because the other databases are not just 01:00:57.200 --> 01:01:02.800 freely available. So you need to learn how to do it through Oriyo. 01:01:02.800 --> 01:01:08.100 I usually use a different University. That's why I struggle a little bit. 01:01:08.100 --> 01:01:14.800 I've got several universities that are collaborated, but you need to use the right way, just get 01:01:14.800 --> 01:01:19.950 used to that. So you have access any database. So now you're here. NOTE Treffsikkerhet: 86% (HØY) 01:01:19.950 --> 01:01:26.500 So this is how you enter, then you 01:01:26.500 --> 01:01:29.700 can click here on mesh. NOTE Treffsikkerhet: 73% (MEDIUM) 01:01:30.200 --> 01:01:36.300 Then you see the mesh. Now I am in the mesh database. If you type in 01:01:36.300 --> 01:01:39.600 questionnaire, please do, NOTE Treffsikkerhet: 84% (HØY) 01:01:41.400 --> 01:01:48.700 then I say, '' Okay. This is what I want. '' I ticket, I add it, NOTE Treffsikkerhet: 83% (HØY) 01:01:48.700 --> 01:01:51.800 I search. NOTE Treffsikkerhet: 76% (HØY) 01:01:52.600 --> 01:02:00.200 Now, I'm no longer in the mesh database. It searched this mesh term. It's 01:02:00.200 --> 01:02:07.300 mesh the subject heading. And these, I've got over a million hits. So that's a lot and I 01:02:07.300 --> 01:02:09.550 don't want that. Okay? NOTE Treffsikkerhet: 82% (HØY) 01:02:09.550 --> 01:02:14.100 Everybody, no problems with that? NOTE Treffsikkerhet: 88% (HØY) 01:02:14.300 --> 01:02:21.200 Let's let's make a promise. If you're not good, 01:02:21.200 --> 01:02:26.000 you let me know. Otherwise, I don't know who's with me or not. Kine: I think I'm just I'm behind there all 01:02:26.000 --> 01:02:32.400 the time. So it's a bit embarrassing. *Renee showing Kine how to do* 01:03:00.300 --> 01:03:06.400 Why don't I have a look 01:03:06.400 --> 01:03:09.500 ever try a few things more. Now, click on NOTE Treffsikkerhet: 70% (MEDIUM) 01:03:09.500 --> 01:03:11.250 advanced. NOTE Treffsikkerhet: 81% (HØY) 01:03:11.250 --> 01:03:19.000 This is what I want you to do everybody. 01:03:19.000 --> 01:03:24.000 I want everybody to just do exactly the same what I'm doing. So, you've got your 01:03:24.000 --> 01:03:30.000 search this one you are in PubMed. Now, this is just an ordinary PubMed. I want you to click on 01:03:30.000 --> 01:03:33.350 the word ''advanced'' below the search. NOTE Treffsikkerhet: 91% (HØY) 01:03:33.350 --> 01:03:41.400 Click. This should pop up. This is your history where you can see what you search. There's my over a 01:03:41.400 --> 01:03:45.800 million hits. Suppose I'm going to do now this NOTE Treffsikkerhet: 72% (MEDIUM) 01:03:45.900 --> 01:03:48.700 survey. NOTE Treffsikkerhet: 89% (HØY) 01:03:49.100 --> 01:03:55.500 Type survey, click and search. NOTE Treffsikkerhet: 90% (HØY) 01:03:55.500 --> 01:04:04.000 I've got 1.6 whatever hits, I go back to advance. NOTE Treffsikkerhet: 85% (HØY) 01:04:04.300 --> 01:04:15.850 Now I'm going to do this, you scroll down, you select title abstract. I just put the same word in 01:04:15.850 --> 01:04:26.700 ''survey''. I click add. So this free text of the doing. So this was subject heading, mesh. This is free 01:04:26.700 --> 01:04:33.100 text survey. So over a million over 1.6. Now, I'll say look for servey in the title or the 01:04:33.100 --> 01:04:35.050 abstract only and NOTE Treffsikkerhet: 87% (HØY) 01:04:35.050 --> 01:04:37.000 search. NOTE Treffsikkerhet: 84% (HØY) 01:04:37.200 --> 01:04:43.300 And I've got now that number. So, all I'm saying is depending on your search, you get totally 01:04:43.300 --> 01:04:48.700 different numbers. The this one is just a nightmare, 1.6 million, but the other one is well. 01:04:48.700 --> 01:04:55.600 But suppose I go back to, I want this search again. So, click now on the one million again. Just click 01:04:55.600 --> 01:05:01.700 on that number. And you go back to PubMed. Is everybody with me? NOTE Treffsikkerhet: 91% (HØY) 01:05:02.900 --> 01:05:10.800 Hana: How did you go back to mesh from here? 01:05:10.800 --> 01:05:18.500 Renee: You click on this number. I can select any search by just clicking. So I go 01:05:18.500 --> 01:05:26.750 to the, it's now changed, but go back to the search, the mesh search and click on the mesh search. 01:05:26.750 --> 01:05:33.250 If you do that, give it some time, you go to PubMed and here you see all the abstracts. NOTE Treffsikkerhet: 89% (HØY) 01:05:33.250 --> 01:05:40.100 Now I'm going to do what I discussed previously. 01:05:40.100 --> 01:05:49.000 You've got limits. There are more limits, just click on additional and then you can see. 01:05:49.000 --> 01:05:56.800 You can say I want language and I just want to read Norwegian. 01:05:56.800 --> 01:06:03.149 I don't want you to do this ever by the way, but okay, Norwegian it is. NOTE Treffsikkerhet: 91% (HØY) 01:06:03.149 --> 01:06:11.600 Then you click it and it shows, so it will just show, there it is. You haven't done it yet. 01:06:11.600 --> 01:06:13.350 You just showed it. NOTE Treffsikkerhet: 91% (HØY) 01:06:13.350 --> 01:06:16.300 Is everybody with me? NOTE Treffsikkerhet: 87% (HØY) 01:06:17.400 --> 01:06:27.800 Now click Norwegian and let the machine do its work, and I'm left with 01:06:27.800 --> 01:06:34.300 from over a million, I went to about 1,600. Have you got that as well? NOTE Treffsikkerhet: 91% (HØY) 01:06:35.700 --> 01:06:43.900 The next step is, I don't want the Norwegian. So, if you don't mind, I say here ''clear 01:06:43.900 --> 01:06:46.950 all''. I want that filter gone. NOTE Treffsikkerhet: 80% (HØY) 01:06:46.950 --> 01:06:53.400 But just so you know, that's how you play with it. Usually I only use this filter English. But okay. 01:06:53.400 --> 01:07:00.200 Now I find a very important one. If it's not there yet you need to use additional filter. 01:07:00.200 --> 01:07:05.450 But otherwise, I want to know what are there systematic reviews. NOTE Treffsikkerhet: 91% (HØY) 01:07:05.450 --> 01:07:15.000 And I've got 10,000 hits that are systematic reviews on surveys and questionnaires. Everybody with me? NOTE Treffsikkerhet: 91% (HØY) 01:07:16.600 --> 01:07:23.300 Okay, now I go back to advanced. NOTE Treffsikkerhet: 82% (HØY) 01:07:24.700 --> 01:07:31.500 And I want to go to mesh, and here is my mesh. You sometimes need to look a little bit, every 01:07:31.500 --> 01:07:37.300 database is different. Click this one. Click mesh. NOTE Treffsikkerhet: 86% (HØY) 01:07:37.400 --> 01:07:48.500 I'm back in my mesh. So suppose I want to know about ASD, as you can see this is 01:07:48.500 --> 01:07:55.149 nonsense. I used the acronym, and this is not what I'm looking for. Then I use, okay, let's do autism. NOTE Treffsikkerhet: 87% (HØY) 01:07:57.250 --> 01:08:00.400 Just try autism. NOTE Treffsikkerhet: 91% (HØY) 01:08:02.100 --> 01:08:08.800 You always need to scroll down and sometimes you have a couple of hundreds then 01:08:08.800 --> 01:08:16.200 you need to select. I think I want that one, I want that one, maybe also Rett syndrome, all 01:08:16.200 --> 01:08:24.200 three. So click all three. Make sure you've got a OR there because you want to combine them in one 01:08:24.200 --> 01:08:28.550 string and you say, add. NOTE Treffsikkerhet: 91% (HØY) 01:08:28.550 --> 01:08:32.700 And then you say search. NOTE Treffsikkerhet: 87% (HØY) 01:08:33.399 --> 01:08:42.100 I've got almost 40,000, then you go back to advanced. NOTE Treffsikkerhet: 91% (HØY) 01:08:42.600 --> 01:08:45.300 Are you with me? NOTE Treffsikkerhet: 79% (HØY) 01:08:45.700 --> 01:08:51.200 Now we're going to do a trick and then we've got a break because then I'm going to see you 01:08:51.200 --> 01:08:58.200 in two hours and I've got another lecture between. So then what I want to do now, we had 01:08:58.200 --> 01:09:03.450 these reviews on surveys, Etc. Click on the dots. NOTE Treffsikkerhet: 88% (HØY) 01:09:03.450 --> 01:09:07.950 Say and query, there it is. NOTE Treffsikkerhet: 91% (HØY) 01:09:07.950 --> 01:09:16.200 Now, I want to combine that with this one the or I want in autism. So I click again on the dots and 01:09:16.200 --> 01:09:24.850 now you can choose and I want ad with end because it's a different string. Now I've got surveys, 01:09:24.850 --> 01:09:28.850 it should be a review and should be about autism. NOTE Treffsikkerhet: 91% (HØY) 01:09:28.850 --> 01:09:32.500 And then you say search. NOTE Treffsikkerhet: 90% (HØY) 01:09:32.700 --> 01:09:43.800 26 results. That is nice. You can play around here. You can say, okay, show me the abstracts. NOTE Treffsikkerhet: 89% (HØY) 01:09:44.800 --> 01:09:52.899 And you can see, you can scroll down and see the abstracts in there. You can also go to advance. 01:09:52.899 --> 01:10:02.050 I very often take a snip of that. I copy that because then I can see exactly what I did. 01:10:02.050 --> 01:10:11.100 Okay, and this is where I stop for now. Let's see, let's stop.