The introduction of groups and a good pilot accuracy test lasted step three days, when time the latest codebook is modified several times. To help you take to accuracy, one or two coders (graduate college students) by themselves coded a batch out of 100 randomly selected meme circumstances (on the ten% of your own take to). Brand new agreement price is examined by using the Krippendorff ( 2004b ) shot, with .66 given that lowest score to simply accept an adjustable once the required (Krippendorff, 2004a ). Eventually, one or two variables, subculture (content) and you will picture list (form) obtained an inadequate score, and you may were taken out of this new codebook, leaving 48 details towards real programming (Find also for the complete codebook of one’s universal attributes inside the all of our studies).