a Study on Users’ Voting Tendency in Daum View

01 Participatory Journalism and Social News Services-Issues in social news servicesParticipatory Journalism?Participatory j ournalism:journalism: The act of a c itizencitizen, or group of citizens , playingplaying an active role in the process of collecting, reporting, analyzing and disseminating news and information.The intent of this participation is to provide independent, reliable, accurate, wide-ranging and relevant information that a democracy requires.Participatory Journalism in Social News ServicesUsersCollecting & AnalyzingDisseminatingReporting1 2 3 &Aggregated NewsRanked NewsSocial News Services01 Participatory Journalism and Social News Services (Cont’d)-Issues in social news servicesJournalistic values, such as accuracy, credibility, reliability, are considered important p19972009PopularityMedia CredibilitySlashdot’s Meta-moderation(1999)Daum’sOpen Editing Algorithm (2008)02 Problems in Voting-Based News Ranking SystemFundamental problems: Credibility of news media is determined by news contents, but votes cannot guarantee values of news contents Probliems hn eacl a gori htfms oi representat ve sociali news serv cesVoting ServiceDescriptionLimitationsMethodSimpleDiggOnce a submission has earned a critical Group voting PopularityVotingmass of Diggs, it is promoted to “popular” problems (Digg > and “most popular.”Mafia, Digg Credibility“Bury” for spam filteringBury Brigade)RedditSubmission score is determined by the Group voting number of Upvotes minus the number of problems downvotes(Reddit downmodsquad) NewsCredit Article / Discredit ArticleGroup voting Credproblems“credibility?”WeightedSlashdotModeration-Metamoderation system: Credibility of metamoderators Votingmetamoderators are randomly chosen in are not consideredthe system and rate moderatorsRating NewsAn rating instrument is given f orfor users t oto Increased user burden BasedTrustrate news articles based on news valuesVoting03 Researches on Journalistic Media CredibilityElements in Traditional Media Credibility Measures– Trustworthiness, expertise, dynamism (Infante, 1980)– Trustworthiness, fairness, bias, completeness, respect for privacy, representation of individual interests, accuracy, concern for community well-being, separation of fact and opinion, concern for public interest, factual foundations of information publi hs ed, qualifiicat ons of reporters ( iR mmer and Weaver, 1987) – Believability, fairness, accuracy, depth of information (Johnson and Kaye, 1998, 2000)Elements in Online News Credibility Measures– factual/opinionated, unfair/fair, accurate/inaccurate, untrustworthy/trustworthy, balanced/unbalanced, biased/unbiased, reliable/unreliable, thorough/not thotough, informative/not informative (Ognianova, 1998)– Kiousis (1999) measuredl on iline news credibilidibility by askiking wh het er onliline news is factual, concerned with making profits, concerned with community well-being, invades people’s privacy with 5-point Likert-type scale03 Researches on Journalistic Media Credibility (Cont’d)Related debates concerning news value elementsRelated works ResearcherS. Bowman and C. Willis, We Media2003We the MediaD. Gilmore, 2006Blog,Blogging, Journalism & Credibility: Battleground and Common ParticipatoryR MacKinnon, 2005GroundJournalismOnline News Credibility: An Examination of the Perceptions of W. P. Cassidy, 2007Newspaper Journalists Restating News Values: Contemporary Criteria for Selecting the J. Mcgregor, 2007News04 Research Questions & ProcessAssumption: “There will be a group of people who vote for journalistically valuable news stories”Q1. How to measure Qjournalistic value of jsocial news contents?– What are the attributes that valuable news stories have?– How to measure values of a number of news contents?– Should each news value elements have different weight for online social news contents?Q2 Wh. to are voters hth ta t ten t to vo fe jor liourna tisllcaly vabua lbl?e news (V?(V laVue to)ers– How to derive value voters?– Do they show consistent tendency in voting behavior?1. Measuring2. Finding3. EvaluationJournalistic ValueAlpha VotersNews Set 2News Set 1voted by Value voters with Value ScoresValue Voters News Set 2With Value ScoresNews Raters 1News Set 2voted b yby g eneralgeneral voters NRews at2ers General Voters05 Measuring Journalistic Value of Social News ContentsC. Lampe and R. Kelly Garrett’s Methodology– Compare performances of several rating instruments(normative, descriptive, full, mini review)– Subjects rated original and degraded news story with 4 rating instruments. – We adopt normative review because it shows the highest level of accuracy in that the result shows similar news values as those from experts.- Representative News Value Elements - Accuracy of ratings by instrument and story quality AttributeDescriptionInstrumentErr2Err| ErrErr | sdrAccuracyFull.80.69.06.285**CredibilityDescriptive1.39.94.07.234**NormativeFairnessNormative.64.62.05.218*InformativenessMini2.901.43.09.326**OriginalityBalanceClarityContextDescriptiveDiversityEvidenceObjectivityTransparency05 Measuring Journalistic Value of Social News Contents (Cont’d)369 well-educated people measure values of top 100 weekly best current news stories of Daum View with normative review instrument (Accuracy, Credibility, Fairness, Informativeness, Originality)To derive importance of each element in online news, our survey asked subjects to rate them with 5-point Likert scale, and we rescaled them so that the news value score ranges from 1 to 5D ierdvei we hgfts hor eacl eliements are dstef as llo ows- Weights for each rating itemsAccuracyCredibilityFairnessInformativenessOriginality0.2250.2270.1980.2020.14805 Measuring Journalistic Value of Social News Contents (Cont’d)Finally, we derive the value scores of top 100 current news of Daum Blogger NewsExamples of survey result Previous RankURLValue89http://http:/ v/ daum.net./net link/3918133/4.10985910985993http://v.daum.net/link/39301343.99689876http://v.daum.net/link/39314103.88224445http://v.daum.net/link/39124583.85602922http://v.daum.net/link/39310273.80779147http://v.daum.net/link/39128613.77774667http://v.daum.net/link/39261423.70575529http://v.daum.net/link/39132463.70377787http://v.daum.net/link/39058333.64687533http://http:/ v/ daum.net./net link/3948105/3.64247764247736http://v.daum.net/link/39150243.63390218http://v.daum.net/link/39025573.62594130http://v.daum.net/link/39027043.62299659http://v.daum.net/link/39220913.59138770http://v.daum.net/link/39005383.58417283http://v.daum.net/link/39130773.58085657http://v.daum.net/link/39114743.57849943http://v.daum.net/link/39282023.55226864http://http:/ v/ daum.net./net link/3925490/3.52133352133325http://v.daum.net/link/39131313.519752