Talk:ResearchGate/Archive 2

From Wikipedia, the free encyclopedia

Archive 1Archive 2Archive 3

Lugger

User:Sjuttiosjuochfjorton posted (in pertinent part) the following on my personal talk page:

Beatrice Lugger's complaint was exaggerated and RG members are very unlikely to obtain higher scores unless having an extensive publication record. Her statement should not have been quoted in the first place. Importantly, her RG score of 10 is based 70% on her 4 publications (one of them has an impact factor > 30 and as a researcher you know this is very high). This makes her statement in the blog misleading and it should not be quoted on Wikipedia without supporting information. We are not in the business of spreading misinformation and Wikipedia has to be objective. We have to scrutinize information from personal blogs/websites, right?

Because this concerns article content, I am cross-posting and replying here.

It is certainly worth asking whether the Lugger source meets the criteria of WP:BLOGS or WP:NEWSBLOG. I checked very briefly, and it appeared that this is a professional blog and not a personal one, but I may well be mistaken about that and that is worth discussing.

Sjuttiosjuochfjorton (talk) 16:44, 28 April 2014 (UTC) A. Lugger's own opinions are posted on the blog. She has 1-5 regular posters only. I have never heard of this person. B. Her current RG score is < 10 and is based on her publications mostly. C. Her screen capture of a past RG score does not even indicate her name. D. Importantly, the criticism is outdated at best and Wikipedia should be up-to-date. E. I provided links so you can check the information I gave. It adds objectivity, up to date information, and is therefore more useful for the reader. F. One of the past editors (Chire) clearly showed his subjectivity by stating "researchgate is useless crap". How many more reasons do you need to include my info? If it looks like a duck, swims like a duck, and quacks like a duck, then it probably is a duck. Make the critique more objective and current. Should I really have to contact RG administration and have them verify that Lugger's criticism is outdated? Check yourselves. The original quote should have been questioned with the same tenacity.

However, if indeed the source is acceptable, I think that rebutting it with unsourced and primary-sourced statements is not appropriate. Thoughts? --BlueMoonlet (t/c) 06:56, 26 April 2014 (UTC)

BlueMoonlet I totally agree. Wikipedia is not about truth, for good reasons, editors of this page need to realise this. Specific policy here: https://en.wikipedia.org/wiki/Wikipedia:Verifiability,_not_truth Millionmice (talk) 12:07, 27 April 2014 (UTC)
For now, I have removed the original research rebutting Lugger's statement. I do have some sympathy for User:Sjuttiosjuochfjorton's objections, and I suggest that the best way to proceed would be to find a reliable source (even a RG website would be acceptable as a source for stating RG's opinion) that critically engages with Lugger. --BlueMoonlet (t/c) 13:57, 28 April 2014 (UTC)

Sjuttiosjuochfjorton (talk) 14:17, 28 April 2014 (UTC) This is a tad frustrating. The whole point is that Lugger's initial comment was inaccurate/false. 70% of her current RG score (~10) is based on her submitted publications and not on her questions or comments (check the link that I provided). As such, her original RG score of 10 was more than likely also based on these research papers and not on "her other contributions". Her critique is thereby proven highly questionable/false and should be removed or balanced with my overly nice statements. Why is this even a problem? If this is the way Wikipedia is working on a general basis I understand why researchers like myself shy away from adjusting/correcting inaccuracies.

Judging from the screenshot on her blog (which does seem a reliable source by Wikipedia standards to me), 70% of her score was based on her questions on RG, and 0% on her publications back then. So his statement does not make sense to me, and is WP:OR. Of course these values are old, but the date is evident from the source. If we want to engage in speculation, the coauthor of the same publication currently has a RG score of 7.38, 100% from this one publication. Her current score is 9.97, and RG reports 71% being the publication history (shouldn't it be 74%?), so her 10 questions and answers increased her score by 2.59! But all of such speculation shouldn't be on Wikipedia, without reliable sources. We don't care about the score-of-the-day, but we do care about journalism that says the RG score is unreliable. Wikipedia:Verifiability, not truth: if you believe this is incorrect, publish a rebuttal in an appropriate format, and then we can add it here. --Chire (talk) 14:23, 28 April 2014 (UTC)

Sjuttiosjuochfjorton (talk) 14:51, 28 April 2014 (UTC): A) The critique is not valid anymore. Outdated. Wikipedia should be up to date and this criticism is not anymore. It may (with emphasis on may) have been pertinent several years ago, but this is not a historical article. B) There are several reasons why her statements are out of place/odd. If find it very peculiar that in two years (and by adding a 30+ impact factor paper [and 3 others]) that her RG score is less than her score in 2012. If you want to get really technical on the 70%: How do you know that the screenshot is from her own score? Her name is not on it and as a member she can access anybody's score. C) Although she appears to be a self-appointed science journalist, since when did blogs become "bonafide" journalism? Who is Beatrice Lugger? Can I quote myself if I add this discussion onto my science blog? I mean, I have more publications than she has and probably more scientific credibility. D) All in all, we have to check and update our information + question the sources. If you do not buy that Wikipedia needs to be up to date, it goes against the whole point of having a quickly evolving source of information i.e. the basis of this very community. It is not a historical article.

Wikipedia is also about history. Flat Earth is a proper topic for Wikipedia; Earth is not flat, but there are a lot of reliable sources about why and when people believed it was flat. If you can identify a reliable source with more up-to-date information, we can add this new situation, too. But don't add your own blog, and don't add anything if you are affiliated with researchgate, because of WP:Conflict of interest. In my personal opinion, the critique is still valid, btw; and researchgate is useless crap, and they are spammers; but very good in self-marketing (the "stem cell study" hype for example - it is an open debate in medicine that 70% of medical research findings are false for simple statistical reasons, now RG makes a fuzz of a single false one as if they had found the holy grail)... so what. Opinions vary, live with it. Many people are highly sceptical of the RG score, and the usefulness of RG; and the lugger source serves as an example reliable source of this. --Chire (talk) 15:22, 28 April 2014 (UTC)

Sjuttiosjuochfjorton (talk) 15:46, 28 April 2014 (UTC)A) Chire: The critique is not valid anymore. I have provided links: 1. Her score in 2012 was 10x less than the highest according to her own blog! 2. The information is now also completely outdated (and questionable in the first place) and the stats I provided are current. Her critique would potentially only fit under a section called "historical growing pains", but it certainly does not fit in its current organisation. B) Here is another big problem: You showed your subjectivity and bias by saying "researchgate is useless crap". This immediately disqualifies you from being objective enough to contribute to this article. C) Of course I am not affiliated with Researchgate and neither am I interested in quoting myself :-). My point is that the original quote could have come from any Joe Schmoe if you picked Lugger. Lugger only has 1-2 posters on her science blog, she does not publish in peer-reviewed journals frequently, and her credibility is not established in the article. Who is she? I have given so many viable arguments why my additions still should stand that indeed it appears that I am engaging in a discussion with the Flat Earth Society or Westboro Baptists. Current, objective, science-based. That is what Wikipedia should strive for. Not subjective opinions.

The statement is clearly marked as "In 2012", and as being her personal opinion; as required by Wikipedias style. It is verifiable. Wikipedia is about WP:Verifiability, not truth. --Chire (talk) 15:53, 28 April 2014 (UTC)

Sjuttiosjuochfjorton (talk) 16:21, 28 April 2014 (UTC)As I have stated on numerous occasions now: The criticism is outdated, misleading, and therefore it no longer serves a purpose. My additions were verifiable facts (links provided) and made her critique more well-rounded and objective. The quote should have been deleted so I was more than nice and I have already compromised from that perspective. Now you bunch need to budge otherwise this will be ongoing. Chire: Your statement that the website is "useless crap" has disqualified you from being able to add any more insights to this discussion. I would prefer if the discussion was passed on to someone with an objective mindset, with energy to check links and read/answer posts.

I am still wondering why this criticism is included here? It is based on the experience of one blogger, and it appears to be written in a personal blog and not a professional one, which does not qualify as a credible, independent third-party source. I think the Lugger criticism should be removed entirely. Does anyone else agree? JNorman704 (talk) 17:07, 28 April 2014 (UTC)
There is concern about the reliability of this score (even on researchgate: , but also the links above wrt. to Nobel laureates having 0 RG score); and the Lugger source seems to be the most reliable we have found so far on the quality of the scores (this one may be a better, more recent, source though: SAIS 2014, which seems to analyze a "dormant" user in the network). If e.g. this source (or some other) turns out to be more reliable, then I'm all in with dropping it. A quick search on her name revealed she is not just "some blogger", but vice scientific director of Klaus Tschira Foundation#NaWik at Karlsruhe Institute of Technology; an institute for science communication (although that post seems to be more part of her journalist activities, than as vice director of that institution). --Chire (talk) 17:35, 28 April 2014 (UTC)

Sjuttiosjuochfjorton (talk) 00:44, 29 April 2014 (UTC) A. I have given you a logical explanation about RG scores of certain Nobel Laureates below. B.The link you provided does not mention research gate specifically and pertains to all (scientific) social networking sites. Either way, the information in the article is not obtainable for most readers http://elibrary.aisnet.org/Default.aspx?url=http://aisel.aisnet.org/cgi/viewcontent.cgi?article=1023&context=sais2014.C. Beyond the multiple reasons I have given you already why Lugger's statements should be tempered, her blog is not moderated by anyone but herself and she has far too few followers to keep content objective and evolving. The input about RG is her subjective and out-to-date opinion and it does not hold up to current evidence. It is as simple as that. JNorman704:

Thanks for your response, Chire. This still feels like it is not balanced. What would feel more balanced to me is to say that some users have posted in blogs and online forums that their ResearchGate scores were high despite limited use of the service, and then balance that with information about how ResearchGate calculates scores, etc. To give both sides of the story. I'm not opposed to posting criticisms at all, but I feel like posting one blogger's experience, not matter how esteemed that blogger may be, just doesn't feel balanced to me. JNorman704 (talk) 18:29, 28 April 2014 (UTC)
As I have said, I have no position on the appropriateness of the Lugger source. If there is consensus it does not meet the criteria of WP:BLOGS or WP:NEWSBLOG, then I have no objection to removing the entire subsection. That it is "the most reliable we have found so far" on the topic is immaterial; if it does not meet the criteria, then we simply have no acceptable sources that address the topic and we cannot address the topic (we have already been through this with the spamming issue). On the other hand, if it does meet the criteria, then we cite it, even if it is "not balanced" by acceptable sources expressing the opposite opinion.
In any case, including the information and then rebutting it with WP:OR is simply not an acceptable solution.
@Sjuttiosjuochfjorton: You claim to be a researcher. I am a scientific researcher myself. If that is true, then you should be adept at listening to others' arguments and adapting your own to respond effectively.
@Chire: You have repeatedly cited WP:COI to Sjuttiosjuochfjorton, and indeed it is reasonable to be concerned about that. However, if you have an agenda to discredit RG because you believe they are "useless crap, and they are spammers", then you also may run afoul of the WP:COI policy, even if you have no financial stake in the matter. Take care.
All for now. --BlueMoonlet (t/c) 19:02, 28 April 2014 (UTC)
Thanks for being a voice of reason, BlueMoonlet. I really appreciate it. My feeling is that there have been a LOT of edits to this article from others who have an agenda to discredit RG. A fair number of these edits in the past have come from anonymous users. I'm not a scientist or RG user but I do care about fairness and balance on Wikipedia and I feel that this article has not lived up to Wiki standards due to an overly negative POV. My vote is to remove the Lugger criticism. Thanks for listening. JNorman704 (talk) 19:20, 28 April 2014 (UTC)

I appreciate the good word, JNorman704. Of course, we don't vote on Wikipedia; rather, we discuss the issue at hand and seek consensus. Whether the source stays or goes should be based on WP:RS policy and nothing else. I think the best way to proceed would be for User:Chire to quote the WP:BLOGS and/or WP:NEWSBLOG policy and explain exactly why he thinks this source meets those criteria, and then for you to respond to his argument. --BlueMoonlet (t/c) 20:54, 28 April 2014 (UTC)

Sounds good to me! JNorman704 (talk) 20:59, 28 April 2014 (UTC)
@BlueMoonlet:, @JNorman704:: I don't think I have a real COI. I'm just being honestly at being annoyed by their spam emails (17+ and counting); but I don't think I have more of a COI than a fanboy user of their platform has a COI. There are not a lot of emotions involved, nor financial interests. I have not claimed that Sjuttiosjuochfjorton has a COI, I have only asked him if he has; because he was very emotional, which often indicates a COI. Either way, what do you think of the SAIS 2014 source (google also returns a PDF, )? --Chire (talk) 09:33, 29 April 2014 (UTC)
@Chire: I don't doubt that you are able to govern yourself in such a way as to avoid a COI. I just wanted to point out that the issue is worth some careful thought on your side as well as the other.
@Chire: and @Sjuttiosjuochfjorton: In my opinion, both of you are editing in good faith, and I suggest both of you assume that about each other and stop casting up the WP:COI policy to each other.
I think the SAIS source is likely fine, though I would invite User:JNorman704 and User:Sjuttiosjuochfjorton to argue otherwise if they wish. Speaking of which, User:Chire, did you specify your policy arguments in favor of the Lugger source? Both JNorman704 and Sjuttiosjuochfjorton have criticized the source, and it would be easier to evaluate the issue if we had a clearer idea of what are the arguments for inclusion in the first place. --BlueMoonlet (t/c) 18:32, 29 April 2014 (UTC)
@BlueMoonlet: Scilogs.de is operated by Spektrum der Wissenschaft - the German branch of Scientific American. This is not a personal blog, but it consists of invited posts by researchers and journalists. All of this is easy to verify by going to the front page . So it should qualify as WP:NEWSBLOG. She is also "coordinating [the Lindau Nobel Laureate Meetings] conference blog since 2008" for nature.com and moderating panel discussions for Nobel laureates and on panels for science communication in new media . So yes, it is journalism, not a self-published blog; her blog is published by the German branch of Scientific American. --Chire (talk) 07:53, 30 April 2014 (UTC)
Thank you, User:Chire, that seems like a strong case.
@JNorman704: and @Sjuttiosjuochfjorton: If you continue to be unconvinced about the appropriateness of the Lugger source, please read the policy at WP:NEWSBLOG and make your argument from that policy. Up to now, your arguments seem to me to have amounted to 1) balancing this Wikipedia article and 2) disagreeing with what Lugger says. However, 1) is not a reason to exclude the source altogether, though we can have a conversation about how to ensure we do not give it undue weight, and 2) amounts mostly to original research.
It seems to me that your options are 1) rebut Chire and argue that the Lugger source does not in fact meet the criteria of WP:NEWSBLOG, 2) find a reliable source that disagrees with Lugger (I would say that even a rebuttal directly from RG would be admissable if reported as the opinion of RG), or 3) acquiesce to the discussion of the Lugger material roughly as it currently stands, possibly with a discussion about WP:UNDUE. Thoughts? --BlueMoonlet (t/c) 09:37, 30 April 2014 (UTC)

Sjuttiosjuochfjorton (talk) 23:50, 28 April 2014 (UTC) Finally some common sense without an agenda. However, BlueMoonlet keeps on referring to WP:RS but the fact is that my additions come from the original citations (i.e. Lugger's own site and Researchgate; check the links and translate from German into English if you need to). If my additions are disqualified then logically the original quote is disqualified as well. It seems like this "crux of the matter" is partly missed by BlueMoonlet and Chire. Further to this, Wikipedia is indeed about open peer review, up to date information, and not about "fairness" between editors. The truth is not democratic in all cases and the objective information that I added is clearly originating from RG and Lugger's own blog. So, logically, Lugger's outdated original complaint (at best) can stay but only if tempered with something in style with what I have written. If you want to take up a discussion in regards to make up of RG scores then do so, but that is a completely different discussion/section in the article.

Nevertheless, Chire has no clue whether or not Lugger's quote was legit even in 2012. The information she provided is not only outdated but highly questionable, especially the claim that her contributions were only questions/answers. Facts speak against this and I have provided her current profile as a link (see A). Neither does Chire know whether or not the blog is mostly a vehicle for Lugger to express her own opinions or not. It clearly appears that it is the case from the tidbits I have read. Yes, I am fluent in German, a published scientist, and listen to critique BlueMoonlet! If you really view blogs as feasible sources of scientific news and objectivity then you must consider the amount of followers too. The blog basically has a handful of followers and I have never heard of Lugger in the first place. It seems to me that someone(Chire?) searched the web in an effort to find a quote that supported his or her subjective views. It is proven beyond a shadow of a doubt that editor Chire is biased ("researchgate is useless crap") so this should disqualify him/her from further discussion and editing. Either way, it is not a democracy (and it is not only about objectivity), it is also about up-to-date information. Do we want Wikipedia to be outdated?

A) One of her papers basically makes up the entirety of her current RG score since it is published in a high impact factor journal. Sometimes when you add publications to the site, the score is immediately updated but the graphics may not be. There is just no way her current RG score of 9.98 would be lower than her 2012 score if she has added these papers afterwards. One of them is a 30+ impact factor paper for Pete's sake! More than likely, her graphics just was not updated and she made an erroneous conclusion in her blog.

Sjuttiosjuochfjorton (talk) 00:04, 29 April 2014 (UTC) Lastly, the whole discussion about Nobel Price winners: If they do not post their publications from high impact journals or secondarily contribute to the discussion in RG, then their RG score will be low. You do not automatically receive a high RG score just because you are a Nobel Price winner. The score reflects the entirety of your work (primarily number of pubs and official impact factor of the journals where they were published) and not only the findings in one publication. Being a Nobel Price winner can be like being a one hit wonder. Does that make their contribution to the community greater than someone who makes semi-good science their whole career? Perhaps, perhaps not. It makes common sense this way, but if you feel that this is unfair then make a case with RG to change the way they make up the RG score. I feel that in general, high impact factor research gets published in high impact factor journals. Researchers in economy appears to publish in low impact factor journals and that is too bad for them. That, on the other hand, is a discussion about impact factor per se, which is best left for the entirety of the scientific community.

Sjuttiosjuochfjorton (talk) 02:03, 29 April 2014 (UTC) There is extensive discussion regarding this subject on Research gate and if anything someone needs to summarize the major points objectively and extensively to include it under a balanced section on criticism. Until then Lugger's comments need to be tempered + you can provide a summary of what RG scores are: The hard-core center of the RG Score, besides interactions, is the journal impact factor system, used in the RG Score and the overall ranking of journal publications. Upon closer inspection, it is evident that RG impact factors are based on the Thomson Reuters Web of Knowledge (WoK) database, which includes some 23,000 journals Web_of_Knowledge. Secondly, I am posting the following a little tongue in cheek (any Joe Schmoe can dig up quotes to support their cause), but in reality it is a balanced statement provided by a Polish researcher from Poznan University of Technology on RG: "RG score - no matter, how much his faults we can prove, precisely takes into account not only dry pronunciation of numbers (in terms of the publishing achievements), but also a scientist activity toward seeking contacts with other scientists. It is a factor which should not be underestimated, because in the end, for example, he may be much more important for the creation of successful multidisciplinary and international research teams (any type of cooperation), than dry numbers indicating the quantity and quality of publications".

We need to make a decision now and end this abnormally long and tedious interaction (for such a small adjustment to the original comment). I say again, if this is how Wikipedia editors in generally work when they are offered free advice and suggestions from credible, helpful, and intelligent sources then I have to reevaluate my future contributions. It has not been a pleasure. Adios amigos.

@Sjuttiosjuochfjorton: I'm sorry that you have been frustrated. While your participation is much valued, the fact is that honest disagreements about what an article should say are common, so you can't just assume that your "free advice and suggestions" will be uncritically accepted. While our methods of reaching consensus may seem tedious, they have been worked out through more than a decade of grappling with the very same fundamental issues that appear in the conversation we have been having.
There is a fundamental difference between an argument made by a reliable source from facts cited by that source and an argument made by a Wikipedia editor based directly on primary sources. The former is generally acceptable, while the technical term for the latter is original research, which is disallowed. That following this policy may result in only one side of an argument being represented is immaterial. If this bothers you, then the remedy is either to question the appropriateness of the source (as you have done, with results that are yet inconclusive) or to find a reliable source that supports the rebuttal you hope to make.
Whether Lugger's post is outdated is also immaterial, I think. The article already cites it as a description of what happened on RG in 2012. That is relevant, even if RG has changed since then. --BlueMoonlet (t/c) 18:34, 29 April 2014 (UTC)

Criticism section

Response to criticism section of this article

Obokata scandal

Related Articles

Wikiwand AI