User talk:Citation bot/Archive 9

Not gonna happen. We work on templates only. That is basically a different bot. AManWithNoPlan (talk) 04:30, 20 August 2018 (UTC)

"Citation bot" has a scope of citations. There's no reason not to deal with raw urls. Headbomb {t · c · p · b} 04:32, 20 August 2018 (UTC)

we do nothing with references. We only do templates. It would require a completely different code base. AManWithNoPlan (talk) 04:34, 20 August 2018 (UTC)

It's already approved for this. See Wikipedia:Bots/Requests_for_approval/Citation_bot_8. Headbomb {t · c · p · b} 04:35, 20 August 2018 (UTC)

approved yes. Code no. AManWithNoPlan (talk) 04:38, 20 August 2018 (UTC)

The 'entirely new' codebase is a minute amount of pre-processing.

<ref([^>]*)>http(s)?:\/\/([^ \>]+)<\s*\/\s*ref>
  →
<ref$1>{{cite web |url=http$2://$3}}</ref>

If the bot gets a hit with that, expand, if not, keep raw url. Headbomb {t · c · p · b} 04:41, 20 August 2018 (UTC)

Actually not that simple. Search needs to be non greedy. Would need to have some type of bogus parameter set to either completely revert at end or just remove the specific flag. Lots of testing, and that’s the pain. AManWithNoPlan (talk) 04:54, 20 August 2018 (UTC)

Point is, this wouldn't be an epic 3-months long development process. Yes some thought needs to be put into it, but the codebase for recognizing stuff from URLs is relatively mature. If that gets a hit, whatever you're going to have will beat the raw url. And it'll save doing before running the bot to get . Headbomb {t · c · p · b} 04:58, 20 August 2018 (UTC)

Laying in bed it came to me:

1. search for and change to cite web, but with extra CITATION_BOT parameter that is encrypted url
2. do normal bot stuff
3. when writing out look for CITATION_BOT flag and If no title is set then just decrypt url and echo that. If title is set remove special flag.

We have do that since url might get upgraded but find no title, such as citeseerer or bad doi. AManWithNoPlan (talk) 12:59, 20 August 2018 (UTC)

More information;

1. the backup url is encrypted to hide it from bot
2. CITATION_BOT is a magic phrase so if we leave one in the Bot will notice
3. we have unused code to call Citoid but they throttle us too much
4. we need to reject any urls with spaces or set braces or square braces just to be safe
5. we would want to try this on the dev bot first

AManWithNoPlan (talk) 13:10, 20 August 2018 (UTC)

Work in progress https://github.com/ms609/citation-bot/pull/621 AManWithNoPlan (talk) 20:28, 20 August 2018 (UTC)

Note, <ref([^>]*)>\[?http(s)?:\/\/([^ \>]+)\]?\s*<\s*\/\s*ref> works better. Headbomb {t · c · p · b} 20:41, 20 August 2018 (UTC)

Opinions on this https://github.com/ms609/citation-bot/pull/628 AManWithNoPlan (talk) 19:34, 21 August 2018 (UTC)

No opinion on the technical side of things, but that's pretty much what I suggested above, so I'm all for it. Headbomb {t · c · p · b} 19:35, 21 August 2018 (UTC)

Seems to be missing \[? and \]? around the URL to catch <ref>[http://example.com]</ref> Headbomb {t · c · p · b} 19:39, 21 August 2018 (UTC)

Character escaping seems off, my understand is that '\>' could be '>'. That or all the other '<' or '>' need to be escaped. Headbomb {t · c · p · b} 19:43, 21 August 2018 (UTC)

No longer escape things that do not need escapes in RegEx. Added support for [http.....] AManWithNoPlan (talk) 20:03, 21 August 2018 (UTC)

Very much looking forward to test this. I've got plenty of pages in the pipeline. Headbomb {t · c · p · b} 20:08, 21 August 2018 (UTC)

This works, so, sooooooooooo well it's insane. Whenever it fails, it's because there's an actually problem with the url/identifiers. This is amazing. Headbomb {t · c · p · b} 14:18, 22 August 2018 (UTC)

I've noticed this a few times now; there's an example visible at

https://tools.wmflabs.org/citations/doibot.php?page=Talk:Galileo%20Galilei

See that line

 - https://books.google.com/books

? We must be adding and removing this URL somewhere along the line, because we're not editing the citation...

Martin (Smith609 – Talk) 14:44, 21 August 2018 (UTC)

Possibly related to User talk:Citation bot#Raw url refs or User talk:Citation bot/Archive 29#Google Books in Cite Web are not expanded? Headbomb {t · c · p · b} 14:59, 21 August 2018 (UTC)

It is not doing anything other than echoing that url. Strange. AManWithNoPlan (talk) 15:11, 21 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/627 AManWithNoPlan (talk) 15:50, 21 August 2018 (UTC)

Fixed

Using the bot on Category:Draft-Class Astronomy articles will, obviously, run the bot on that category.

• https://tools.wmflabs.org/citations/category.php?cat=Draft-Class_Astronomy_articles

However, it would be very useful to have the bot run on the main pages associated with those talk pages in the category. I.e. take all pages in Category:Draft-Class Astronomy articles, convert to main pages, and run the bot on those. Perhaps via something like

• https://tools.wmflabs.org/citations/talkcategory.php?cat=Draft-Class_Astronomy_articles

or

• https://tools.wmflabs.org/citations/category.php?talkcat=Draft-Class_Astronomy_articles

Headbomb {t · c · p · b} 14:39, 17 August 2018 (UTC)

https://tools.wmflabs.org/citations/category.php?cat=Draft-Class_Astronomy_articles&talk=1 would be the way to go. The Bot would get a list of the category and then add "Talk:" to each page title (or change "User:" to "User_Talk:" in the case of user pages or just ignore user talk pages). AManWithNoPlan (talk) 18:28, 19 August 2018 (UTC)

• Possible solution [Suggestion 1]: modify function category_members in WikiFunctions.php so that it removes the namespace from all pages that it queues up to visit. I can't think of many situations when one would want to run the bot on pages outside the main namespace, and it could be disruptive if someones deliberately included an incorrectly formatted citation in a discussion.
• Alternative solution [Suggestion 2]: Add the main namespace equivalent of each Talk page to the array of pages to be visited.

Martin (Smith609 – Talk) 14:19, 21 August 2018 (UTC)

I've gone ahead and implemented suggestion 1. Martin (Smith609 – Talk) 14:54, 21 August 2018 (UTC)

@Smith609: Which is suggestion 1? Or more clearly, what's the syntax for this? Headbomb {t · c · p · b} 19:44, 21 August 2018 (UTC)

Whatever he did, he did not commit it to github AManWithNoPlan (talk) 19:47, 21 August 2018 (UTC)

https://tools.wmflabs.org/citations/category.php?cat=Draft-Class_Astronomy_articles now visits all mainspace articles whose talk pages are in Category:Draft-Class_Astronomy_articles. Martin (Smith609 – Talk) 05:08, 22 August 2018 (UTC)

@Smith609: that's not very useful though (Mainspace articles associated with draft talk? What'd be the use of that?). What would be useful is if it visited the [[Foobar:<...>]] pages associated with [[Foobar talk:<...>]]. Headbomb {t · c · p · b} 11:17, 22 August 2018 (UTC)

• Ah, I'd missed the introduction of the "Draft" namespace. I see what you are trying to accomplish now. Fixed in GitHub Pull 641. Martin (Smith609 – Talk) 09:18, 24 August 2018 (UTC)
  • @Smith609: so now it works as {Suggestion 2}? Headbomb {t · c · p · b} 11:09, 24 August 2018 (UTC)
    • Yep, should do. Let me know how you get on. Martin (Smith609 – Talk) 12:46, 24 August 2018 (UTC)
      • @Smith609: works flawlessly. Save for all the other bugs, which are now much more efficiently triggered! Headbomb {t · c · p · b} 16:32, 24 August 2018 (UTC)

https://en.wikipedia.org/w/index.php?search=in-source%3A%22https%3A%2F%2Fwww.ncbi.nlm.nih.gov%2Fsites%2Fentrez%2F%22&title=Special:Search&profile=default&fulltext=1&searchToken=k3ig3e0tgj7hn3p0ig9gmvkk Does not look worth it to me AManWithNoPlan (talk) 21:52, 21 August 2018 (UTC)

Better search: but you might be right here. Headbomb {t · c · p · b} 22:50, 21 August 2018 (UTC)

That link gives no hits. AManWithNoPlan (talk) 23:46, 21 August 2018 (UTC)

Better . Headbomb {t · c · p · b} 00:04, 22 August 2018 (UTC)

most of those do not link to and article AManWithNoPlan (talk) 03:01, 22 August 2018 (UTC)

All of those do? = PMID 17046367. &uid= is the pmid, see . Headbomb {t · c · p · b} 04:17, 22 August 2018 (UTC)

interesting. The links are dead, but the pmid is in the link AManWithNoPlan (talk) 04:34, 22 August 2018 (UTC)

Well they're not dead for me. Headbomb {t · c · p · b} 15:10, 22 August 2018 (UTC)

Dead on the mobile site. Interesting. That’s a good reason to recognize and fix. AManWithNoPlan (talk) 15:18, 22 August 2018 (UTC)

Not a bug Fixed them all by hand since only a couple were in citation templates. AManWithNoPlan (talk) 22:14, 26 August 2018 (UTC)

Won't fix See .Headbomb {t · c · p · b} 21:55, 26 August 2018 (UTC)

back to back der seems to not work right. AManWithNoPlan (talk) 22:13, 26 August 2018 (UTC)

Then don't bother fixing. der der is obviously a typo. Headbomb {t · c · p · b} 22:16, 26 August 2018 (UTC)

E.g.

This was activated via https://tools.wmflabs.org/citations/doibot.php?edit=toolbar&slow=1&user=Headbomb&cat=Particle_physics%20stubs

And the edit summary should reflect this. Possibly even deny category runs without a &user= value specified. Headbomb {t · c · p · b} 01:22, 23 August 2018 (UTC)

Working for me:

https://tools.wmflabs.org/citations/category.php?cat=X1&user=Smith609 generated https://en.wikipedia.org/w/index.php?title=User%3ADOI+bot%2FZandbox&diff=prev&oldid=856337766

Category.php will now show a note where the username is invalid or not specified.

As you're making more use of it I'll add a user-friendly interface to doibot.html in the future, to save manually editing URLs... Martin (Smith609 – Talk) 14:27, 24 August 2018 (UTC)

I'm triggering it via User:Headbomb/citations.js, but that would be a great features for the average Wikipedian. Might want to implement this in Wikipedia:Citation expander too, but I'd rather wait till we have a "run on list" (would be very useful in the Book: namespace, e.g. Book:Canada) and throttling before making that request. Headbomb {t · c · p · b} 14:34, 24 August 2018 (UTC)

Fixed in GitHub Pull 660 Now you can prompt the bot to edit multiple pages by separating their names with a pipe, e.g. "page1|page2". Martin (Smith609 – Talk) 19:59, 24 August 2018 (UTC)

Interesting, although I don't know that it's very user-friendly to do that. Couldn't easily run it on say, Book:Canada or User:Headbomb/Sandbox4. And I'm not sure it could handle having 2000 articles shoved in as article1|article2|...|article1999|article2000. Headbomb {t · c · p · b} 20:58, 24 August 2018 (UTC)

. Headbomb {t · c · p · b} 00:27, 23 August 2018 (UTC)

Fixed in GitHub Pull 638 AManWithNoPlan (talk) 23:46, 23 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/638 AManWithNoPlan (talk) 23:45, 23 August 2018 (UTC)

• I have a similar one, the Dutch "en", which means "and", should not be capitalised to "En" either, as done here at the bottom: FunkMonk (talk) 04:13, 24 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/650 AManWithNoPlan (talk) 15:05, 24 August 2018 (UTC)

This is more a question than a bug report, is it intentional that all words that are normally not capitalised, such as "the, as, in, an, of" etc., in journal names are now capitalised? And now it seems another bot is changing some of this back? FunkMonk (talk) 16:14, 23 August 2018 (UTC)

Journals should use title case, so if something doesn't use title case, that would be an issue. Converting to title case is fine and encouraged. Note that there was a bug in Citation bot that capitalized journals by mistake for a little while, that's fixed now. Headbomb {t · c · p · b} 16:18, 23 August 2018 (UTC)

Ok, that was what I was referring to, seems I had not completed the sentence above. FunkMonk (talk) 16:47, 23 August 2018 (UTC)

Not a bug. Fixed already AManWithNoPlan (talk) 23:07, 23 August 2018 (UTC)

To be clear, I tried running Citation bot on this today, and it failed to update the caps. So I did it via JCW-CleanerBot instead. It just so happened that Citation bot made the last edit before JCW-CleanerBot. Headbomb {t · c · p · b} 23:57, 23 August 2018 (UTC)

how are launching the bot? It worked for me both master and dev version AManWithNoPlan (talk) 00:17, 24 August 2018 (UTC)

Via . Test page is setup at User:Headbomb/sandbox4. Headbomb {t · c · p · b} 00:31, 24 August 2018 (UTC)

doibot.php incorrectly does not notice some changes. Because nothing was reported as changed the bot avoided doing a null edit AManWithNoPlan (talk) 01:47, 24 August 2018 (UTC)

@AManWithNoPlan: so what's the most bleeding edge / most advanced code / unstable code available to mortals? Headbomb {t · c · p · b} 01:50, 24 August 2018 (UTC)

the gadget api where you are editing the file works right. Also if there had been more to do on the page then it would have done the modifications-AManWithNoPlan (talk) 01:56, 24 August 2018 (UTC)

Another one. It's really annoying to have to do them by hand when the bot could be fixed them. Headbomb {t · c · p · b} 00:05, 25 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/666 The pull of the beast AManWithNoPlan (talk) 01:21, 25 August 2018 (UTC)

\m/(-_-)\m/ Headbomb {t · c · p · b} 01:21, 25 August 2018 (UTC)

 > Checking AdsAbs database
   > AdsAbs search 3177/50000:
       arXiv:"1305.7450"
   + Adding bibcode: 2013arXiv1305.7450M
   ~ Renamed "eprint" -> "arxiv"
   - Dropping parameter "class"

bibcodes typically denote journals. The bot now (PR 647) won't assume that a bibcode denotes a journal, if the bibcode contains the string "arxiv". Are there any other cases that we should watch out for? Martin (Smith609 – Talk) 12:00, 24 August 2018 (UTC)

There are. I'll get a list. Headbomb {t · c · p · b} 12:04, 24 August 2018 (UTC)

####arXiv
####gr.qc
####hep.ex
####hep.lat
####hep.ph
####hep.th
####math.ph
####math
####nucl.ex
####nucl.th
####physics

#### being years. That should cover it. You could simplify it to ####hep, ####math and ####nucl for those with sub-arxivs. Actually no, that might lead to some collisions. Headbomb {t · c · p · b} 12:09, 24 August 2018 (UTC)

Thanks for the list. These additions Fixed in GitHub Pull 654. Martin (Smith609 – Talk) 18:00, 24 August 2018 (UTC)

WP:BOTPOL suggests that rate for non-critical tasks. While I'm not a stickler for rules, the potential for damage is relatively high, especially in several WP:BEANS scenario (it just edited at a rate of 25 EPM on a recent run!). So implementing a per-activation throttle would be best. Headbomb {t · c · p · b} 12:34, 24 August 2018 (UTC)

I've coded a throttle, but not tested it; I'd be grateful if you could keep an eye out and see whether you notice throttling in action! Martin (Smith609 – Talk) 17:44, 24 August 2018 (UTC)

@Smith609: seems to work. I unleashed it on Category: CS1 maint: PMC format which had 15 very easy edits to make, and it cleared it at 6 EPM. The category API doesn't update during the run, but you do get the results after the run. Not sure if the throttle is 'smart' (edits at 6/min) or 'dumb' (processes at 6/min), but it's working. Headbomb {t · c · p · b} 18:13, 24 August 2018 (UTC)

Great. The script now keeps track of when it last edited, and makes sure that this was at least 10 seconds ago, which probably makes it 'semi-smart' (as if it spent the first 50 seconds of a minute without making an edit, it could squeeze five into the last ten seconds!) Martin (Smith609 – Talk) 06:38, 25 August 2018 (UTC)

See . Headbomb {t · c · p · b} 10:10, 26 August 2018 (UTC)

Fixed

https://github.com/ms609/citation-bot/pull/632 AManWithNoPlan (talk) 23:59, 21 August 2018 (UTC) Fixed

do should not be capitalized (at least not in Memórias Do Instituto Oswaldo Cruz), see https://en.wikipedia.org/w/index.php?title=Leptoconops&diff=prev&oldid=855945017 (t) Josve05a (c) 21:49, 21 August 2018 (UTC)

The Tower of Babel strikes again. AManWithNoPlan (talk) 22:01, 21 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/631 AManWithNoPlan (talk) 22:02, 21 August 2018 (UTC)

Fixed

Forget |via=[[JSTOR]] (or |via=JSTOR) and |registration= if the bot forgets |url=https://www.jstor.org/stable/29780032 in favor of |jstor=; see https://en.wikipedia.org/w/index.php?title=Sir_John_Ellerman,_1st_Baronet&diff=prev&oldid=855994139 (t) Josve05a (c) 05:58, 22 August 2018 (UTC)

In general |access-date= / |archive-date= / |archive-url= / |dead-url= / |format= / |registration= / |subscription= / |url-access= / |via= can be all be omitted if there are no url. |format= is tricky though, since it's abused for a lot of things that should be in |type= instead. Headbomb {t · c · p · b} 13:13, 22 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/637 AManWithNoPlan (talk) 23:38, 23 August 2018 (UTC)

Fixed

From this:

{{Cite journal |last1=Levasseur |first1=David G. |last2=Sawyer |first2=J. Kanan |date=August 19, 2006 |title=Pedagogy Meets PowerPoint: A Research Review of the Effects of Computer-Generated Slides in the Classroom |url=https://www.tandfonline.com/doi/full/10.1080/15358590600763383 |url-access=subscription <!-- but archive is ungated --> |journal=Review of Communication |issn=1535-8593 |publisher=Taylor and Francis |volume=6 |issue=1–2 |pages=101–123 |doi=10.1080/15358590600763383 |archive-url=https://www.webcitation.org/6YM4kjvL0?url=http://www.tandfonline.com/doi/full/10.1080/15358590600763383 |dead-url=no |archive-date=May 7, 2015 |access-date=September 23, 2017 |quote= [quotation redacted]}}

the bot produced this:

{{Cite journal |last1=Levasseur |first1=David G. |last2=Sawyer |first2=J. Kanan |date=August 19, 2006 |title=Pedagogy Meets PowerPoint: A Research Review of the Effects of Computer-Generated Slides in the Classroom |url-access=subscription <!-- but archive is ungated --> |journal=Review of Communication |issn=1535-8593 |volume=6 |issue=1–2 |pages=101–123 |doi=10.1080/15358590600763383 |dead-url=no |quote= [quotation redacted]}}

Levasseur, David G.; Sawyer, J. Kanan (August 19, 2006). "Pedagogy Meets PowerPoint: A Research Review of the Effects of Computer-Generated Slides in the Classroom". Review of Communication. 6 (1–2): 101–123. doi:10.1080/15358590600763383. ISSN 1535-8593. [quotation redacted] {{cite journal}}: |url-access= requires |url= (help); Unknown parameter |dead-url= ignored (|url-status= suggested) (help)

—Trappist the monk (talk) 13:39, 22 August 2018 (UTC)

See also User talk:Citation bot#Forget more things. Headbomb {t · c · p · b} 14:00, 22 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/637 AManWithNoPlan (talk) 23:38, 23 August 2018 (UTC)

Could be generalized to any punctuation (.,;:… or ...). Headbomb {t · c · p · b} 01:58, 24 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/637 AManWithNoPlan (talk) 23:37, 23 August 2018 (UTC)

The bot should be able to detect that https://www.jstor.org/stable/pdf/10.1525/j.ctt1ffjn5h.6.pdf is the same as https://www.jstor.org/stable/10.1525/j.ctt1ffjn5h.6 and be able to expand that. It failed to do so here https://en.wikipedia.org/w/index.php?title=Mughal%E2%80%93Safavid_War_(1649%E2%80%9353)&diff=prev&oldid=856169186 (t) Josve05a (c) 11:24, 23 August 2018 (UTC)

See also . Headbomb {t · c · p · b} 11:41, 23 August 2018 (UTC)

Fixed in GitHub Pull 657 Martin (Smith609 – Talk) 19:03, 24 August 2018 (UTC)

Maybe the bot shouldn't remove URLs with doi's in them, if the |doi= is broken (with a |doi-broken-date=). https://en.wikipedia.org/w/index.php?title=Israel&diff=prev&oldid=856185012

From

<ref>{{cite journal|url=http://opil.ouplaw.com/view/10.1093/law:epil/9780199231690/law-9780199231690-e1301|title=Israel, Occupied Territories|publisher=|doi=10.1093/law:epil/9780199231690/law-9780199231690-e1301|doi-broken-date=2018-07-07}}</ref>

to

<ref>{{cite journal|title=Israel, Occupied Territories|publisher=|doi=10.1093/law:epil/9780199231690/law-9780199231690-e1301|doi-broken-date=2018-08-23}}</ref>

(t) Josve05a (c) 13:03, 23 August 2018 (UTC)

Great report, thanks. Fixed in GitHub Pull 656 Martin (Smith609 – Talk) 18:38, 24 August 2018 (UTC)

The bot added this from JSTOR. It both looks weird, and the |first1= doens't have a ; to display the Ó character (which should be used instead directly instead of using HTML code.

|last1 = mórdha|first1 = Pilip &#xd3

https://en.wikipedia.org/w/index.php?title=Achaidh_Leithdeircc&diff=prev&oldid=856303097 (t) Josve05a (c) 08:32, 24 August 2018 (UTC)

See correct edit: https://en.wikipedia.org/w/index.php?title=Achaidh_Leithdeircc&diff=856304296&oldid=856303097 (t) Josve05a (c) 08:34, 24 August 2018 (UTC)

Fixed in GitHub Pull 655 Martin (Smith609 – Talk) 18:22, 24 August 2018 (UTC)

Fixed in GitHub Pull 677 The bot should simplify

• |url=https://www.researchgate.net/profile/Qi-fu_Chen/publication/252679525_The_2008_Wenchuan_Earthquake_and_Earthquake_Prediction_in_China/

to

• |url=https://www.researchgate.net/publication/252679525

See , right before |bibcode= 2010BuSSA.100.2840C.

In general, the structure will be https://www.researchgate.net/profile/FOOBAR/publication/DIGITS...

Headbomb {t · c · p · b} 11:24, 26 August 2018 (UTC)

The correct url ends in process_page.php AManWithNoPlan (talk) 17:27, 26 August 2018 (UTC)

There should perhaps be an 'internal redirect', since several scripts make use of it. Headbomb {t · c · p · b} 17:49, 26 August 2018 (UTC)

the official method has been fixed. Almost all of those have been broken for many years. AManWithNoPlan (talk) 17:53, 26 August 2018 (UTC)

the correct search is https://en.wikipedia.org/w/index.php?search=insource%3A%2Fdoibot%5C.php%2F+-insource%3ADOI_bot&title=Special:Search&profile=advanced&fulltext=1&ns2=1&searchToken=4x836wn6m7sw0hmzfe6bs818k not the one that you posted. I fixed both publicly editable pages, leaving a few peoples common.js files. AManWithNoPlan (talk) 18:02, 26 August 2018 (UTC)

When you put stuff in your our files such as User:Josve05a/citations.js, instead of just turning on the the citation bot option, you get what you get and you don't throw a fit. AManWithNoPlan (talk) 18:03, 26 August 2018 (UTC)

I'm not using that. I'm using User:Smith609/citations.js. (t) Josve05a (c) 18:10, 26 August 2018 (UTC)

I've even forgotten I did even did that. It was due to the "official script" was broken for a few weeks/months back in 2014 if I can remember. It had been working ever since, so somehting recently changed. I didn't (mean to) throw a fit, I just wanted to draw attention to that the "old way" the script worked, just broke. (t) Josve05a (c) 18:06, 26 August 2018 (UTC)

I have a copy of it for the dev version so, I had to fix that myself too. The "don't throw fit" is an american phrase used to warn kids in advance that complaints will not be listen too (my using is was mostly in jest). Here are some links to the official version AManWithNoPlan (talk) 18:11, 26 August 2018 (UTC)

https://en.wikipedia.org/wiki/MediaWiki:Gadget-citations.js

https://en.wikipedia.org/wiki/MediaWiki_talk:Gadget-citations.js

https://en.wikipedia.org/wiki/Wikipedia:Citation_expander

I hope you understand I only want to help out (with my limited knowledge) by reporting issues which are affecting me or which I'm noticing, and not trying to complain. (t) Josve05a (c) 18:22, 26 August 2018 (UTC)

The Smith scripts are not really updated anymore since we got official support from media wiki. He should probably remove them actually. AManWithNoPlan (talk) 18:12, 26 August 2018 (UTC)

Yeah, some () are still using it. (t) Josve05a (c) 18:13, 26 August 2018 (UTC)

• Thanks for the report. I've updated the Smith script, and will keep an eye out for other outdated links (I couldn't turn any others up by Google). A redirect is probably a good idea too. Martin (Smith609 – Talk) 08:43, 27 August 2018 (UTC)

And it even says "No need to repeat AdsAbs search for 1994ASAJ...96.1218T" 😏🤔🙄😂 AManWithNoPlan (talk) 22:24, 26 August 2018 (UTC)

Obviously! The bot knows it would just fail again! Headbomb {t · c · p · b} 22:45, 26 August 2018 (UTC)

@Smith609: This is partially fixed: Headbomb {t · c · p · b} 11:58, 27 August 2018 (UTC)

Now fully fixed. . Headbomb {t · c · p · b} 16:31, 27 August 2018 (UTC)

Please forget all variants of |publisher=Books.google.com from {{cite book}} (such as |publisher=, |work=, |website=, but also |foo=Google Books, |foo=Google, |foo=google.com etc. (t) Josve05a (c) 19:28, 22 August 2018 (UTC)

See https://en.wikipedia.org/w/index.php?title=Japanese_hip_hop&diff=prev&oldid=856085189 (t) Josve05a (c) 19:28, 22 August 2018 (UTC)

Agreed! Headbomb {t · c · p · b} 19:48, 22 August 2018 (UTC)

I hate seeing publisher=Google. Copyright-Thief=Books.Google.Com is cool though. AManWithNoPlan (talk) 01:00, 23 August 2018 (UTC)

Is via=Google Books permissible? Martin (Smith609 – Talk) 07:45, 25 August 2018 (UTC)

It is, but it's ... a relatively spammy practice. I remove it, but I don't think it would be appropriate for the bot to remove/add it.Headbomb {t · c · p · b} 20:08, 26 August 2018 (UTC)

• Conservatively addressed in https://github.com/ms609/citation-bot/pull/672; thoughts welcome before I commit... Martin (Smith609 – Talk) 07:54, 25 August 2018 (UTC)

{{fixed}}

Once Cluebot III is running again this page will get cleaned up.

{{notabug}} flagging so that this goes away when fixed. AManWithNoPlan (talk) 20:25, 24 August 2018 (UTC)

Was just wondering about that myself. Thanks for checking! Martin (Smith609 – Talk) 20:19, 24 August 2018 (UTC)

still down. https://en.wikipedia.org/wiki/Special:Contributions/ClueBot_III AManWithNoPlan (talk) 20:24, 24 August 2018 (UTC)

It is back online. It may take a while to get to us. AManWithNoPlan (talk) 13:22, 27 August 2018 (UTC)

We don't handle Cite Magazine. the bot'll now rename magazine to journal in cite journal. Martin (Smith609 – Talk) 07:31, 25 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/676 AManWithNoPlan (talk) 19:45, 26 August 2018 (UTC)

{{fixed}}

> Consult APIs to expand templates
 > Using pubmed API to retrieve publication details: 
   > Found match for pubmed identifier 11090370
   > Found match for pubmed identifier 29262068
   > Found match for pubmed identifier 21324708
   > Found match for pubmed identifier 14718418
   > Found match for pubmed identifier 26185361
   > Found match for pubmed identifier 18023732
   > Found match for pubmed identifier 11472968
   > Found match for pubmed identifier 18032698
   > Found match for pubmed identifier 28144783
   > Found match for pubmed identifier 6370120
   > Found match for pubmed identifier 30069044
   > Found match for pubmed identifier 30069046
   + Adding volume: 560
   + Adding issue: 7718
   + Adding pmid: 30069046
 > Checking PMID 30069046for more details
   + Adding doi: 10.1038/s41586-018-0394-6
   + Adding pmc: 6108322
   + Adding journal: Nature
   - Dropping parameter "publisher"
   - Dropping parameter "location"
   > Found match for pubmed identifier 25613900
   > Found match for pubmed identifier 25169055
   > Found match for pubmed identifier 24812003
   > Found match for pubmed identifier 21356587
   > Found match for pubmed identifier 19223979
   > Found match for pubmed identifier 22323207
   > Found match for pubmed identifier 23378277
   > Checking that DOI 10.1038/s41586-018-0394-6 is operational... DOI ok.
   > Checking that DOI 10.2214/ajr.175.6.1751537 is operational... DOI ok.
   > Checking that DOI 10.1016/j.ejcts.2010.12.028 is operational... DOI

Weird. Must be new multi-template code since it works fine on a single template AManWithNoPlan (talk) 02:36, 27 August 2018 (UTC)

I cannot reproduce it. Double weird. AManWithNoPlan (talk) 03:54, 27 August 2018 (UTC)

@AManWithNoPlan: Was caused by an invisible NSBP, which WP:WikEd exposed when I edited the page. Removing it fixed the cause of the issue locally, but seems to fix the issue being triggered in the first place everywhere. Headbomb {t · c · p · b} 11:54, 27 August 2018 (UTC)

When it finds an arXiv year it adds it. AManWithNoPlan (talk) 02:35, 27 August 2018 (UTC)

Dupe of report above User talk:Citation bot/Archive_9#Adds year even if date is there after getting arxiv data. (t) Josve05a (c) 11:57, 27 August 2018 (UTC)

This may need some research to see if there are exceptions. (t) Josve05a (c) 13:14, 27 August 2018 (UTC)

I have always felt this would be good idea, but J Food is probably not Journal Food, but journal of Food or the journal of food. Every journal would be a special case. AManWithNoPlan (talk) 13:19, 27 August 2018 (UTC)

If the J. is of the end of a |journal= and the word Journal (or magazine) is not present, then it sounds to me a good bet that it should be replaced with |journal=Foo Journal. (t) Josve05a (c) 13:26, 27 August 2018 (UTC)

Very, very bad idea, per WP:CONTEXTBOT, and per lack of consensus. If you want this to be done on a specific page, delete the abbreviations and run the bot again. Headbomb {t · c · p · b} 13:34, 27 August 2018 (UTC)

that’s what I do. Many people would consider this upgrade to be ‘worse than vandalism’. I consider them wrong, but there would blood everywhere AManWithNoPlan (talk) 13:52, 27 August 2018 (UTC)

(We could start a (small) list, and maintain it, and adding new journals one by one...but that's way much work) (t) Josve05a (c) 13:53, 27 August 2018 (UTC)

The list or journal is huuuge, and you may run awry of WP:CITEVAR by messing consistently abbreviated journals in an article to a mish-mash of abbreviated-and-not-abbreviated journals in the same article. But if you get consensus for something like this, this would be better addressed by a different, possibly new bot.Headbomb {t · c · p · b} 14:10, 27 August 2018 (UTC)

Yes, a separate bot with separate approval. One page of php code. 300 pages of journal names. AManWithNoPlan (talk) 15:00, 27 August 2018 (UTC)

Note, the parameter doesn't yet exist, but I've made a request for it. Coding support for it should be rather trivial though. Headbomb {t · c · p · b} 15:40, 21 August 2018 (UTC)

No need for this, I found a better solution: User:Citation bot/use#... the bot made a mistake. Headbomb {t · c · p · b} 03:33, 29 August 2018 (UTC)

There is no consensus for messing around with valid abbreviations. Fixing caps / title case is fine, but converting abbreviations to non-abbreviations is not, at least not without a strong consensus to do so.Headbomb {t · c · p · b} 13:31, 27 August 2018 (UTC)

In that case, it should keep caps. (t) Josve05a (c) 13:39, 27 August 2018 (UTC)

That has actually been debated and the belief at the time was that DOI was better than JSTOR and if they were exactly the same, then only list the DOI. This DOI is not owned by JSTOR, so it is not truly stable. JSTOR owns 10.2307 AManWithNoPlan (talk) 23:20, 27 August 2018 (UTC) {{notabug}}

The bot does sometimes get throttled by databases. Also, sometimes they just fail. AManWithNoPlan (talk) 14:51, 29 August 2018 (UTC)

I updated the User:Citation bot user page to be prettier / more user friendly. Feel free to tweak. I also gave a major revamp the User:Citation bot/use guide. Please review/tweak, you can discuss the revamped guide at User talk:Citation bot/use#Revamp feedback. Headbomb {t · c · p · b} 17:17, 25 August 2018 (UTC)

Great! Thanks! Martin (Smith609 – Talk) 09:00, 27 August 2018 (UTC)

after a while just change that talk page to a redirect to here AManWithNoPlan (talk) 22:14, 27 August 2018 (UTC)

{{fixed}}ed it up very nice!!! AManWithNoPlan (talk) 16:11, 31 August 2018 (UTC)

it has a page number without a - character so the bot assumes a single page number and thus when it gets a range of pages it upgrades to the range. Pages are one of the few things we might blow away and replace. AManWithNoPlan (talk) 04:45, 25 August 2018 (UTC)

The bot has been overwriting comments for a long time. AManWithNoPlan (talk) 15:12, 21 August 2018 (UTC)

Oh dear; I wonder how much dud information has been introduced as a result! Even if there is a better way to deal with false positives, I'm not sure how we might make a transition now that a standard has been set... Martin (Smith609 – Talk) 15:20, 21 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/630 page numbers AManWithNoPlan (talk) 20:44, 21 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/629 series and ISSN AManWithNoPlan (talk) 20:44, 21 August 2018 (UTC)

I think that once these two pulls are in, the code should respect comments again. AManWithNoPlan (talk) 23:59, 21 August 2018 (UTC)

Still does it btw . Headbomb {t · c · p · b} 16:37, 24 August 2018 (UTC)

of course it does. The code has not been changed yet AManWithNoPlan (talk) 17:12, 24 August 2018 (UTC)

Well it's pretty hard to tell what's in the bot and what isn't. Headbomb {t · c · p · b} 17:15, 24 August 2018 (UTC)

Why have one page keyword when you can have five! (“At” is the only one that is special) https://github.com/ms609/citation-bot/pull/692 AManWithNoPlan (talk) 19:03, 29 August 2018 (UTC)

https://github.com/ms609/citation-bot/pull/691 AManWithNoPlan (talk) 16:34, 28 August 2018 (UTC)

Duplicate of User_talk:Citation_bot#Removal_of_trailing_full_stop. Headbomb {t · c · p · b} 23:24, 31 August 2018 (UTC)