DOPBot (talk · contribs)

Operator: Fl.schmitt (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions)

Bot's tasks for which permission is being sought:

• • DOPBot will add precise coordinates (SDC coordinates of the point of view (P1259)) to ~ 74,000 Orthophotos kindly provided by the Bavarian Agency for Digitisation, High-Speed Internet and Surveying. The files are currently organized by districts in Orthophotos from Bayerische Vermessungsverwaltung.
    • Currently, every file has the district's geographical center assigned als coordinates of the point of view (P1259) value. The same location is sometimes also hard-coded in the page text using {{Location}}. Using the district's geographic center for every file renders the geocoding almost useless (the real location might be off about 10 kilometers...).
    • To determine the exact location, DOPBot will check the file names for UTM coordinates. E.g., for DOP40_-_Stadt_Nürnberg_32643_5488_(Bayerische_Vermessungsverwaltung).tif, the UTM values are 32 / 643 / 5488, which reads 32U 643000 5488000 as UTM coordinate for the lower left corner of the orthophoto. The corresponding decimal geolocation is 49°31′40″N 10°58′34″E / 49.527730°N 10.976109°E / 49.527730; 10.976109.
    • For exact geocoding, DOPBot will use the center of each image to calculate the coordinates, which is very easy: just add 500 to the UTM northing/easting values. For geocoding DOP40_-_Stadt_Nürnberg_32643_5488_(Bayerische_Vermessungsverwaltung).tif, DOPBot will use the UTM coordinates 32U 643500 5488500, yielding the exact decimal geolocation of the orthophoto's center: 49°31′56″N 10°59′00″E / 49.532107°N 10.983196°E / 49.532107; 10.983196.
  • Additionally, DOPBot will delete any existing {{Location}} template, since {{Information}} template will render the exact SDC values automatically.
  • DOPBot won't touch an orthophoto at all if there are no UTM coordinates available.

Automatic or manually assisted: Automatic

Edit type (e.g. Continuous, daily, one time run): One time run

Maximum edit rate (e.g. edits per minute): 5-6?

Bot flag requested: (Y/N): Y

Programming language(s): Python (pywikibot)

--Fl.schmitt (talk) 11:24, 13 July 2025 (UTC)

Discussion

Please make test run. --EugeneZelenko (talk) 14:38, 13 July 2025 (UTC)

Please also add coordinates of depicted place (P9149) with the same coordinates as coordinates of the point of view (P1259), but set the precision value to like 0.01 not the sandard 0.000001 --Schlurcher (talk) 15:26, 13 July 2025 (UTC)

Also, I think {{Information}} does not include coordinates from SDC. You would need to add an {{Location}} without parameters. Also you should add {{Object location}} without parameters. --Schlurcher (talk) 15:31, 13 July 2025 (UTC)

@Schlurcher: ok, no problem. I'm not sure yet if and how to set a source claim for the calculated coordinates - see also my corresponding question on the SDC Talk. Additionally, I'll have to adapt the bot code to set both coordinate claims in a single edit. Fl.schmitt (talk) 16:42, 13 July 2025 (UTC)

@EugeneZelenko, @Schlurcher: Removing obsolete SDC locations and adding new ones now works in a single step. Here are the first five edited DOPs (had to rework the first and second file, the last three ones are solely edited by DOPBot):

• File:DOP40 - Stadt Nürnberg 32643 5488 (Bayerische Vermessungsverwaltung).tif
• File:DOP40 - Stadt Nürnberg 32643 5489 (Bayerische Vermessungsverwaltung).tif
• File:DOP40 - Stadt Nürnberg 32644 5472 (Bayerische Vermessungsverwaltung).tif
• File:DOP40 - Stadt Nürnberg 32644 5471 (Bayerische Vermessungsverwaltung).tif
• File:DOP40 - Stadt Nürnberg 32644 5476 (Bayerische Vermessungsverwaltung).tif

with their respective new position on a wikimap: https://wikimap.toolforge.org/?cat=Orthophotos_of_Nuremberg_from_Bayerische_Vermessungsverwaltung. Fl.schmitt (talk) 20:49, 13 July 2025 (UTC)

I've just modified the source claim in SDC of those five files manually, bot code already adapted. Fl.schmitt (talk) 05:46, 14 July 2025 (UTC)

Is there property for bounding box? It makes much more sense for aerial/satellite photos than location and object location. EugeneZelenko (talk) 14:22, 14 July 2025 (UTC)

I've thought about this already, but AFAIK there's no such property in Wikidata (I couldn't even find any discussion about that point). There are properties for the northernmost / southernmost / easternmost / westernmost point of a location (see coordinates of northernmost point (P1332) / coordinates of southernmost point (P1333) / coordinates of easternmost point (P1334) / coordinates of westernmost point (P1335)), but this isn't the same - additionally, there's no single northernmost point of an UTM-grid-based area. It would be very easy to calculate the exact position of the four corners (as it is the case regarding the area's center), but there's no Wikidata property for those values.

Having defined location / object location IMO makes sense on its own, esp. for a map-based access (see the wikimap i've linked) and for further categorization (name of villages, POIs and so on). So i think this information is quite useful as it is. Fl.schmitt (talk) 15:12, 14 July 2025 (UTC)

BTW: The Bounding Box question also affects maps. As far as I see, there's no SDC way to describe the boundingbox of a map, but the {{Map}} template allows for describing that property using the latitude property. See, for example File:Berlin Dusableau 1737.jpg with boundingbox information provided as template parameters, but not as SDC. Fl.schmitt (talk) 15:22, 14 July 2025 (UTC)

Thanks. For the SDC edits, please add the Special:Tags of "BotSDC" (this can be achived by setting the corresponding option in the wbeditentity function that you are using). Lot's of users like to filter these type of edits out. Also please perform 5 more of these edits including all corrections. There should be no manual edits been required afterwards. Overall this is looking good to me, thanks for making the effort. --Schlurcher (talk) 16:23, 14 July 2025 (UTC)

Please also update the second edit description (the one that will show up on the watch list to something like "... cleared to show SDC location based on UTM values from file name). As only the last edit is shown there, people should not need to go into the history to understand what and why this is happening. Thanks. --Schlurcher (talk) 16:26, 14 July 2025 (UTC)

@Schlurcher: good points - both done. Here are the next six files edited:

• DOP40 - Stadt Nürnberg 32644 5488 (Bayerische Vermessungsverwaltung).tif
• DOP40 - Stadt Nürnberg 32644 5487 (Bayerische Vermessungsverwaltung).tif
• DOP40 - Stadt Nürnberg 32644 5486 (Bayerische Vermessungsverwaltung).tif
• DOP40 - Stadt Nürnberg 32644 5479 (Bayerische Vermessungsverwaltung).tif
• DOP40 - Stadt Nürnberg 32644 5478 (Bayerische Vermessungsverwaltung).tif
• DOP40 - Stadt Nürnberg 32644 5477 (Bayerische Vermessungsverwaltung).tif

and the corresponding wikimap: https://wikimap.toolforge.org/?cat=Orthophotos_of_Nuremberg_from_Bayerische_Vermessungsverwaltung Fl.schmitt (talk) 17:43, 14 July 2025 (UTC)

Thanks. Fine for me. Schlurcher (talk) 21:40, 14 July 2025 (UTC)

HiW-Bot 4 (talk · contribs)

Operator: Hedwig in Washington (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions)

Bot's tasks for which permission is being sought:

• General cleanup, currently in Commons:Maintenance of main categories (Peru). Most tasks I do by hand, some are just tedious; adding 30x the same author, or adding language templates.
• Replacing categories, when doing other stuff (otherwise cat-a-lot). Mass-inserting templates like Institution templates, where appropriate.
• Adding descriptions to a series of files.

Automatic or manually assisted:

• mostly automatic supervised

Edit type :several times a week, as needed

Maximum edit rate (e.g. edits per minute):

• ca. 30 / min.

Bot flag requested: (Y/N):Y

Programming language(s):

• AWB mostly

--Hedwig in Washington ^(mail?) 20:10, 24 June 2025 (UTC)

Discussion

• I think manual / AWB edits of small batches should be done with the main account and without bot flag. --Krd 04:32, 25 June 2025 (UTC)

  • • I am not going to fix thousands of files again without some kind of automatic edits. The last time was murder. AWB requires constant interaction without bot flag; or did that change? Cheers,

  Hedwig in Washington ^(mail?) 04:46, 25 June 2025 (UTC)

  Above you said "Most tasks I do by hand". Did I get that wrong? Krd 07:00, 26 June 2025 (UTC)

Please make test run. EugeneZelenko (talk) 14:45, 25 June 2025 (UTC)

 Done

{{Special:Contributions/HiW-Bot|limit=9}} Hedwig in Washington ^(mail?) 05:39, 26 June 2025 (UTC)

Looks OK for me, but will be good idea to simplify edit summaries (Flickr URL is overkill) and clearly mention that affected changes relate to Author field. --EugeneZelenko (talk) 13:58, 26 June 2025 (UTC)

I'll change that, no problem. Hedwig in Washington ^(mail?) 23:00, 26 June 2025 (UTC)

Please make another test run. EugeneZelenko (talk) 14:25, 30 June 2025 (UTC)

Certainly:

30 June 2025

• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902657622).jpg clean up, adding Institution template current Tag: AWB
• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902657147).jpg clean up, adding Institution template current Tag: AWB
• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902353081).jpg clean up, adding Institution template current Tag: AWB
• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902352936).jpg clean up, adding Institution template current Tag: AWB
• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902352476).jpg clean up, adding Institution template current Tag: AWB
• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902351736).jpg clean up, adding Institution template current Tag: AWB
• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902351686).jpg clean up, adding Institution template current Tag: AWB
• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902350556).jpg clean up, adding Institution template current Tag: AWB
• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902349626).jpg clean up, adding Institution template current Tag: AWB
• 21:1721:17, 30 June 2025 diff hist −113 File:MINISTRO DE DEFENSA REALIZÓ VIAJE DE TRABAJO A LA REGIÓN CAJAMARCA (49902349461).jpg clean up, adding Institution template current Tag: AWB

I have to admit, it looks much cleaner now. ----Hedwig in Washington ^(mail?) 21:28, 30 June 2025 (UTC)

Looks OK for me. --EugeneZelenko (talk) 14:10, 1 July 2025 (UTC)

I'm not convinced. The task description is wide and vague, AWB batches of 30 edits per batch should IMHO be done with the main account. What is "Adding descriptions to a series of files.", how many files, wht is the source of the descriptions? Krd 12:27, 11 July 2025 (UTC)

If there are no objections, I think bot status should be granted. --EugeneZelenko (talk) 14:01, 11 July 2025 (UTC)

Please see one line above. Krd 09:15, 13 July 2025 (UTC)

There is a misunderstanding. It's not edits/batch, it's max edits/min. I believe sixty edits per minute is the standard limit for AWB? I don't care about the edit rate that much. I can throttle it up/down if needed. And yes, thirty files can be done with the main account, for sure.

Here's a quick batch size: Jircas 434 files, Ministry of Defense of Peru ~ 12k files, same for the Ministry of Defense, the rest is about 2k files or so of Ministry of XYZ of Peru. Then there's a bunch of maintenance of the other main categories of Peru. It's just not feasible with Visual File Change. --Hedwig in Washington ^(mail?) 12:03, 13 July 2025 (UTC)

BoreBot (talk · contribs)

Operator: Borealex (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions)

Bot's tasks for which permission is being sought:

• download hundreds of files using a pywikibot with pre-generated description templates;
• adding statement "captured with" (P4082) to structured data (code example).

Automatic or manually assisted: Automatic/supervised

Edit type (e.g. Continuous, daily, one time run): daily

Maximum edit rate (e.g. edits per minute): ~6 edits per minute

Bot flag requested: (Y/N): N

Programming language(s): Python (using Pywikibot)

Borealex (talk) 21:34, 29 April 2025 (UTC)

Discussion

Little clarification about adding structured data: the bot will not randomly sort through the metadata of all files, but will process files from ready-made lists received via the SQL-request (from Quarry for example). Test run: 1 2 3 4 5 6 7 8

What is that useful for? Is there any community consensus that this should be done a large scale? --Krd 13:36, 5 May 2025 (UTC)

Hi! I definitely know of at least one practical use for captured with added statements — the ability to search for examples of photos from various cameras, smartphones, camera lenses, scanners etc. This may not be a native user-friendly search functionality yet, but it's already working to some extent. The ability to make such requests useful, for example, when comparing devices before purchase. Some photohosting sites, such as Flickr, have similar functionality. And as my first step, I would like to contribute to filling the Wikimedia Commons with such information.

Answering your second question, I assumed that bots already exist that, among other things, perform the function of adding statements from EXIF metadata (for example), and if I understand correctly, there is a consensus on adding structured data by bots. The original idea was to create and fill categories, but I abandoned it in favor of structured data, based on the discussion of the BotAdventures discussion, where structured data is also given priority in this case. I would also add that the main difference between my bot and others will be the manual compilation of file lists according to something like this flow — I add a new device on Wikidata or add information about the Camera Model, create an SQL query and run the bot based on it. Borealex (talk) 20:24, 5 May 2025 (UTC)

I think structured data shall be set by bot only if they are useful, and I'm not convinced that it is relevant in more that a few dozen cases which camera a photo has been taken with. I think there should be specific community consensus before this can be approved to be applied to all files. Krd 07:13, 11 May 2025 (UTC)

Got it. Could you tell me please where would it be more relevant and appropriate to discuss this? Structured data Discussion page or Village pump? Borealex (talk) 18:23, 11 May 2025 (UTC)

I'm not sure, perhaps chose one of it and leave a link to it on the other? Krd 05:03, 17 May 2025 (UTC)

Started a discussion.

Commons:Village pump#Adding 'captured with' statement by bot

Commons talk:Structured data#Adding 'captured with' statement by bot Borealex (talk) 23:06, 24 May 2025 (UTC)

I've already been doing this for a while and some other bots too so we already have 40 million files with captured with (P4082).

Actually these edits will make it possible for the bots to pick up these files.

Your code looks like one of my old bots before structured data on Commons was added to Pywikibot. Have a look at a more recent one to see how you can do it now much cleaner. Multichill (talk) 18:43, 26 May 2025 (UTC)

Hi! My code is based on the code from here, and it's pretty old, yes. Thanks for the link, I'll study it soon. Borealex (talk) 08:43, 27 May 2025 (UTC)

I updated the code using pywikibot and the example from your bot. Thanks again for the help. Here is a test run after the update. Borealex (talk) 21:05, 2 June 2025 (UTC)

Ha, that looks much cleaner. You might also adopt the SPARQL logic so that you don't have to do that all manual. Multichill (talk) 17:00, 3 June 2025 (UTC)

Yes, I've already evaluated this script from your bot. At the moment, my bot's logic does not require a SPARQL-query, because as part of a each bot launch, the list of files will belong to a specific camera with a known QID. I plan to remove some of the manual work in the future by dealing with SQL queries, but I think I'll do it in the next step of updating my bot. Borealex (talk) 20:58, 4 June 2025 (UTC)

@Krd hi!

Is there any action required of me to approve the bot? Borealex (talk) 19:43, 21 June 2025 (UTC)

Has any consensus been reached? If yes, please link it here. Krd 09:14, 13 July 2025 (UTC)

I haven't received a single response in over a month. But as Multichill noted above, there are already nearly 41 million files in Commons that have captured with (P4082) added by bots. Couldn't this be considered as a consensus having been reached a long time ago? Borealex (talk) 12:06, 13 July 2025 (UTC)

Железный капут (talk · contribs)

Operator: MBH (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions), Iluvatar (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions), Well very well (talk · contributions · Statistics · Recent activity · block log · User rights log · uploads · Global account information) (assign permissions)

Bot's tasks for which permission is being sought: Hello! As one of the co-maintainers of the bot I request for it bot and rollback flags. The bot detects suspicious potentially vandalous edits (on Commons this also includes copyright issues), streams them onto a Discord server, and trusted users revert/rollback/RfD them through an interface. Bot is already running on Russian, Ukrainian, Belarusian Wikipedias and Wikidata.

Automatic or manually assisted: Manually assisted

Edit type (e.g. Continuous, daily, one time run): Continuous

Maximum edit rate (e.g. edits per minute): Few edits per day

Bot flag requested: (Y/N): Y

Programming language(s): C# and Python

Well very well (talk) 06:16, 20 March 2025 (UTC)

Discussion

@CptViraj Seems like for some reason here on Commons, when a user is linked in bot edits' descriptions that user gets pinged -- a behaviour that doesn't happen on ru/uk/bewiki or WD... Do you know what it may be caused by and would it be fixed with the bot flag? Well very well (talk) 13:01, 23 March 2025 (UTC)

@Well very well: Per T189040, notifications aren't sent for edit summary mentions if the edit is marked as bot edit (b), so yeah, this should be fixed with the bot flag. -- CptViraj (talk) 16:00, 23 March 2025 (UTC)

It seems from subtasks of that task that just adding : to the start of link should remove the ping. I will go currently with this approach then. Well very well (talk) 17:32, 23 March 2025 (UTC)

Edits adding speedy deletion tags should generally not be marked as bot, as they should not be hidden from watchlists. AntiCompositeNumber (talk) 19:06, 24 March 2025 (UTC)

Currently bot doesn't mark its edits as bot at all, so this shouldn't be a concern. Well very well (talk) 15:34, 25 March 2025 (UTC)

I have some concerns. The test edits that have been made are mostly speedy deletion nominations, which is outside of the bot task you have described, especially since the majority of the files were tagged for copyright reasons, not vandalism. Please revise the request to accurately describe what the bot is designed for and capable of doing. Additionally, the bot does not notify page creators of the speedy deletion tags. More broadly, this bot task appears to mostly have the effect of removing rollbacks and speedy deletion tags from a user's contributions & deleted contributions, where they can be easily monitored by administrators. This is important both to deal with bad reviewing and to be able to establish a history of accurate copyright tagging when applying for advanced rights. And while rollback-like tools like SWViewer and Twinkle make the Commons rollback right less important than it might have been in the past, this bot gives administrators no control over who may be using it. AntiCompositeNumber (talk) 19:05, 24 March 2025 (UTC)

@AntiCompositeNumber
Please revise the request to accurately describe what the bot is designed for and capable of doing.
Done.
Additionally, the bot does not notify page creators of the speedy deletion tags.
Ok, will be implemented, thanks!
More broadly, this bot task appears to mostly have the effect of removing rollbacks and speedy deletion tags from a user's contributions & deleted contributions, where they can be easily monitored by administrators. This is important both to deal with bad reviewing and to be able to establish a history of accurate copyright tagging when applying for advanced rights.
Well, you can use tool for searching through user's descriptions — for that reason the bot always includes the type of action (RfD/rollback/undo) and user who did it in its edit description.
And while rollback-like tools like SWViewer and Twinkle make the Commons rollback right less important than it might have been in the past, this bot gives administrators no control over who may be using it.
Hm... @MBH @Iluvatar Maybe we can make the bot take the users list from a wiki page, e.g. a subpage of bot userpage on Meta? In this case everyone could see the list and stewards could also edit it. Well very well (talk) 15:42, 25 March 2025 (UTC)

Maybe we can make the bot take the users list from a wiki page, e.g. a subpage of bot userpage on Meta? In this case everyone could see the list and stewards could also edit it.
This is implemented now. Well very well (talk) 19:10, 10 July 2025 (UTC)

@Well very well: Please report current state. --Krd 07:03, 11 May 2025 (UTC)

@Well very well:  ? --Krd 06:22, 29 May 2025 (UTC)

Oops, sorry, I wasn't checking the pings. I wasn't really working on the bot in the last 2 months (will continue the work soon) — so everything's the same currently. Should I proceed with implementing the suggestion from my last comment? Well very well (talk) 11:39, 29 May 2025 (UTC)

I'm not sure, but in any case please keep this page updated as long as the request is open. Krd 16:37, 12 June 2025 (UTC)