Commons:Batch uploading

Request a batch upload Current requests Past batch uploads Failed batch uploads
Category:Commons batch uploading

Commons Batch Uploading is a project to centralize the uploading of a collection of files, that have released their work as PD or any Commons compatible license. The files would be assigned to a bot operator who would see how the request would be fulfilled.

Before you request a batch upload here, please read the guide to batch uploading first.

See w:Wikipedia:Public domain image resources for potential future batch uploads.

Related project: Commons:Library back up project aims to upload books in public domain from libraries of all languages.

Requests

Legislation.gov.uk Acts of Parliament

  1. Acts of Parliament from 1975 to 1990 in the form of booklets.
  2. Acts of Parliament since then (i.e. from 1991).

Source to upload from

License

As they are hosted on legislation.gov.uk, they are licensed under {{OGL3}}.

Description

Around early April 2025, National Archives (which operates legislation.gov.uk) replaced Stationery Office booklet scans of British Acts to scans from the annual Public General Acts collections ("PGA collections") by overwriting their hosted files, which affected Acts until 1990. This is identifiable by the lack of table of contents and the page numbers. For example, one may refer to the current version of Theft Act 1968 on Commons with the one now hosted on legislation.gov.uk.

uploaded the available scans of Acts to here up to 1975, but the rest are wiped out by the National Archives. Fortunately many of the requested scans are archived on the Wayback Machine, and the original links follow the format of https://www.legislation.gov.uk/ukpga/YYYY/CC/pdfs/ukpga_YYYY00CC_en.pdf, where:

  • YYYY is the year of enactment; and
  • CC is the chapter number, and should be filled with a 0 if the chapter number is smaller than 10 (e.g. chapter 1 means 01).

And as a secondary request, I also request that post-1990 Acts can also be batch uploaded to Commons at the same time. They are unaffected by National Archives' move, so I believe bot uploads for them would be easier to deal with.

To preserve the aforementioned files, I request this batch upload process. Please feel free to comment if there are any other information needed, thank you.廣九直通車 (talk) 13:07, 1 May 2025 (UTC)

The title of each file on commons should be of the form "ActName (UKPGA YYYY-chapnum qp)". For acts passed during the reign of Charles III replace qp with kp. ToxicPea (talk) 01:26, 3 May 2025 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Portable Antiquities Scheme

All PAS images should be uploaded, on a recurring basis.

Source to upload from

Example (for File:Iron Age Coin, Stater of the Corieltauvi (FindID 622777).jpg):

Source
https://finds.org.uk/database/ajax/download/id/473330
Catalog
https://finds.org.uk/database/images/image/id/473330/recordtype/artefacts archive copy
Artefact
https://finds.org.uk/database/artefacts/record/id/622777

License

Various Commons-compatible CC licences

Description

User:Fæ was making these uploads on a regular basis (as of January 2021, there were over 614,980 files; I assisted with subsequent categorisation) before they left the project. AFAICT, no work has been one since then. The images are highly valuable from an historic and educational PoV.

See User:Fæ/Project list/PAS for detailed documentation.

Andy Mabbett (Pigsonthewing); Talk to Andy; Andy's edits 18:17, 4 September 2023 (UTC)

Opinions

I've requested a property for the image ID to track it better: d:Wikidata:Property proposal/Portable Antiquities Scheme image ID -- DaxServer (talk) 13:02, 23 April 2025 (UTC)

Created as ‎Portable Antiquities Scheme image ID (P13556). Andy Mabbett (Pigsonthewing); Talk to Andy; Andy's edits 18:03, 6 May 2025 (UTC)
I'll file a bot request to fill the property for the ~600,000+ files in a couple of days. Once that is done, let's review the batch upload -- DaxServer (talk) 19:19, 6 May 2025 (UTC)
@Pigsonthewing I've filed a bot request at Commons:Bots/Requests/CuratorBot (6) for the SDC to begin with. Also, there are some corrections to be done (see that page for the info). If you some ideas on how we can fix the errors, let me know -- DaxServer (talk) 15:54, 9 May 2025 (UTC)
Thank you. No idea on the errors. How odd. How are you finding them? Andy Mabbett (Pigsonthewing); Talk to Andy; Andy's edits 16:02, 9 May 2025 (UTC)
Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Śląskie Digitarium (Silesian Digitarium)

The purpose of the Silesian Digitarium project is the digitisation and accessibility of the cultural resources of the Silesian province through a comprehensive system of digitisation, archiving and presentation of collections.

Source to upload from

All images to be uploaded will be added to Wikimedia Poland's Google Drive

License

Creative Commons: Attribution 4.0 ( https://creativecommons.org/licenses/by/4.0/ )

The Wojciech Korfanty Institute is the owner of the property copyrights to the submitted works under Article 12 of the Law on Copyright and Related Rights, as the authors performed these works as part of their official duties while being employees of the Institution.

File sharing consent was sent to: permissions-pl@wikimedia.org, and its number will be added to the template when uploading.

I confirm that above mentioned consent with the list of pictures has been sent to VTR: ticket:2025031410006899. Polimerek (talk) 13:48, 14 March 2025 (UTC)

Description

Uploading of photos taken as part of the “Silesian Digitarium” project is made as part of the cooperation between Wikimedia Poland and the Wojciech Korfanty Regional Institute of Culture.

I will be adding all photos to Wikimedia Commons using Open Refine and the official Wikimedia Poland account: User:Ada Jakubowska (WMPL). I will do this in several rounds, with the first round being a trial, with a small number of photos (max 40). The planned number of photos to be uploaded is 4 753, and each will include templates such as: - Template:Wojciech Korfanty Institute partnership (Mobile Digitization Centre) - License template with upload consent number Each photo will have a category: Category:Media contributed by the Mobile Digitization Centre and, if possible, a category related to the ritual shown in the photo The source in the description of each file will be: Wojciech Korfanty Regional Institute of Culture (Q28672957)

Names of images in the Commons will be named according to the formula: [event name]_[file number]_RIKiWK_MCD

Ada Jakubowska (WMPL) (talk) 13:39, 14 March 2025 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Museovirasto collection

The Finnish Heritage Agency (Museovirasto) has approximately 386,935 CC-BY 4.0 licensed images available through the Finna.fi platform that could be valuable additions to Wikimedia Commons. These images document Finnish cultural heritage, including historical photographs, artifacts, and architectural documentation.

Source to upload from

License

386,935 images are licensed under CC-BY 4.0.

Description

Each image comes with extensive metadata through the Finna API including:

  • Original titles in Finnish and sometimes Swedish
  • Descriptions and historical context
  • Dates and time periods
  • Creator/photographer information
  • Geographic locations
  • Subject keywords and classifications
  • Collection and archival references
  • Technical image information

The images will be categorized using: 1. Primary tracking categories

  • Media contributed by the Finnish Heritage Agency
  • Collections of the Finnish Heritage Agency

2. Content-based categories derived from Finna metadata:

  • Location categories (from "Aiheen paikka")
  • Time period categories (from "Aiheen aika")
  • Subject matter categories (from "Aiheet")
  • Photographer categories (from creator fields)
  • Media type categories (from "Aineistotyyppi")
  • Cultural heritage categories

Technical details:

  • The Finna API (api.finna.fi) provides full programmatic access
  • High-resolution images are available
  • Structured metadata enables automated categorization
  • API includes pagination and filtering capabilities

Template usage:

  • Information template for core metadata
  • Institution template for Museovirasto
  • Creator templates for photographers
  • Multilingual descriptions (Finnish/English where available)

The upload will be conducted in phases: 1. Initial test batch (100 images) 2. Themed batches by subject matter 3. Systematic upload of remaining collection

--Apinanaivot (talk) 18:41, 18 January 2025 (UTC)

Opinions

Assigned to Progress Bot name Category
Planning
Category:Commons batch uploading#Museovirasto%20Finna

Videos by Psych2Go

The videos of the Channel "Psych2Go"

Source to upload from

https://www.youtube.com/@Psych2Go

License

{{YouTube CC-BY|Psych2Go}}

Description

The videos addresses different psychological-related topics; often with references. The topics are based on psych health, love and social relationships, and more.

PantheraLeo1359531 😺 (talk) 12:17, 13 November 2024 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Videos by Psych2Go
Category:Commons batch uploading#Batch%20uploading

George Michell Bengal Photographs

Source to upload from

All digitised photographs have been uploaded to this Google Drive

License


Creative Commons Attribution-Share Alike 4.0 International

George Michell as the sole owner of the physical photographic slides has released the copyright of that work under the above license.

Detailed discussion with the Wikimedia VRT agent and link to the ticket is available in this section of the Discussion tab of the Wikimedia Grant page.

Description

1. All the metadata including file names and locations is in this Google Sheet.

2. Photos are within folders named after sites photographs were taken. The metadata file has references to locations.

  • Do the media URLs follow a pattern: Yes, metadata file has details.
  • Does the site have an API: Not sure. It is a Google Drive folder.
  • What else could ease uploading: Metadata file.
  • Did you contact the site owner: Photos are uploaded to my personal Google Drive.
  • Is there a template that could be used on the file description pages, or should one be created: In the metadata file.


AmitGuha (talk) 18:02, 7 June 2024 (UTC)

Hello @AmitGuha. Rows 469 and 470 has no Creator. Should it be assumed to be George Michell or be left blank? -- DaxServer (talk) 09:48, 20 September 2024 (UTC)
Are the GPS coordinates: of the building or of the photographer? -- DaxServer (talk) 10:31, 20 September 2024 (UTC)
Would you be able to provide some Wikimedia Commons categories for the files?
By default, they'd added to Category:George Michell and Category:Centre for Studies in Social Sciences -- DaxServer (talk) 10:42, 20 September 2024 (UTC)
Is Commons:Batch uploading/George Michell Bengal Temples request a duplicate? -- DaxServer (talk) 11:08, 20 September 2024 (UTC)
There are quite some discrepancies in the Sheets compared to the Drive. Please refine them, it's becoming harder for me to validate -- DaxServer (talk) 14:40, 20 September 2024 (UTC)
Many thanks @DaxServer for the comments above.
1. I will fix all of the missing creator and discrepancies on sheets vs drive and respond here.
2. Yes, I will provide additional Wikimedia Commons categories
I have found some other errors as well. I will need a couple of weeks to fix this and will respond and tag you here when I'm done.
On the other questions:
1. The GPS coordinates are of the buildings
2. Commons:Batch uploading/George Michell Bengal Temples is a duplicate and can be removed
Thanks again! AmitGuha (talk) 21:51, 23 September 2024 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Yevgeny Khaldei photographs

Photographs in public domain by famous Soviet photographer Yevgeny Khaldei.

Source to upload from

https://russiainphoto.ru/search/years-1937-1953/?query=&author_ids=171

License

Public domain - {{PD-Russia}}{{Yevgeny Khaldei as TASS photographer}} (2,453 files)

Description

  • Do the media URLs follow a pattern?
    • Description page: for example https://russiainphoto.ru/photos/180701/, but not all files are in order in the catalog numbering system
    • Description pages contain plenty of metadata such as title, caption, source museum, date taken, place taken and keywords, which should be included
    • Full size images: for example https://735606.selcdn.ru/thumbnails/photos/2017/09/04/ztjzboam0rskxuxz_1024.jpg, however not every file was uploaded on the same day and some files have urls like https://735606.selcdn.ru/thumbnails/photos/9/6/o/96o52b30d244f515_1024.jpg
  • Does the site have an API? - Yes
  • What could ease uploading? The source code for every image page brought up by search query includes source code with this text.

<div class="share share_size_small b-photo__share-block" data-description="" data-title="Подвеска авиабомб в самолет Пе-2, 1941 год" data-url="https://russiainphoto.ru/photos/180589/" data-image="https://735606.selcdn.ru/thumbnails/photos/2017/09/04/qpip0gtkuggujqqo_1024.jpg"></div>

    • Information from the field data-title should be the image title
    • data-url is the description url
    • data-image is the link to the full size image
  • Did you contact the site owner? - Not necessary
  • Is there a template that could be used on the file description pages, or should one be created? - Not necessary


Kges1901 (talk) 17:37, 8 August 2024 (UTC)

I uploaded the photos from before 1946 because Template:PD-Russia-1996 says "created by an employee of TASS, ROSTA, or KarelfinTAG as part of that person’s official duties between July 10, 1925 and January 1, 1946"  REAL 💬   09:54, 10 April 2025 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Landesarchiv Baden-Württemberg

The Baden-Württemberg state archive (w:de:Landesarchiv Baden-Württemberg) provides access to over 25,000,000 digitized files documenting the history of the german state of Baden-Württemberg. The majority of the files are digitized/microfilmed documents, but the collection also includes plenty of images.

Source to upload from

https://www2.landesarchiv-bw.de/ofs21/home.php is the starting point of the archive. However, to ease navigation for this purpose, I made a list of the (in my opinion) contents most intresting for commons, mostly photos and maps:

Staatsarchiv Freiburg / State archive Freiburg
Series ID Series Name Link Date Digitized files Notes on digitized files Status
A 25/1 Landgericht Freiburg (1823-) 1879-1945 (-1963) 1,903 court files
A 47/1 Staatsanwaltschaft beim Sondergericht Freiburg 1933-45 (Nazi German) 103,265 court documents, generally nazi german specific crimes such as desertion
A 66/1 Direktorium des Dreisamkreises 1800-1830 238 digitized materials are largely architectural plans of buildings
B 685/1 Bezirksamt Achern 55
B 686/1 Bezirksamt Appenweier 8 plats
B 694/1 Bezirksamt Breisach 205
B 695/1 Landratsamt Donaueschingen 119
B 698/5 Landratsamt Emmendingen 1,302 plats, building plans
B 700/1 Bezirksamt Engen 32
B 701/1 Bezirksamt Ettenheim 59
B 702/1 Landratsamt Freiburg 1,213
B 704/1 Bezirksamt Gengenbach 49
B 711/1 Bezirksamt Jestetten 102 building plans
B 713/1 Landratsamt Kehl 1,191
B 714/1 Bezirksamt Kenzingen 181
B 715/1 Landratsamt Konstanz 5,067
B 717/2 Landratsamt Lahr 5,422
B 719/1 Landratsamt Lörrach 3,564
B 723/1 Bezirksamt Meßkirch 86
B 725/1 Landratsamt Müllheim 327
B 726/1 Landratsamt Neustadt 211
B 727/12 Bezirksamt Oberkirch 117
B 728/1 Landratsamt Offenburg 151
B 729/1 Bezirksamt Pfullendorf 2
B 730/1 Bezirksamt Radolfzell 248
B 731/1 Bezirksamt Rheinbischofsheim 18
B 733/1 Landratsamt Säckingen 3,759
B 734/1 Bezirksamt Salem 52
B 735/1 Bezirksamt St. Blasien 14
B 738/1 Bezirksamt Schönau 46
B 740/1 Bezirksamt Schopfheim 2,603
B 741/1 Bezirksamt Staufen 32
B 743/1 Landratsamt Stockach 16
B 744/1 Bezirksamt Stühlingen 10
B 747/1 Landratsamt Überlingen 185
B 748/1 Landratsamt Villingen 162
B 749/1 Bezirksamt Waldkirch 25
B 750/14 Landratsamt Waldshut (1544 - 1804) 1805 - 1952 (1953 – 1989) 167
G 1000/1 Landwirtschaftsämter und landwirtschaftliche Schulungseinrichtungen Kreis Waldshut 1934-1977 3,667 largely images
K 345 Karten und Pläne aus Bezirks- und Landratsamtsbeständen ca. 1810 - ca. 1968 1780
T 1 (Zugang 2005/0058) Nachlass Allgeier, Sepp 5,087
T 1 (Zugang 2009/0034) Nachlass Baudendistel, Peter 659
T 1 (Zugang 1975/0001) Nachlass Blankenhorn, Erich 23,098
T 1 (Zugang 2015/0038) Nachlass Bolanz, Julius Friedrich 100
T 1 (Zugang 2010/0034) Nachlass Drischel, Dr. Friedrich 106
T 1 (Zugang 2008/0032) Nachlass Eckert, Klaus 193
T 1 (Zugang 2014/0036) Nachlass Herr, Konrad 123
T 1 (Zugang 2017/0006) Nachlass Hoppe, Oskar I 117
T 1 (Zugang 1974/0013) Nachlass Lorenz, Adolf 845
T 1 (Zugang 1999/0046) Nachlass Middendorff, Wolf 276
T 1 (Zugang 1992/0347) Nachlass Schinzinger, Fridolin 717
T 1 (Zugang 2003/0065) Nachlass Tröndle, Wilhelm I 212
W 110/1 Plakatsammlung I 401
W 134 (Glaspl.) Sammlung Willy Pragher I: Glasplattennegative 1926-92 4,933
W 134 (Filmnegative I) Sammlung Willy Pragher I: Filmnegative I, Bildordner 3-307 1926-92 62,133
W 134 (Filmnegative II) Sammlung Willy Pragher I: Filmnegative II, Bildordner 311-787 1926-92 43,209
W 134 (Filmnegative III) Sammlung Willy Pragher I: Filmnegative III, Bildordner 804-1921 1926-92 39,172
W 134 (Mittelformatdiapositive) Sammlung Willy Pragher I: Mittelformatdiapositive 1926-92 5,218
W 134 (Kleindiapositive) Sammlung Willy Pragher I: Kleindiapositive 1926-92 1,641
W 140 Fotosammlung Marlis Decker 1976-2005 5,838
W 145/1 Bildsammlung v. Lamezan – Hundt ca. 1801 - ca. 1953 147
W 145/2 Bildsammlung Karl Fritz 1890 – 1950 414
W 145/3 Bildsammlung Losch-Olson 1921-1943 302
W 145/4 Fotosammlung Georg Corcodel 1880 - ca. 1945 1048
W 145/5 Fotosammlung Norbert Armbruster 2012-2015 27
W 251 Kriegsbriefsammlung Badische Zeitung Freiburg 1914-1918 167
W 307 Sammlung Karl Fritz 1870-1982 6,245
TOTAL 340,208
Generallandesarchiv Karlsruhe / General state archive Karlsruhe
Series ID Series Name Link Date Digitized files Notes on digitized files Status
46 Haus- und Staatsarchiv: I. Personalia 1693 67 military plans
Hfk Planbände Hausfideikommiss, Planbände 1-28 1600s 116 military plans
69 Baden, Sammlung 1995: Fotosammlung I ca. 1850 - 1923 (-1951) 9,284 historic buildings
498-1 Glasnegative Wilhelm Kratt (1869-1949) - Landesamt für Denkmalpflege, Außenstelle Karlsruhe 1900-1935 8,926 historic buildings
498-2 Denkmalpflege - Sammlung Karl Weysser 1858-1902 1,011 historic buildings
57-3 Badisches Staatstheater Karlsruhe – Fotos late 1800s - 2009 10,521
456 F 1 Armee-Oberkommando 7 World War I 45 military photos
456 F 2 Armee-Abteilung A World War I 55 military photos
456 F 3 Armeeabteilung B World War I 1,467 military photos
456 F 5 Generalkommando XIV. Armeekorps: Frieden und Abwicklung World War I 35 military photos
456 F 6 Generalkommando XIV. Armeekorps: Krieg und Abwicklung World War I 278 military photos
456 F 7 Generalkommando XIV. Reservekorps World War I 282 military photos
456 F 8 Stellvertretendes Generalkommando XIV. Armeekorps World War I 2 military photos
456 F 11 28. Infanterie-Division: Feld World War I 112 military photos
456 F 12 29. Infanterie-Division: Feld World War I 158 military photos
456 F 13 56. Infanterie-Division World War I 218 military photos
456 F 14 200. Infanterie-Division World War I 48 military photos
456 F 15 222. Infanterie-Division (später Oberbaustab 222) World War I 51 military photos
456 F 16 28. Reserve-Division World War I 24 military photos
456 F 17 75. Reserve-Division World War I 30 military photos
456 F 18 8. Landwehr-Division World War I 65 military photos
456 F 19 12. Landwehr-Division (später Ostsee-Division und Deutscher General in Finnland) World War I 118 military photos
456 F 20 55. Infanterie-Brigade: Feld World War I 50 military photos
456 F 22 56. Infanterie-Brigade: Feld World War I 20 military photos
456 F 23 57. Infanterie-Brigade: Feld World War I 102 military photos
456 F 24 58. Infanterie-Brigade: Feld World War I 29 military photos
456 F 25 84. Infanterie-Brigade World War I 12 military photos
456 F 26 112. und 513. Infanterie-Brigade World War I 64 military photos
456 F 29 56. Reserve-Infanterie-Brigade World War I 1 military photos
456 F 31 55. Landwehr-Infanterie-Brigade World War I 84 military photos
456 F 32 56. Landwehr-Infanterie-Brigade World War I 284 military photos
456 F 74 28. und 29. Kavallerie-Brigade Inspektion der Ersatz-Eskadronen des XIV. Armeekorps World War I 5 military photos
456 F 82 Artillerie-Kommandeur 28 World War I 97 military photos
456 F 83 Artillerie-Kommandeur 29 World War I 3 military photos
456 F 84 Artillerie-Kommandeur 56 World War I 176 military photos
456 F 85 Artillerie-Kommandeur 75, 85, 126, 127, 142, 222 World War I 49 military photos
456 F 137 Oberleitung Grenzschutz Baden-Schweiz World War I 30 military photos
456 F 34 Füsilier-Regiment 40 World War I 76 military photos
456 F 35 Leib-Grenadier-Regiment 109 World War I 225 military photos
456 F 36 Grenadier-Regiment 110 World War I 117 military photos
456 F 37 Infanterie-Regiment 111 World War I 69 military photos
456 F 38 Infanterie-Regiment 112 World War I 77 military photos
456 F 39 Infanterie-Regiment 113 World War I 88 military photos
456 F 40 Infanterie-Regiment 114 World War I 45 military photos
456 F 41 Infanterie-Regiment 142 World War I 7 military photos
456 F 42 Infanterie-Regiment 169 World War I 27 military photos
456 F 43 Infanterie-Regiment 170 World War I 69 military photos
456 F 44 Infanterie-Regiment 185 World War I 40 military photos
456 F 46 Infanterie-Regiment 469 World War I 25 military photos
456 F 47 Infanterie-Regiment 470 World War I 19 military photos
456 F 49 Ersatz-Infanterie-Regiment 28 World War I 5 military photos
456 F 50 Ersatz-Infanterie-Regiment 29 World War I 20 military photos
456 F 51 Reserve-Infanterie-Regiment 40 World War I 75 military photos
456 F 53 Reserve-Infanterie-Regiment 109 World War I 117 military photos
456 F 54 Reserve-Infanterie-Regiment 110 World War I 147 military photos
456 F 55 Reserve-Infanterie-Regiment 111 World War I 255 military photos
456 F 56 Reserve-Infanterie-Regiment 249 World War I 8 military photos
456 F 59 Landwehr-Infanterie-Regiment 109 World War I 1 military photos
456 F 63 Landsturm-Infanterie-Bataillone des XIV. Armeekorps World War I 20 military photos
456 F 64 Sturmbataillon 7 World War I 43 military photos
456 F 65 Sturmbataillon 16 World War I 49 military photos
456 F 66 Feldrekruten-Depot der 28. und 29. Infanterie-Division World War I 30 military photos
456 F 70 Feldrekruten-Depot der 8. Landwehr-Division World War I 1 military photos
456 F 72 Maschinengewehr-Scharfschützen-Abteilungen, Maschinengewehr-Instandsetzungs-Werkstätten, Maschinengewehr-Schulen World War I 8 military photos
456 F 81 Jäger-Regimente 2 und 3, Gebirgsersatz-Abteilung des II. Bataillons des Jäger-Regiments 3, Jäger-Bataillon Stephanus World War I 71 military photos
456 F 77 Dragoner-Regiment 22 World War I 2 military photos
456 F 86 Feldartillerie-Regiment 14 World War I 118 military photos
456 F 87 Feldartillerie-Regiment 30 World War I 5 military photos
456 F 88 Feldartillerie-Regiment 50 World War I 224 military photos
456 F 89 Feldartillerie-Regiment 66 World War I 272 military photos
456 F 90 Feldartillerie-Regiment 76 World War I 19 military photos
456 F 91 Feldartillerie-Regimenter 104, 259, 261, 270 Feldartillerie-Abteilungen 298, 1003, 1007 Feldartillerie-Batterien 854, 855, 856, 859, 964 Infanterie-Geschütz-Batterien 3 und 9 Nahkampf-Batterie 220 World War I 20 military photos
456 F 92 Gebirgsartillerie-Abteilung 5 (mit Gebirgs-Batterien 14, 15, 16), Gebirgsartillerie-Abteilung 6 (mit Gebirgs-Batterien 1, 2, 17), Ersatz-Abteilung der Gebirgsartillerie-Abteilungen 5 und 6, Gebirgskanonen-Batterie "Rennecke" World War I 5 military photos
456 F 93 Reserve-Feldartillerie-Regimenter 28, 29, 52, 55 World War I 8 military photos
456 F 94 Landwehr-Feldartillerie-Regimenter 4, 12, 15 World War I 225 military photos
456 F 96 Fußartillerie-Regiments-Stäbe 119 und 224 World War I 1 military photos
456 F 97 Fußartillerie-Regiment 14 World War I 19 military photos
456 F 98 Fußartillerie-Regiment 24 World War I 5 military photos
456 F 99 Fußartillerie-Bataillone 33, 61, 68, 98, 151 World War I 7 military photos
456 F 101 Licht- und Schallmeßtrupps World War I 589 military photos
456 F 102 Reserve-Fußartillerie-Regiment 14 World War I 138 military photos
456 F 103 Reserve-Fußartillerie-Regiment 24 World War I 34 military photos
456 F 104 Landwehr-Fußartillerie-Bataillone 14, 50, 59, Landsturm-Fußartillerie-Bataillon XIV. A. K. World War I 5 military photos
456 F 105 Stabsoffizier der Pioniere Nr. 52, Pionier-Bataillone und Pionier-Bataillonsstäbe, Pionier-Kompanien, Reserve-, Landwehr- und Landsturm-Pionier-Kompanien, Brückentrains des XIV. Armeekorps, selbständige Pionierformationen World War I 600 military photos
456 F 106 Minenwerfer-Bataillone, Minenwerfer-Kompanien, selbständige Minenwerferformationen World War I 293 military photos
456 F 108 Nachrichtentruppen World War I 104 military photos
456 F 119 Kraftfahr-Formationen World War I 70 military photos
456 F 110 Train-Formationen des XIV. Armeekorps und Militärische Prüfungsstelle Pforzheim World War I 28 military photos
456 F 114 Feldlazarette, Reserve-Feldlazarette und Landwehr-Feldlazarette World War I 16 military photos
456 F 115 Sanitäts-Kompanien World War I 8 military photos
456 F 117 Krankentransport-Abteilungen, Sanitätsdepots, Lazarettzüge, Krankensichtungsstellen, Krankensammelstellen World War I 3 military photos
456 F 118 Durchgangslager-, Garnisons-, Kriegsgefangenen-, Offiziers-, Reserve- und Vereinslazarette World War I 15 military photos
456 F 112 Pferdedepots, -lazarette und -sammelstellen World War I 17 military photos
456 F 109 Mobile Etappen-Kommandanturen World War I 37 military photos
456 F 123 Armierungsformationen und Etappen-Hilfsbataillone World War I 131 military photos
456 F 146 Etappen-Inspektion 7 World War I 9 military photos
456 F 147 Etappen-Inspektion 19 World War I 35 military photos
456 F 148 Etappen-Inspektion 28 World War I 81 military photos
456 F 113 Sanitätsamt World War I 85 military photos
456 F 124 Proviantämter/-depots, Durchgangslager, Verpflegungsanstalten, Schlächtereien, Kriegsgefangenenstellen, Material- und Veterinärdepots World War I 3 military photos
456 F 128 Garnisonkommandos World War I 10 military photos
456 F 129 Garnisonverwaltungen und Militärbauamt Rastatt World War I 3 military photos
456 F 150 Intendantur des Generalkommandos und des Stellvertretenden Generalkommandos sowie die Abwicklungsintendantur des XIV. Armeekorps World War I 6 military photos
456 F 151 Feldintendanturen World War I 6 military photos
456 F 143 Kriegstagebücher:
Artillerie-, Pionier-, Nachrichten-, Train-, Armierungs-, Sanitäts- und Etappenformationen
World War I 69 military photos
456 G 2 Fotosammlung der Offiziere des XIV. Armeekorps World War I 341 military photos
421 K 1 Eisenbahndirektion/Bundesbahndirektion Karlsruhe: Planrollen 1832-1993 554 railroad doumentation
J-B Ansichten von Orten und Landschaften 1400s-2011 2,988
J-D Geschichtliche Ereignisse 171
J-E Belagerungen und Schlachten 123
J-G Revolution 1848-1849 in Baden und in der Pfalz 108
J-S Karikaturen Karikaturen zum Vormärz und zur Revolution 1848 - 1849 265
J-H Karikaturen 18
J-L Mode, Trachten und Berufsgruppen 200
F-S Neuwirth Fotografien von Abgeordneten des badischen Landtags 41
F-S Paulcke Fotosammlung des Prof. Wilhelm Paulcke (1873-1949) 1869-1950 476
F-S Wochenschau Propagandafotos aus dem Ersten Weltkrieg 1917-1918 255
F-S Schmeiser Fotografien von Abgeordneten des badischen Landtags 1908 - 1933 120
J-S Velten Sammlung Velten: Künstlerpostkarten 1897-1901 88 postcards
G Technische Pläne I Technische Pläne I (allgemein), eine Auswahlpräsentation 40
G Technische Pläne III Technische Pläne III: Patentschriften 112
H Gemarkungspläne 1500s-1900s 9248 maps
H-1 Gemarkungspläne 1:10000 (farbig) 1857-1935 1532 maps
O Neuere Flugblätter 77
P Plakate 15
S Thomas Kellner Sammlung des Buchhändlers und Antiquars Thomas Kellner 1494 – 2003 1,016 Photo & map collection
TOTAL 56,766
Grundbuchzentralarchiv Kornwestheim / Plat book central archive Kornwestheim

238,424 digized files online, only a tiny fraction of the entire archive. Questionable if in commons scope.

Staatsarchiv Ludwigsburg / State Archive Ludwigsburg
Series ID Series Name Link Date Digitized files Notes on digitized files Status
E 18 III Hof-/Landes-/Staatstheater Stuttgart: Fotos und Graphiken 1800-ca. 1960 6,995
EL 18 IV Staatsarchiv Ludwigsburg: Fotosammlung 1989 1,028
EL 20/4 III a Regierungspräsidium Stuttgart: Glasplatten zu Straßen- und Wasserbau (bis 9x12 cm) 430
EL 20/4 III b Regierungspräsidium Stuttgart: Glasplatten zu Straßen- und Wasserbau (13x18 cm) 395
EL 20/4 III c Regierungspräsidium Stuttgart: Glasplatten zu Straßen- und Wasserbau (18x24 cm) 103
EL 20/4 III d Regierungspräsidium Stuttgart: Glasplatten zu Straßen- und Wasserbau (24x30 cm) 5
EL 68 VI Landesvermessungsamt Baden-Württemberg: Flurkarten der Württemberg. und Hohenz. Landesvermessung (Digitalisate) 1818-1863 16,672
EL 68 IX Landesvermessungsamt Baden-Württemberg: Landesbefliegung Baden-Württemberg 1968 - Luftbilder und digitales Orthophoto 1968 19,568 statewide aerial photography
EL 75 I Landesamt für Straßenwesen Baden-Württemberg 1934-2002 1,726
EL 75 VI a Landesamt für Straßenwesen: Bildersammlung zum Autobahnbau (Papierabzüge auf Karteikarten) 1930-2000 7,499
EL 75 VI b Landesamt für Straßenwesen: Bildersammlung zum Autobahnbau (Historische Glasplatten) 285
EL 75 VI c Landesamt für Straßenwesen: Bildersammlung zum Autobahnbau (Kleinbild-Dias I) 676
EL 75 VI d Landesamt für Straßenwesen: Bildersammlung zum Autobahnbau (Kleinbild-Dias II) 1982-1999 3,854
EL 221/8 Württembergisches Staatstheater Stuttgart: Dekorationsmappen 1954-1989 1633
EL 228 a I Landesdenkmalamt Baden-Württemberg: Fotosammlung, Glasplatten Mittelformate 4,910
EL 228 a II Landesdenkmalamt Baden-Württemberg: Fotosammlung, Glasplatten Großformate 1,193
EL 228 a III Landesdenkmalamt Baden-Württemberg: Fotosammlung, Glasplatten Klein- und Mittelformate 4,294
EL 228 a IV Landesdenkmalamt Baden-Württemberg: Fotosammlung, Glasplatten Kleinformate 2,199
F 234 VI Staatliche Heilanstalt Weinsberg: Fotosammlung Kemmler 1903-1915 1,032
FL 10/5 Polizeidirektion Heidenheim World War II 44 flyers dropped by allies encouraging resistence againest Nazi Germany
FL 45/1 Wasserwirtschaftsamt Besigheim 1751-1995 1,341
FL 410/8 II Staatliches Hochbauamt Stuttgart I: Pläne 1896-1992 4,242 building plans
FL 410/12 Staatliches Hochbauamt Ulm II (Bund) – Pläne 1801-1998 136
FL 420/1 Wilhelma, Zoologisch-botanischer Garten Stuttgart 1927-2016 2,362 animal photos
K 412 IV Reichs-/Bundesbahndirektion Stuttgart: Hochbaupläne ca. 1840 - ca. 1990 13,421
K 414 I Reichs-/Bundesbahndirektion Stuttgart: Fotografien ca. 1930-1990 6,954
K 414 II Reichs-/Bundesbahndirektion Stuttgart: Fotografien Ca. 1900-ca. 1950 536
K 415 Reichs-/Bundesbahnbetriebsamt Aalen 1859-1977 479
K 422 II a Wasser- und Schifffahrtsdirektion Stuttgart: Fotosammlung, Kleinbilddias Ca. 1960-ca. 1974 1,224
K 422 II b Wasser- und Schifffahrtsdirektion Stuttgart: Fotosammlung, Glasplatten 6x9 1935-1952 120
K 422 II c Wasser- und Schifffahrtsdirektion Stuttgart: Fotosammlung, Glasplatten 8,5x10 1928-1957 185
K 422 II d Wasser- und Schifffahrtsdirektion Stuttgart: Fotosammlung, Glasplatten 9x12 33
K 422 II e Wasser- und Schifffahrtsdirektion Stuttgart: Fotosammlung, Glasplatten 13x18 1,937 4
K 422 II f Wasser- und Schifffahrtsdirektion Stuttgart: Fotosammlung, Glasplatten 18x24 33
K 422 II g Wasser- und Schifffahrtsdirektion Stuttgart: Fotosammlung, Glasplatten 24x30, 30x40 1930s 238
K 422 II i Wasser- und Schifffahrtsdirektion Stuttgart: Fotosammlung, Negative 11,5x16,5 1930-1950 3
K 422 II j Wasser- und Schifffahrtsdirektion Stuttgart: Fotosammlung, Negative 17x23 10
K 423 Wasser- und Schiffahrtsamt Heilbronn 1,095
{PL 4/81} Unifranck Lebensmittelwerke GmbH Ludwigsburg, Werbemittelarchiv 103
PL 723 Nachlass Hans Noller: Sammlung zum Eisenbahnwesen in Württemberg 1844-2011 15,381
PL 734 Fotosammlung Harald Knauer zum Eisenbahnwesen in Württemberg 1872-1889, 1905-2022 8,825
TOTAL 131,266
Hohenlohe-Zentralarchiv Neuenstein / Hohenlohe-Central Archive Neuenstein
Series ID Series Name Link Date Digitized files Notes on digitized files Status
GA 100 Handgezeichnete Karten 865
GA 105 Gedruckte Karten 30
GA 115 Plansammlungen 150 building plans
KrA SF 2/1 Fotosammlung: Ehemals eigenständige Gemeinden Adolzfurt – Lassbach 1860 – 2011 3,983
KrA SF 2/2 Fotosammlung: Ehemals eigenständige Gemeinden Mangoldsall – Zweiflingen 1860 - 2011 3,691
TOTAL 8,719
Staatsarchiv Sigmaringen / Sigmaringen State Archive
Series ID Series Name Link Date Digitized files Notes on digitized files Status
FAS H 1/1 T 1 Nachlass Albert Waldenspul: Glasplatten, Diapositive und Alben 831
FAS H 1/1 T 3 Nachlass Albert Waldenspul: Fotosammlung 422
FAS Sa Sammlungen und Nachlässe 1918-1928 1,188
FAS Sa A 7 T 1 Nachlass Xaver Henselmann 1899-1918, 1932-1933 203
FAS K Karten 199
FAS PA Pläne, Karten, Zeichnungen 95
FAS PA St Stammtafeln 16.- 20. Jh. 42
Wü 160 T 5 Forstdirektion Tübingen: Luftbilddokumentation 1952-2008 13,639
Dep. 44 T 2 Sammlung Botho Walldorf, Fotograf, Heimatkundler (geb. 1945) 1717-2007 1,041
N 1/68 Fotoatelier Kugler in Sigmaringen: Glasplattennegative 1916-1938 2,215
N 1/78 T 1 Nachlass Robert Arnaud, Kaufmann (1885-1945) 1871-2005 458 postcards
N 1/85 T 1 Nachlass Heinz Braun, Techniker (geb. 1927) 181
N 1/89 T 1 Nachlass Werner Rees (geb. 1947) 85
N 1/96 T 1 Luftbildarchiv Erich Merkler (geb. 1947): Negative 1,407
N 1/96 T 2 Luftbildarchiv Erich Merkler (geb. 1947): Diapositive 35
K Karten und Pläne 236
TOTAL 22,277
Hauptstaatsarchiv Stuttgart / Main State Archive Stuttgart
Series ID Series Name Link Date Digitized files Notes on digitized files Status
H 107 Kieser-Ortsansichten 1680-ca. 1690 974
J 151 Sammlung von Maueranschlägen 1900-1948 2,736
J 312 Fotoarchiv Blumenthal / von Schoenebeck, Bad Wildbad ca. 1896-1965 4,367
J 170 Berichte von Gemeinden über die Kriegsereignisse 1945 und das Ausmaß der Zerstörungen im Zweiten Weltkrieg 1948-1952, 1955, 1960-1962 9,799
J 311 Luftbildpläne der Jahre 1933-1936 1933-1936 57
J 313 Landschafts-, Kunst-, Weltkriegs- und Architekturfotografien ca. 1910 und ca. 1935 372
J 314 Aufnahmen aus Südwestdeutschland 1935 - 1939 106
J 317 Fotografien aus dem Nachlass von Christoph Siegfried Langbein (1880-1921) 1895 - 1905 111
J 319 Fotografien aus dem Nachlass von Edmund Müller, Grafiker und Fotograf, *1900 +1945 1,434
J 320 Sammlung von Fotographien "Aus dem Leben der Herzogin Wera (*1854, +1912)" 723
M 700/1 Sammlung von Ortsfotografien World War I 1,059
M 700/2 Sammlung von Landschaftsfotografien World War I 177
M 700/3 Sammlung von Karten und Planfotografien World War I 88
M 700/4 Sammlung von Truppenfotografien World War I 132
M 700/5 Sammlung von Personenfotografien World War I 65
M 703 Militärhistorische Bildersammlung 1800s 5,381
M 707 Bildersammlung I World War I 7,736
M 708 Bildersammlung II World War I 10,657
M 709 Bildersammlung III World War I 6,729
N 1 Land- und Flurkarten betreffend Altwürttemberg 150
N 3 Forstkarten betreffend Altwürttemberg 766
N 5 Karten des Herzoglich Württembergischen Corps des Guides 56
N 7 Nachlass Johann Majer, Pfarrer und Kartograph 123
N 11 Land- und Flurkarten betreffend Neuwürttemberg 399
N 13 Forstkarten betreffend Neuwürttemberg 19
N 26 Karten des Benediktinerklosters Ochsenhausen und des Fürstentums Ochsenhausen der Fürsten von Metternich-Winneburg 81
N 28 Karten des Prämonstratenserklosters Rot an der Rot und der Herrschaften Wartenberg-Rot und Erbach-Wartenberg-Rot 16
N 30 Karten des Prämonstratenserklosters Schussenried 158
N 34 Karten des Benediktinerklosters Weingarten 127
N 36 Karten und Pläne des Prämonstratenserklosters Weißenau 37
N 40 Karten des Benediktinerklosters Zwiefalten 115
N 60 Land- und Flurkarten betreffend Gebiete des Kurfürstentums bzw. Königreichs Württemberg 109
N 70 Forstkarten betreffend Gebiete des Königreiches Württemberg 550
N 100 Ältere gedruckte Karten 2,676
N 200 Pläne und Zeichnungen betreffend Altwürttemberg aus der Zeit bis 1806 1,238
N 201 Pläne und Zeichnungen betreffend Neuwürttemberg und Gebiete außerhalb von Württemberg aus der Zeit bis 1806 45
N 205 Pläne und Zeichnungen betreffend Württemberg ab 1806 und Württemberg-Baden bzw. Baden-Württemberg ab 1945 38
TOTAL 82,681
Staatsarchiv Wertheim / Wertheim State Archive
Series ID Series Name Link Date Digitized files Notes on digitized files Status
S-N 70 Fotosammlung Wehnert 1882-2013 3,741
K-LRA 91 Kreisbildstelle / Kreismedienzentrum Main-Tauber-Kreis 1935-2004 3,095
6,836

TOTAL 649,253

License

All content is either public domain (age/created by government), and if not, everything is licenced under CC BY 3.0. (see terms of use: Some of the digitized archive records in the finding aid system of the Landesarchiv Baden-Württemberg are still subject to copyright protection, some are exempt from copyright protection as official works, and some are in the public domain. Where they are protected by copyright, the State Archives hold the corresponding exploitation rights and grant a Creative Commons CC-BY license.)
The source "Landesarchiv Baden-Württemberg" and the archive reference ID of the image needs to be mentioned when using the image - this information is also always present on the image when downloading fron the website.

Description

  • Do the media URLs follow a pattern?

Yes, from what I can see: Each image can be viewed in an image viewer. The image viewer can be accessed from the archive series page (example)
Those image viewer links look like this: https://www2.landesarchiv-bw.de/ofs21/bild_zoom/zoom.php?bestand=SERIES_ID&id=IMAGE_ID&gewaehlteSeite=FILE_NAME (for example https://www2.landesarchiv-bw.de/ofs21/bild_zoom/zoom.php?bestand=21715&id=2836819&gewaehlteSeite=02_0001128649_0001_2-1128649-1.png)
The image file can be downloaded by using https://www2.landesarchiv-bw.de/ofs21/bild_zoom/download.php?&id=IMAGE_ID&bilddatei=FILE_NAME (example https://www2.landesarchiv-bw.de/ofs21/bild_zoom/download.php?&id=2836819&bilddatei=02_0001128649_0001_2-1128649-1.png)

  • Does the site have an API?

No.

  • Is there a template that could be used on the file description pages, or should one be created?

Since there is a huge amount of files, creating one might by a good idea.

TheImaCow (talk) 09:28, 19 May 2024 (UTC)

I started scraping and it is going well. Do you know of files that fall under CC BY 3.0 ? -- DaxServer (talk) 07:55, 13 August 2024 (UTC)
All 25,700,000 digitized objects do, per the terms of use.
There is already {{Landesarchiv-bw-image}}, which references
- the archive location (collapsed sections above, see the "Table of identification codes" on the template documentation)
- the archive signature of the object (such as "W 145/4 Nr. 0091")
- the permanent link ID to the digitized object such as "5-790216-1" (http://www.landesarchiv-bw.de/plink/?f=5-790216-1)
This can be used in an information template "accession_number" field.

As for the |source= field, there is clear guidance: We cite the archive signature, if known the author and the permalink, such as
"Landesarchiv Baden-Württemberg, Staatsarchiv Freiburg W 145/4 Nr. 0091 / Fotograf: Leopold Adler"
Example without known/specified author:
"Landesarchiv Baden-Württemberg, Staatsarchiv Ludwigsburg K 414 I Nr 273"

As for the licencing template, I think we should use a custom version of the {{Cc-by-3.0}} template, I created {{LABW}} (for parameter 1, use the same value as for "source" described above)

What data exactly is there to scrape? Is there a way to tell if an object is a photograph or something else (map, drawing, text)? (to decide weather to use {{Photograph}}) ~TheImaCow (talk) 11:03, 13 August 2024 (UTC)
I'm scraping the metadata and the images associated with an object. An object can contain one or more [digitalized] images (of course, only those Findbücher that are digitalized).
I haven't yet explored the data that I've gathered so far, so I've limited info atm. -- DaxServer (talk) 12:13, 13 August 2024 (UTC)
Things I noted regarding file names - some images have no title (eg "Keine Angabe"), then we should only use the archive ID (PL 723 DK 94-2), and if the images have title, we should probably start the file name with the archive ID, because they are sometimes sorted by date or relation etc, and this preserves the original file order in the categories, e.g. "PL 723 DK 55-20 - Bf. Kupfer", where the "20" is a running number.
I removed some series from the above table...
- T 1 (Zugang 2008/0013)/SERIES ID 22257 only text documents
- T 1 (Zugang 2008/0032)/22664 only low quality scans of personal photos, probably out of scope
- T 1 (Zugang 1983/0018-01)/10461 only text documents
- J 153/political party advertising often recently collected by the archive, unlikely if actually free
- Q 2/50 - 17,000 negative photo bags containing ~520,000 individual photographs, unfortunaly low scan quality, so extracted images are of very poor quality
All objects seem to have their "category tree" as part of the description, such as
Staatsarchiv Ludwigsburg
\/
Deposita, nichtstaatliche Archive und Nachlässe / 1335-1997
\/
Nachlässe (ohne Deposita)
\/
PL 723 Nachlass Hans Noller: Sammlung zum Eisenbahnwesen in Württemberg / Ca. 1844-2011
\/
2. KB-Dias
\/
Stuttgart - Horb ("Gäubahn")
\/
Diakasten 18: Stuttgart - Horb I
at this object: http://www.landesarchiv-bw.de/plink/?f=2-5340602-1
I think it would be a good idea to automatically copy these category trees as commons categories, as this would make the manual categorisation needed for the images significantly easier. Such a category tree has already been created for the US National Archives upload, see Category:US National Archives Record Groups. ~TheImaCow (talk) 12:42, 22 August 2024 (UTC)

TheImaCow I was able to collect 375,357 records (many with multiple files). Here is a statistic of the metadata:

Key proposed value/usage
Archivalienart I see values such as "Fotos" or "Karten und Pläne". Can be used to decide weather to use {{Photograph}}, {{Map}} or generic {{Information}}. However, it looks like the majority of media lack this tag, and we should use "Photograph" as default, as by far most images are photos. Except collections such as A 47/1 which consist of documents, there we can use the normal information template. I also see the value "Personenakten", where are also many images but the majority of files are text documents, so we use the normal Information template there. There will be some false-positives, but they can be fixed manually.
Art der Information Merge multiple values "Art der Information - Art der Vorlage - Format - Umfang", into "medium=" value
Art der Vorlage Merge multiple values "Art der Information - Art der Vorlage - Format - Umfang", into "medium=" value
Aus Bestand Merge multiple values Einordnung des Bestandes - Aus Bestand" into "collection=" value
Ausführung XXX
Autor author=
Autor/Fotograf/Künstler author=
Bemerkung notes=
Bemerkungen notes=
Bestellsignatur Merge with Permalink into source=, e.g. source=Staatsarchiv Ludwigsburg K 423 Bü 3625
Blattzahl XXX
Digitalisate: XXX
Einordnung des Bestands Merge multiple values Einordnung des Bestandes - Aus Bestand" into "collection=" value
Enthält medium=
Entstehungsstufe XXX
Farbigkeit XXX
Format Merge multiple values "Art der Information - Art der Vorlage - Format - Umfang", into "medium=" value
Funktion in der Akte XXX
Geburtsdatum XXX
Geburtsort XXX
Geogr. Begrenzung location=
Herausgeber publisher=
Herstellungsort publication place=
Informationsträger (Material) XXX
Kartogr. Schlagwort notes=
Kurztitel XXX
Laufzeit date=
Literatur XXX
Maßstab scale= (for {{Map}})
Materialart XXX
Name unclear?
Namenszusatz XXX
Orientierung heading= (for {{Map}})
Originalmaßstab XXX
Orte depicted_place=
Permalink Merge with Permalink into source=, e.g. source=Staatsarchiv Ludwigsburg K 423 Bü 3625
Provenienz XXX
Rechteinhaber XXX, unless something other than state archive indicated, then remove file from upload
Rubrik XXX
Schaden XXX
Sprache XXX
Sterbedatum XXX
Sterbeort XXX
Stichworte notes=
Titel description=
Trägerformat XXX
Umfang Merge multiple values "Art der Information - Art der Vorlage - Format - Umfang", into "medium=" value
Vorbemerkung notes=
Vorprovenienzen XXX
Vorsignaturen XXX
Wohnort XXX
  • Bemerkung shall be merged with Bemerkungen
  • I'm not sure if we want to merge "Autor" and "Autor/Fotograf/Künstler"
  • Do you want them to be uploaded with translation into EN? Or simply use the {{de template and be done with that?

Let me know how you want to proceed now. -- DaxServer (talk) 22:00, 20 December 2024 (UTC)

I added some {{Information}}/{{Photograph}} template values for the original keys to the table. I think we should only use the original "{{de" values, english translations should be done manually. To proceed, probably a test upload? (there is also the {{Landesarchiv-bw-image}} template for |accession_number=, see above)~TheImaCow (talk) 22:49, 21 December 2024 (UTC)
@TheImaCow Here're the stats into Archivalienart:
  • Amtsbücher - 3
  • Fotos - 228950
  • Karten und Pläne - 47749
  • Nachlässe - 7
  • Personenakten - 7062
  • (blank) 91585
-- DaxServer (talk) 09:30, 24 December 2024 (UTC)
I wanted to do some test, but the website has some issues https://www2.landesarchiv-bw.de/ofs21/olf/bildexplorer.php?bestand=21569 (on archive). Tweeted to them, but maybe they're all in Holidays. Will wait and see. -- DaxServer (talk) 09:44, 24 December 2024 (UTC)
Possibly that collection got removed intentionally from the website for whatever reason, it must have been between "FAS K" and "FAS Pa ST" here, at the bottom. Now this collection is missing from the list. (only 90 items affected) ~TheImaCow (talk) 22:00, 24 December 2024 (UTC)
It seems some information has been changed from the last time I gathered the data. I'll have to do a refresh on the 375k items collected. This will take a few weeks it seems 😵‍💫 -- DaxServer (talk) 18:29, 1 January 2025 (UTC)
@TheImaCow Can you give me an example for merging the values for medium= and collection=, for example this one: http://www.landesarchiv-bw.de/plink/?f=3-558838
Also, how should the <br/> be translated into wikitext? - line break, wikitext break, special character, or something else -- DaxServer (talk) 10:15, 14 March 2025 (UTC)
Medium: medium=Bild - 9,9 x 6,0 cm //// (medium=Art der Information - Format)
Collection: collection=Kommunalarchive im Hohenlohekreis<br>Kreisarchiv Hohenlohekreis<br>Sammlungsbestände<br>Foto-, Dia- und Postkartensammlung<br><br>KrA SF 2<br>Fotosammlung: Ehemals eigenständige Gemeinden Adolzfurt - Lassbach / um 1860 - 2011<br>10. Bitzfeld<br>10.2 Gebäude, Bauten :::
/// collection=Einordnung des Bestands<br><br>Aus Bestand

Hope this is understandable/answers the question, here is an example on how it could be rendered:

Description
Deutsch: Bitzfeld: Brunnen mit altem Backhaus in Weißlensburg
Medium
InfoField
Deutsch: Bild - 9,9 x 6,0 cm
Source

Hohenlohe-Zentralarchiv Neuenstein KrA SF 2 Bi-10.2.3

Author Rauser
Collection
InfoField
Kommunalarchive im Hohenlohekreis↓
Kreisarchiv Hohenlohekreis↓
Sammlungsbestände↓
Foto-, Dia- und Postkartensammlung↓

KrA SF 2↓
Fotosammlung: Ehemals eigenständige Gemeinden Adolzfurt - Lassbach / um 1860 - 2011↓
10. Bitzfeld↓
10.2 Gebäude, Bauten
I had the idea with the little arrows ↓↓↓ on the collection tag spontanous, they could be added too. ~TheImaCow (talk) 21:52, 15 March 2025 (UTC)
@TheImaCow I wanted to normalize the Laufzeit field to fit into {{complex date}} but it seems to take too much of my time. Would you be able to convert them? If so, I can email you an export with that data. If not, I'd add the original data into some other_fields parameter. Let me know -- DaxServer (talk) 12:10, 18 March 2025 (UTC)
Unfortunaly I'm quite clueless with such data processing, I don't think I could make that work. Lets do the solution with other fields. ~TheImaCow (talk) 22:45, 18 March 2025 (UTC)
@TheImaCow It seems all pre-work is done. Maybe I'll add couple of SDCs. Also, request for whitelisting domain: MediaWiki talk:Copyupload-allowed-domains#Allowlist request - Landesarchiv Baden-Württemberg Online-Findmittelsystem -- DaxServer (talk) 12:53, 30 March 2025 (UTC)

BTW, can you design some categorization schema? -- DaxServer (talk) 13:25, 30 March 2025 (UTC)

I suggest creating a category for each series (the ones listed in the collapse boxes above, first value in the "Aus Bestand" field e.g. Category:KrA SF 2 Fotosammlung: Ehemals eigenständige Gemeinden Adolzfurt - Lassbach / um 1860 - 2011
These categories should be categorized into already existing Category:Collections of Staatsarchiv Ludwigsburg, Category:Collections of Staatsarchiv Freiburg, Category:Collections of Staatsarchiv Sigmaringen etc. ~TheImaCow (talk) 11:28, 5 April 2025 (UTC)
@TheImaCow Extracting the Bestand info seemed a bit more complicated with the data format I have right now. So I fellback to using Category:Generallandesarchiv Karlsruhe Findbuch O format.
I uploaded 10 test files: Special:Search/hastemplate:LABW file:
Let me know how they look. -- DaxServer (talk) 13:43, 10 April 2025 (UTC)
Looks good overall! Two things:
  • File name: A better format would probably "<Titel> - LABW - <Bestellsignatur>"
    We need to use some amount of description per Commons:File naming. It looks to me like the "Titel" field is a good fit for that. "Landesarchiv Baden-Württemberg" can be abbreviated to LABW (to avoid too long file names). The "Bestand"/"Permalink" IDs can be left out, as they are only the ID numbers automatically assigned by the digital finding aid, without a direct weblink, they are pretty useless. The "Bestellsignatur" archive signature should be sufficient.
    Example:
    Photograph from Landesarchiv Baden-Württemberg Hauptstaatsarchiv Stuttgart M 700-4 Nr. 100 Bestand-6587 permalink 1-852418-1.jpg
    ↓to↓
    Soldaten im Schützengraben (Gruppenbild) - LABW - Hauptstaatsarchiv Stuttgart M 700/4 Nr. 100.jpg
    This will result in some duplicate file names where multiple images are assigned to the same object, so it looks we can keep the digit(s) after the last "-" in the "Permalink" ID to make the filename unique e.g.
    Photograph from Landesarchiv Baden-Württemberg Hauptstaatsarchiv Stuttgart J 317 Nr 10 Bestand-23838 permalink 1-1335908-2.jpeg
    to
    Herbst 1902 - LABW - Hauptstaatsarchiv Stuttgart J 317 Nr 10 -2.jpg
    Exception i've seen: On media where "Archivalienart" is "Personenakten", we must use "Name" field instead of "Titel", as a title is often not present there.
    Hope I explained this understandable
  • Collection field/Arrows ↓: These arrows are at every line break, not just at the "collection level", which can lead to situations like here Easiest to probably just leave them away then.
~TheImaCow (talk) 11:54, 11 April 2025 (UTC)
@TheImaCow There are some entries where they put description as Titel like this one: https://www.landesarchiv-bw.de/plink/?f=5-348952 I don't think I can extract a meaningful filename for such. Any ideas? -- DaxServer (talk) 14:49, 14 April 2025 (UTC)
@DaxServer If it's possible we could limit the title to maybe the first 200 characters or so. However, it is probably better to just leave out that particular collection. It seems to be consisting entirely of text documents which are difficult to properly curate on Commons anyway. Are there more collections with such long titles? (I've seen collection A 25/1 Landgericht Freiburg with the same issue, lets leave that out too)~TheImaCow (talk) 19:47, 14 April 2025 (UTC)
@TheImaCow Here's the updated test:
-- DaxServer (talk) 11:27, 15 April 2025 (UTC)
Looks good! ~TheImaCow (talk) 15:57, 15 April 2025 (UTC)

Applied Commons:Bots/Requests/CuratorBot (4) -- DaxServer (talk) 17:40, 15 April 2025 (UTC)

Opinions

Assigned to Progress Bot name Category
DaxServer (talk · contribs) Pending run approval Commons:Bots/Requests/CuratorBot (4) CuratorBot (talk · contribs) Category:Files from Landesarchiv Baden-Württemberg uploaded by CuratorBot
Category:Commons batch uploading#Batch%20uploading

Deepin icons

Deepin's icons.

Source to upload from

https://github.com/linuxdeepin/deepin-icon-theme

License


GNU head This work is free software; you can redistribute it and/or modify it under the terms of the GNU General Public License as published by the Free Software Foundation; either version 3 of the License, or any later version. This work is distributed in the hope that it will be useful, but WITHOUT ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See version 3 of the GNU General Public License for more details.

Description

  • Do the media URLs follow a pattern?
Sure do. Example: https://github.com/linuxdeepin/deepin-icon-theme/blob/master/Sea/apps/scalable/accessories-text-editor.svg
  • Does the site have an API?
Yes.
  • What else could ease uploading?
Not sure.
  • Did you contact the site owner?
Nope.
  • Is there a template that could be used on the file description pages, or should one be created?
User:Psiĥedelisto/Deepin icons

Psiĥedelisto (talkcontribs) please always ping! 18:51, 3 July 2023 (UTC)

Opinions

Assigned to Progress Bot name Category
 Half done Category:Deepin Icon Theme

@Psiĥedelisto: Hi! I looked deeper into this and uploaded the majority of the icons. Unfortunately, some icons are covered by copyright, as they are derivative work. --PantheraLeo1359531 😺 (talk) 19:17, 20 January 2024 (UTC) Category:Commons batch uploading#Batch%20uploading

IBM Research on YouTube

Source to upload from

https://www.youtube.com/@ibmresearch/videos

License

Virtually all uploads to the IBM Research channel are licensed under the Creative Commons Attribution 3.0 Unported license, per the License tag in the description of each video.

Description

784 videos (and counting, as of the time I'm writing this) of pure IBM and technology-related gold. Lots of great photography and headshots to extract from these. Some of the content therein may contain non-free elements over the de minimis threshold, but from what I've watched so far those are few and far in between. Would be trivial to download all videos using youtube-dl; reencoding each video to fit within the 100 MB upload limit is a different story however. DigitalIceAge (talk) 04:52, 17 November 2023 (UTC)

The limit is now 5 GB. Yann (talk) 20:12, 17 April 2025 (UTC)

Opinions

Assigned to Progress Bot name Category
Videos by IBM Research
@DigitalIceAge 437 files are Category:Videos by IBM Research uploaded to date --PantheraLeo1359531 😺 (talk) 16:23, 27 March 2025 (UTC)

Newspapers by Feureau in Internet Archive

Source to upload from


License
  • Public domain


Description
  • This user has uploaded more than a thousand old newspapers from Indonesia, as well as Dutch magazine Tong Tong.

Please help importing the newspaper here, they would make a great addition to Category:Newspapers_of_Indonesia

Bennylin (yes?) 18:29, 18 February 2023 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Babad Diponegoro from Internet Archive

Source to upload from
License

Public Domain

Description

The IA didn't provide DJVU nor PDF format, only zipped JPGS (1429 files and 1303 files) Bennylin (yes?) 06:57, 15 February 2023 (UTC)

I found another file, same, no pdf/djvu

Opinions

  • There are PDF files, but over 500 MB each. Yann (talk) 20:26, 17 April 2025 (UTC)
    Yes. I already uploaded them here. In 2023 there were no PDF. We can close this request. Thank you for looking this up. Bennylin (yes?) 07:57, 18 April 2025 (UTC)
Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

CC0 ant micro-CTs

X-ray microtomograms of ants

Source to upload from

Dryad Subject Area: cybertype - Blacklight Search Results

License

Creative Commons CC0 License (Q6938433) (rationale)

Description

Arlo James Barnes 23:01, 10 June 2022 (UTC)

Opinions

Assigned to Progress Bot name Category

Denkmalatlas Niedersachsen

Images of cultural monuments in Lower-Saxony, Germany.

Source to upload from

https://denkmalatlas.niedersachsen.de/viewer/

License

CC BY-SA 4.0

Description

Images of cultural monuments in Lower-Saxony, Germany, from the "Denkmalatlas Niedersachsen" project of the Lower Saxony State Office for Heritage Conservation. The project offers exterior shots of the monuments. Photos shot from public space are permitted in accordance with the freedom of panorama in Germany. For published photos shot on private property, the State Office has the consent of the property owner. In the "Denkmalatlas", all photos are published with the license CC BY-SA 4.0.

Timk70 (talk) 16:00, 10 June 2022 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Editora Fi

Source to upload from

https://www.editorafi.org/catalogo

License

CC BY-SA 4.0

Description

Open Access/CC books perfect for Wikisource. I believe that it is everything on Google Drive. It needs an specific template. Erick Soares3 (talk) 12:36, 9 March 2022 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

SciELO Books

Source to upload from
http://books.scielo.org/
https://archive.org/details/scielobooks
https://archive.org/details/@scielo_books
License

Several types of Creative Commons (including non-commercial) and Public Domain.

Description

SciELO Books, part of Scielo Brazil (also an amazing source for Wikisource), have a partnership with several academic publishers to release or re-release their works on Open Access, be CC or Public Domain.

Since it is clearly legal, it should be an amazing resource for Wikisource and the Wikimedia in general.

The bot should be able to read the archive and select the ones with Wiki Commons friendly licenses. Internet Archive some works released as CC BY-4.0 are registered as non-commercial (example). A similar thing also happens on the main website: 1 and 2. Would be nice if the bot could compare the main website and the Internet Archive collection for missing files and check at least once a month for new works released into Wiki friendly licenses.

It is necessary an official template. Thanks, Erick Soares3 (talk) 20:38, 6 March 2022 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Official Journal of the European Union

Source to upload from

Eurlex: https://eur-lex.europa.eu/oj/direct-access.html

License

{{PD-EUGov}} for the EU itself and {{PD-EdictGov}} for the US side. Admittedly, I'm not sure how this will work for issues before certain dates (eg. before the act of 2011 mentioned in {{European Union Government}}) or prior to the EU's existence (i.e. during the time of the European Coal and Steel Community). However, due to the content being official legislation and communication I think it should be OK.

Description

Describe the content to be uploaded in detail (audio files, images by …), and what makes it valuable to Wikimedia Commons.

The files will be PDF copies of all issues of the Official Journal of the European Union (OJEU), the official gazette of the EU. Thus, it would be a useful resource for EU legislation and communications.


MSG17 (talk) 14:47, 8 February 2022 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Biblioteca Digital Hispánica

  • Source to upload from: Photography collection from the Biblioteca Digital Hispánica: search query
    • Do the media URLs follow a pattern? metadata permalink, viewer permalink, JPEG deep link
    • Does the site have an API? No
    • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?) The HTML is quite well-formed and follows an homogeneous structure, although metadata tabulation is a bit weird.
    • Did you contact the site owner? No
  • Describe the works to be uploaded in detail (audio files, images by …): This request is for a subset of this Digital Library covering photographies and engravings. Note that the JPEG deep link provided above is valid only to fetch the first page of the document. For this collection, most (all?) works are a single page.
  • Which license tag(s) should be applied? It depends on the work. I think it should generally be PD-old-assumed, and in some cases PD-old-70 and PD-old-100.

I already have a scraper and (work in progress) page generator for this collection. So I can help to provide everything in the required format. Anyway, I think the bulk of pending work is probably identifying author and the right license tag for each work.

MarioGom (talk) 21:15, 12 October 2020 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Perry–Castañeda Library Map Collection

  • Source to upload from: http://legacy.lib.utexas.edu/maps/ams/
    • Do the media URLs follow a pattern?
      The urls themselves, so far as I can work out, don't, but in the same way as in Adobe Acrobat Pro you can set it to go down a list of web links to generate a single pdf, a bot may be able to too
    • Does the site have an API?
      Bit technical, but I dont' think so
    • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?)
      I don't know
    • Did you contact the site owner?
      No
  • Describe the works to be uploaded in detail (audio files, images by …): vast series of maps generated by the US Army Map Service (i.e., PD-USGov-Military) in the Perry–Castañeda Library Map Collection, The University of Texas at Austin
  • Which license tag(s) should be applied? PD-USGov-Military
  • Is there a template that could be used on the file description pages? Do you think a special template should be created? In terms of the file naming convention, this could follow that of the site, i.e, the top of each page has the series, a credit to the US AMS, and the date, then each map file has the name of the map, the sheet number (for the index pages, cross-references from adjoining maps etc), and the scale

NB there are already some files at Category:India maps by U.S. Army Map Service (plus various other individual uploads etc within Category:Maps by the United States Army Map Service), and it looks from below on this page and eg this commons image that "Slick-o-bot" may have been used in 2012 to upload some or all of these (I'm most keen on the various Japan-related maps (especially the 3x Honshu 1:50,000 series) but imagine every region would benefit).
This would be a mind-bogglingly great addition, thank you, Maculosae tegmine lyncis (talk) 14:08, 13 August 2020 (UTC)

PS, these are much more detailed than google maps - and the labelling is in English (with some Japanese too), Maculosae tegmine lyncis (talk) 19:27, 21 August 2020 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Claremont Colleges Digital Library

  • Describe the works to be uploaded in detail (audio files, images by …):

All photos in the Boynton Collection of Early Claremont, all of which are dated prior to 1925. If it's not too much trouble, it would also be very nice to have all photos in the Claremont Colleges Photo Archive and City of Claremont History Collection dated prior to 1925.

  • Is there a template that could be used on the file description pages? Do you think a special template should be created? Not sure

Sdkb (talk) 07:42, 8 August 2020 (UTC)

Opinions

Were these photos published prior to 1925, or merely taken prior to then? Publication needs to be pre-1925 for {{PD-US-expired}} to be allowed. Pi.1415926535 (talk) 08:25, 8 August 2020 (UTC)

@Pi.1415926535: The about page states The collection ... is believed to have come to Pomona College included with the papers of Charles Luther Boynton, a Pomona College alumnus and missionary to China. Boynton himself graduated from Pomona around 1900. I can't say for sure the year his papers came into possession of the college, though (which I assume would be the date of publication?). The library would probably tell us if we asked, though. Sdkb (talk) 05:47, 10 August 2020 (UTC)
Acquisition by the college would not be considered publication for the purposes of copyright. Only use in a publicly released printed material, or on a webpage, is considered publication. Pi.1415926535 (talk) 06:48, 10 August 2020 (UTC)
@Pi.1415926535: does being added to a library not count as publication? The collection has presumably been housed in the special collections department and publicly available to anyone who requested access since it was obtained. Sdkb (talk) 20:55, 10 August 2020 (UTC)
A collection merely being in a library does not constitute publication, by my reading. Under copyright law, publication is the distribution of copies or phonorecords of a work to the public by sale or other transfer of ownership or by rental, lease, or lending. Offering to distribute copies or phonorecords to a group of people for purposes of further distribution, public performance, or public display also constitutes publication. (From here.) Is the death date of Boynton known? If it was before 1950, then {{PD-old-70}} applies. Pi.1415926535 (talk) 23:14, 10 August 2020 (UTC)
@Pi.1415926535: According to here, Boynton died in 1961, so not quite. The above would seem to me to indicate being in a library counts, though, because of lending, which is what a library does. Sdkb (talk) 19:11, 11 August 2020 (UTC)
A collection in the library would be the originals (not copies) and is likely for use only in the library (not lending). I understand that you wish to have this collection available on Commons, but from the available evidence I do not believe the images are public domain. Pi.1415926535 (talk) 20:58, 11 August 2020 (UTC)
Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Balinese Lontar from Internet Archive

  • Source to upload from: http://archive.org/details/Bali
    • Do the media URLs follow a pattern? yes
    • Does the site have an API? yes
    • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?) N/A
    • Did you contact the site owner? yes
  • Describe the works to be uploaded in detail (audio files, images by …):
    • Balinese Lontar (palm-leaf manuscripts) from the Internet Archive's Bali collection
    • Each manuscript is a PDF containing photographs of the originals
    • This batch upload is in connection with an active project grant.
  • Which license tag(s) should be applied?

{{PD-scan}}, following the behavior of the ia-upload tool.

  • Is there a template that could be used on the file description pages? Do you think a special template should be created?

Yes. I will follow the ia-upload template closely when doing the batch upload. I will use a short python script that aggregates info from the Internet Archive API and sends each upload request via pywikibot. If necessary I will create a bot account for this purpose. There are approximately 2700 items to upload.

Lautgesetz (talk) 01:03, 4 July 2020 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Japanese Homes and their surroundings

  • Source to upload from: List of files, List of illustrations with names assigned to each number. It would be really nice if the figures contained their original names in teh uploaded filenames.
    • Do the media URLs follow a pattern?:
    • Does the site have an API?:
      • I assume that Gutenberg has an API. If someone can point me at instructions on how to use it with Commons, I might be able to do this myself; I assume this is a beaten path...
    • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?):
    • Did you contact the site owner?:
      • No, for Gutenberg this seems redundant.
      • I uploaded some manually already, with permission, from another site (names files with pattern https://www.kellscraft.com/JapaneseHomes/JapanHomes001.jpg, to JapanHomes301.jpg, 129-130 are duplicates, figure numbers do not align with file names, so combined illustrations cause no disruption to sequential numbering). The Gutenberg images are in better in many, but not all, cases (higher-res, better scan).
      • The same book is also at , but the images seem to be worse.
  • Describe the works to be uploaded in detail (audio files, images by …):
  • Which license tag(s) should be applied?:
    • {{PD-old-70-1923}}
    • note: five years from PD-100
  • Is there a template that could be used on the file description pages? Do you think a special template should be created?

Thank you! HLHJ (talk) 04:17, 4 February 2020 (UTC)

I uploaded 167-307 from the website. For each image I tried to fetch the description by getting the text of all the divs which mention that figure.  REAL 💬   15:41, 12 April 2025 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Baseball Hall of Fame

Is there a practical way to batch extract and upload files that are tagged with "http://rightsstatements.org/vocab/NoC-US/1.0/" under the "Copyright note" section? They basically confirm which files are in the public domain. Or they will sometimes post in that same section "The National Baseball Hall of Fame and Museum is not aware of any U.S. copyright or any other restrictions in the documents."

Oaktree b (talk) 02:16, 23 November 2019 (UTC)

Opinions

Unfortunately I think this collection is now being locked down. The link above 404s and there is no obvious way to get to a collection from the root website (best link is https://baseballhall.org/the-museum/collections/photo-archives). – BMacZero (🗩) 07:05, 12 January 2025 (UTC)
Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

NPGallery

  • Describe the works to be uploaded in detail (audio files, images by …):

"NPGallery supports a wide array of digital asset file types (images, MS office formats, adobe pdfs, audio files, videos)." We would, I think, be primarily interested in their photographs of national parks.

  • Which license tag(s) should be applied?

{{PD-USgov}} may apply to many images, but they need to be checked individually. This could probably be automated to some degree.

  • Is there a template that could be used on the file description pages? Do you think a special template should be created?

Standard templates such as {{Photograph}} should be acceptable.

This was spotted by Animalparty on COM:VP. BMacZero (talk) 00:12, 22 January 2019 (UTC)

Opinions

  • Comments by Animalparty.
  • {{PD-USGov}} would be the most inclusive template, but is rather vague. More specific templates include {{PD-USGov-NPS}} and {{PD-USGov-Interior}}. Any Photographer field that says "NPS Staff" or "NPS Photo" (e.g. ) should automatically get PD-USGov-NPS.
  • I think {{Photograph}} or {{Information}} are fine, ideally with detailed semi custom fields for keywords, collection, location, etc., as seen in the Library of Congress images uploaded by User:Fæ (example).
  • The more pre- or auto-categorization, or at least clearly noting collection, yeear/decade, geographic unit, etc., the better, else we dump thousands of unsorted of images into already cluttered categories like Yosemite National Park.
  • There may be overlap with some material on Archives.gov , individual National Park Flickr feeds/websites, and such material already uploaded. But I think the value of the images uploaded at their largest file size and with curated metadata outweigh the inconvenience of some duplication.
  • Many files have geographical coordinates, but I suspect that many are generic coordinates of the center of the National Park or Monument, rather than being unique to the photograph.
  • Thanks for initiating this, sorry if these comments are basic/obvious to experienced mass uploaders. --Animalparty (talk) 01:29, 22 January 2019 (UTC)


On some more inspection, certain images may be a bit problematic in terms of copyright, namely works of art (e.g. paintings and sculptures) not explicitly credited to NPS employees, but that are nonetheless labeled "Public domain:Full Granting Rights". Some of these appear to be created by Artist-in-Residence programs (e.g. this gallery and this one), and from browsing elsewhere it appears that different parks may have different rules regarding copyrights. Rocky Mountain National Park states "Artists are also required to provide the copyright for this artwork to the National Park Service. The National Park Service will not allow the commercial use of any donated artwork once it is selected and accessioned into the Park's permanent museum collection", which is a restriction against public domain. Perhaps no art from Rocky Mountain was transferred to NPGallery? These 2 images from the U.S.S. Arizona memorial are labeled PD on NPGallery, yet on a different NPS page their status is ambiguous, with the included usage disclaimer "Multimedia credited with a copyright symbol (indicating that the creator may maintain rights to the work) or credited to any entity other than NPS must not be presumed to be public domain; contact the host park or program to ascertain who owns the material" (emphasis added).

Side note: I think every photograph I've viewed on NPGallery has the Copyright disclaimer "Permission must be secured from the individual copyright owners to reproduce any copyrighted materials contained within this website. Digital assets without any copyright restrictions are public domain.", but every file is also labeled Public domain in the Constraints Information.

Another snag I've noticed, just from browsing the term "Artist", are that some images are scans/photographs from newspapers that were most likely not originally created by Federal employees (although the derivative scans/photos are): for instance Louis Grell illustration album, with cartoons by Louis Grell published in World War I. These are still PD via pre-1924 publication (and possibly by {{PD-USGov-Military}}), but it hinders accurate bot-designation of PD template.

And public domain rationale is ambiguous on this vido, with Copyright" "Photo courtesy of Betty Maya Foott, Colorado Plateau Dark Sky Cooperative" (so, probably not a federal employee), yet is nonetheless labeled "Public domain:Full Granting Rights". I may have just found a relative handful of exceptions. But there are also probably a good deal of historical photographs that are PD-1923 or PD-no-notice yet not US Government works. Perhaps a generic umbrella template similar to {{Flickr-no known copyright restrictions}} could be used to encapsulate different possibilities, like {{PD-NPGallery}}.

I think it would be a good idea to contact someone at NPGallery to double check that all media labeled public domain is in fact public domain, for some reason, especially when rationale is ambiguous or lacking. We also might want to consider not transfering the somewhat intimidating, potentially misleading Copyright message "Permission must be secured from the individual copyright owners to reproduce any copyrighted materials contained within this website. Digital assets without any copyright restrictions are public domain." This may be a liability disclaimer on NPGallery's end, but ideally, everything we transfer to Commons would be in the public domain, and so no permission need be secured. --Animalparty (talk) 11:45, 25 January 2019 (UTC)

Working on adapting my bot to handle this. I'll contact them, and also start with only things that are obviously PD. BMacZero (talk) 17:50, 9 February 2019 (UTC)
I e-mailed NPGallery a while back about the public domain statuses of images and neglected to share here. Unfortunately got a not-too-helpful response essentially saying that the licenses and attributions are not "consistent" and "there is not a good way to assure an asset id is truly in the public domain, or not". We'll have to figure out what types of signals we can rely on to decide whether {{PD-USGov-NPS}} or other templates apply. Of course, publication pre-1924 will be a good one to start. BMacZero (talk) 04:30, 11 April 2019 (UTC)
I'm currently harvesting a list of all the images. It's going a bit slow but it should only a take a few days. After that I'll start downloading the metadata, which may take several days. BMacZero (talk) 04:45, 12 April 2019 (UTC)
Ah, a shame about the inconsistent licensing criteria. I guess pre-1924 and files credited to "NPS staff" or similar can be prioritized for now. --Animalparty (talk) 19:13, 12 April 2019 (UTC)
Started downloading the item metadata. You can check on the progress on this fun page I made. BMacZero (talk) 15:49, 13 April 2019 (UTC)
BRFA filed (Commons:Bots/Requests/BMacZeroBot 6). BMacZero (talk) 05:35, 10 May 2019 (UTC)
Started uploading last night, will probably be ongoing for quite a while. See Category:Images from NPGallery to check to help with validation and categorization! – BMacZero (🗩) 16:35, 29 June 2019 (UTC)
Assigned to Progress Bot name Category
User:BMacZero In progress User:BMacZeroBot Category:Images from NPGallery to check
See Also

APPLAUSE

  • Does the site have an API? Yes: 101_xxxx (x is a variable number)
  • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?) https://www.plate-archive.org/query/
  • Did you contact the site owner? No
  • Describe the works to be uploaded in detail (audio files, images by …): Historical astronomical plates, logbooks, envelopes or notes https://www.plate-archive.org/applause/info/gallery/ (we don't need to upload all, but I think the plates would be insteresting.
  • Which license tag(s) should be applied?

The database is licensed under CC-0 (https://www.plate-archive.org/applause/project/disclaimer/)

  • Is there a template that could be used on the file description pages? Do you think a special template should be created? Yes, I think a template should be created.

Habitator terrae 🌍 16:37, 27 October 2018 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

PauloGuedes

This url generates 94 results pages, each linking to 10 individual image pages. Each image page url is
http://arquivomunicipal2.cm-lisboa.pt/X-arqWeb/ContentPage.aspx?ID=code&Pos=1&Tipo=PCD
while the image in it is at
http://arquivomunicipal2.cm-lisboa.pt/X-arqWeb/ContentDisplay.aspx?ID=code&Pos=1&Tipo=PCD&Thb=0
with code being a 20-digit lower-case hex number — which has no bearing with the official identification references (cota — see below).
  • Does the site have an API? dunno
    • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?) consistent, machine-generated HTML (parsable, even if not necessarily valid)
    • Did you contact the site owner? No
  • Describe the works to be uploaded in detail (audio files, images by …): Smallish batch (711, according to inventory, or 933, according with the database search report) of scanned b/w photos in various hardcopy formats.
  • Is there a template that could be used on the file description pages? Do you think a special template should be created? {{AMLx}}; it needs to be fed at least {{{cota}}} (given also as código de referência), a slashed crumbthread-like alphanumeric string of variable length; other values to be (trivially) extracted from each image page are:
  • Título
  • Assunto
  • Data(s)
  • Dimensão e suporte
  • Nota(s)
  • Cotas antigas or Cotas or Cota(s)
The filenames can be constructed from Título (possibly trimmed) and the two last crumbs of {{{cota}}}, in parenthesis, devoided of the slash (which is one of the Cotas)

-- Tuválkin 16:54, 30 June 2018 (UTC)

Never mind. The bunch of imcompetents at CMLarq changed their software and “of course” old urls wont work. As they are also copyfraud goons, the new search functionality throws us back to the 1970s and it’s even less usable. Better visit their facilities in Lisbon (now rehoused in a modern neighbourhood becuae their historic HQ had to be converted into a tourist trap) and fiddle around with a microfilm viewer or some such nonsense. -- Tuválkin 22:03, 5 August 2024 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

VOA News files

  • Source to upload from: https://web.archive.org/web/*/https://www.voanews.com/mp3/voa/english/nnow/NNOW_HEADLINES.mp3
    • Do the media URLs follow a pattern? They all have the same name. The date when archived is given in 14 digits, with the first eight digits being the year, month, and day respectively, with the remaining digits being the time of day archived, in UTC.
    • Does the site have an API? Don't know.
    • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?) Don't know.
    • Did you contact the site owner? No need to, since U.S. government works so public domain.
  • Describe the works to be uploaded in detail (audio files, images by …): VOA world news headline newscast audio files for (almost) every day spanning from 5 May 2009 to 6 July 2019.
  • Is there a template that could be used on the file description pages? Do you think a special template should be created? Just use the standard one. Upload as "VOA News Headlines (MONTH DAY, YEAR)". If possible, upload them in FLAC, WAV, and OGG.

Illegitimate Barrister (talkcontribs), 13:07, 26 May 2019 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

HiRISE

  • Describe the works to be uploaded in detail (audio files, images by …):
    Images by HiRISE (High Resolution Imaging Science Experiment)
  • Which license tag(s) should be applied?
  • As explained in each image's description page for example: "All of the images produced by HiRISE and accessible on this site are within the public domain: there are no restrictions on their usage by anyone in the public, including news or science organizations. We do ask for a credit line where possible: NASA/JPL/University of Arizona"
  • PD-USGov-NASA or a variation of it to include JPL and University of Arizona must be used.
  • Is there a template that could be used on the file description pages? Do you think a special template should be created?
There is no template yet. It must be created to include all the relevant data e.g. Acquisition date, Latitude , Longitude , etc. from the label files.
  • Note: Due to JPEG2000 not being currently supported on Wikimedia Commons, a conversion to PNG is also needed. File sizes may be large!

Meisam (talk) 21:58, 20 June 2018 (UTC)

Opinions

  •  Support Seems like an interesting project --Kristbaum (talk) 16:00, 8 May 2019 (UTC)
  •  Info Template:PD-NASA-HiRISE has been created for these images! -- Meisam (talk) 17:31, 11 May 2019 (UTC)
    @Meisam: - I am interested in pursuing this. I think it would be a logical extension of my work with uploading from ESRS. Do you have any suggestion as to how we most efficiently store the PDS data with each image? Askeuhd (talk) 08:28, 6 June 2022 (UTC)
    @Askeuhd: I don’t have any good solutions. I suppose we can store them as tEXt chunks in the PNG image and also add them in a table (using wiki templates) to the image description page. -- Meisam (talk) 11:30, 6 June 2022 (UTC)
    @Meisam: - I would personally much prefer the latter option, I fear that the former option may not be very user friendly. We will also have to parse as much of the data as possible to SDC. I will try to think of a suitable paradigm. Askeuhd (talk) 11:40, 6 June 2022 (UTC)
Assigned to Progress Bot name Category

PDS data import proposal

Proposal for the import of PDS data for each image, to ensure as much as possible is added to SDC and necessary data for the user is displayed prominently in the wikitext.

I propose that the entire LBL file is imported as a collapsible text field in the template for each file, preserving all formatting and indentation, so that researches or other users familiar with the PDS format may be able to utilize plain text search for the values we will not be able to add to SDC, similar to this:

Raw Planetary Data System data

PDS Content of LBL file

In addition to this, I have broken down the example file, to try and maximize possible SDC data migration, as well as adding some of the data to a custom wikidata template for this particular import. I am highly interested in any suggestions. I take the libery of pinging @Multichill: as you have previously been very helpful in a similar endeavour with the ISS photos. I hope you would be interested in adding your valuable input here as well.

I will make a couple of example files in a few days or so to test the SDC structure and a potential template, before starting any peliminary coding, so the concepts can be tested out.

Reference to be set as stated in (P248) --> "Planetary Data System" for all SDC values imported from PDS.

All PDS identifiers can be looked up here for clarification. The LBL example file also contains some in-line comments.

Paradigm for importing PDS data - based on example ESP_053850_2170_RED.LBL
PDS IdentifierPDS Value in example fileCommons/SDC identifierCommons/SDC value
PDS_VERSION_IDPDS3N/AN/A
NOT_APPLICABLE_CONSTANT-9998N/AN/A
DATA_SET_ID"MRO-M-HIRISE-3-RDR-V1.1"N/AN/A
DATA_SET_NAME"MRO MARS HIGH RESOLUTION IMAGING SCIENCE EXPERIMENT RDR V1.1"part of the series (P179)Appropriate wikidata-entity for this property (to be created)
PRODUCER_INSTITUTION_NAME"UNIVERSITY OF ARIZONA"affiliation (P1416) as a qualifier to creator (P170)University of Arizona (Q503419)
PRODUCER_ID"UA"N/AN/A
PRODUCER_FULL_NAME"ALFRED MCEWEN"creator (P170)"some value" --> "Alfred McEwen"
OBSERVATION_ID"ESP_053850_2170"catalog code (P528) and {{NASA-image}}"some value" --> "ESP_053850_2170", qualified with catalog (P972) and an appropriate wikidata-entity for this property (to be created).
PRODUCT_ID"ESP_053850_2170_RED"N/AN/A
PRODUCT_VERSION_ID"1.0"N/AN/A
INSTRUMENT_HOST_NAME"MARS RECONNAISSANCE ORBITER"location of creation (P1071) & location of the point of view (P7108)Mars Reconnaissance Orbiter (Q183160)
INSTRUMENT_HOST_ID"MRO"N/AN/A
INSTRUMENT_NAME"HIGH RESOLUTION IMAGING SCIENCE EXPERIMENT"captured with (P4082)HiRISE (Q1036092)
INSTRUMENT_ID"HIRISE"N/AN/A
TARGET_NAME"MARS"depicts (P180)Mars (Q111)
MISSION_PHASE_NAME"EXTENDED SCIENCE PHASE"significant event (P793)Appropriate wikidata-entity for this property (to be created)
ORBIT_NUMBER53850orbits completed (P1418)value: 53850 possibly qualified with type of orbit (P522) --> areocentric orbit (Q3884965)
SOURCE_PRODUCT_ID(ESP_053850_2170_RED0_0, ESP_053850_2170_RED0_1, ESP_053850_2170_RED1_0, ESP_053850_2170_RED1_1, ESP_053850_2170_RED2_0, ESP_053850_2170_RED2_1, ESP_053850_2170_RED3_0, ESP_053850_2170_RED3_1, ESP_053850_2170_RED4_0, ESP_053850_2170_RED4_1, ESP_053850_2170_RED5_0, ESP_053850_2170_RED5_1, ESP_053850_2170_RED6_0, ESP_053850_2170_RED6_1, ESP_053850_2170_RED7_0, ESP_053850_2170_RED7_1, ESP_053850_2170_RED8_0, ESP_053850_2170_RED8_1)N/AN/A
RATIONALE_DESC"Monitoring new impact site"to be added to {{En}} in main template - We might also go over all LBL files to search for obvious depicts (P180) statements"PDS description: Monitoring new impact site"
SOFTWARE_NAME"PDS_to_JP2 v3.19 (1.53 2012/01/24 03:07:27)"I was unable to find an appropriate wikidata property here, but I feel like there should be one ?
OBJECT = IMAGE_MAP_PROJECTION
DATA_SET_MAP_PROJECTION"DSMAP.CAT"N/AN/A
MAP_PROJECTION_TYPE"EQUIRECTANGULAR"I was unable to find the appropriate wikidata property for "projection", I might be looking in the wrong place. spatial reference system (P3037) was the closest I gotequidistant cylindrical projection (Q1326965)
PROJECTION_LATITUDE_TYPEPLANETOCENTRICN/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are planetocentric)N/A
A_AXIS_RADIUS3389.5743490888 <KM>N/A (simply the mean readius of Mars)N/A
B_AXIS_RADIUS3389.5743490888 <KM>N/A (simply the mean readius of Mars)N/A
C_AXIS_RADIUS3389.5743490888 <KM>N/A (simply the mean readius of Mars)N/A
COORDINATE_SYSTEM_NAMEPLANETOCENTRICN/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are planetocentric)N/A
POSITIVE_LONGITUDE_DIRECTIONEASTN/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are east-positive)N/A
KEYWORD_LATITUDE_TYPEPLANETOCENTRICN/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are planetocentric)N/A
POSITIVE_LONGITUDE_DIRECTIONEASTN/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are east-positive)N/A
KEYWORD_LATITUDE_TYPEPLANETOCENTRICN/A (coordinates given by globe planetocentric Martian coordinates (Q106948918) are planetocentric)N/A
CENTER_LATITUDE35.000 <DEG>See belowSee below
CENTER_LONGITUDE180.000 <DEG>coordinates of depicted place (P9149) - not completely sure though, as it the example specifically comments that the location is the center of the projection not necessarily the center of the image. So it may not be so helpful to import this value as the coordinates of depicted place (P9149) - see bounding values below{ "latitude": 35, "longitude": 180, "precision": 0.001, "globe": "http://www.wikidata.org/entity/Q106948918" }
LINE_FIRST_PIXEL1N/AN/A
LINE_LAST_PIXEL32134N/AN/A
SAMPLE_FIRST_PIXEL1N/AN/A
SAMPLE_LAST_PIXEL25483N/AN/A
MAP_PROJECTION_ROTATION0.0 <DEG>N/AN/A
MAP_RESOLUTION236636.93053097 <PIX/DEG>angular resolution (P3439)converted to milliarcseconds/pixel (1/236636.93053097*3600000) value: 15.21317907531, unit: milliarcsecond (Q21500224)
MAP_SCALE0.25 <METERS/PIXEL>I was unable to find an appropriate wikidata property here, something like "ground sample distance" or similar - I think it should be included as custom field in the wikitext template for each image, as it is a very commonly needed figureN/A
MAXIMUM_LATITUDE36.973920949851 <DEG>coordinates of northernmost point (P1332){ "latitude": 36.973920949851, "longitude": 148.23651113052, "precision": 0.000000000001, "globe": "http://www.wikidata.org/entity/Q106948918" } <-- longitude set to westermost longitude clarified by syntax clarification (P2916) qualifier.
MINIMUM_LATITUDE36.838131126084 <DEG>coordinates of southernmost point (P1333){ "latitude": 36.838131126084, "longitude": 148.36797304112, "precision": 0.000000000001, "globe": "http://www.wikidata.org/entity/Q106948918" } <-- longitude set to easternmost longitude clarified by syntax clarification (P2916) qualifier.
LINE_PROJECTION_OFFSET8749396.5 <PIXEL>N/AN/A
SAMPLE_PROJECTION_OFFSET6157087.5 <PIXEL>N/AN/A
EASTERNMOST_LONGITUDE148.36797304112 <DEG>coordinates of easternmost point (P1334){ "latitude": 36.973920949851, "longitude": 148.36797304112, "precision": 0.000000000001, "globe": "http://www.wikidata.org/entity/Q106948918" } <-- latitude set to maximum latitude clarified by syntax clarification (P2916) qualifier.
WESTERNMOST_LONGITUDE148.23651113052 <DEG>coordinates of westernmost point (P1335){ "latitude": 36.838131126084, "longitude": 148.23651113052, "precision": 0.000000000001, "globe": "http://www.wikidata.org/entity/Q106948918" } <-- latitude set to minimum latitude clarified by syntax clarification (P2916) qualifier.
GROUP = TIME_PARAMETERS
MRO:OBSERVATION_START_TIME2018-01-21T12:51:50.434N/AN/A
START_TIME2018-01-21T12:51:50.582N/AN/A
SPACECRAFT_CLOCK_START_COUNT"1201006358:10651"N/AN/A
STOP_TIME2018-01-21T12:51:53.012inception (P571) and date field in templatedate used as value for wikidata property, full time string parsed to data field for date field in wikitext template
SPACECRAFT_CLOCK_STOP_COUNT"1201006360:38785"N/AN/A
PRODUCT_CREATION_TIME2018-01-25T05:01:36publication date (P577) but I am not completely sure heredate used as value for wikidata property.
GROUP = INSTRUMENT_SETTING_PARAMETERS
MRO:CCD_FLAG(ON, ON, ON, ON, ON, ON, ON, ON, ON, OFF, ON, ON, ON, ON)N/AN/A
MRO:BINNING(1, 1, 1, 1, 1, 1, 1, 1, 1, -9998, -9998, -9998, -9998, -9998)N/AN/A
MRO:TDI(128, 128, 128, 128, 128, 128, 128, 128, 128, -9998, -9998, -9998, -9998, -9998)N/AN/A
MRO:SPECIAL_PROCESSING_FLAG(NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, NOMINAL, "NULL", "NULL", "NULL", "NULL", "NULL")N/AN/A
GROUP = VIEWING_PARAMETERS
INCIDENCE_ANGLE42.714413 <DEG>N/AN/A
EMISSION_ANGLE0.434473 <DEG>tilt (P8208)value: 0.434473 --> unit degree (Q28390)
PHASE_ANGLE42.502572 <DEG>N/AN/A
LOCAL_TIME15.10520 <LOCALDAY/24>N/AN/A
SOLAR_LONGITUDE118.215906 <DEG>N/AN/A
SUB_SOLAR_AZIMUTH173.163664 <DEG>N/AN/A
NORTH_AZIMUTH270.000000 <DEG>N/AN/A
OBJECT = COMPRESSED_FILE
FILE_NAME"ESP_053850_2170_RED.JP2"N/AN/A
RECORD_TYPEUNDEFINEDN/AN/A
ENCODING_TYPE"JP2"N/AN/A
ENCODING_TYPE_VERSION_NAME"ISO/IEC15444-1:2004"N/AN/A
INTERCHANGE_FORMATBINARYN/AN/A
UNCOMPRESSED_FILE_NAME"ESP_053850_2170_RED.IMG"N/AN/A
REQUIRED_STORAGE_BYTES1637741444 <BYTES>N/AN/A
DESCRIPTION "JP2INFO.TXT"N/AN/A
INTERCHANGE_FORMATBINARYN/AN/A
OBJECT = UNCOMPRESSED_FILE
FILE_NAME"ESP_053850_2170_RED.IMG"N/AN/A
RECORD_TYPEFIXED_LENGTHN/AN/A
RECORD_BYTES50966 <BYTES>N/AN/A
FILE_RECORDS32134N/AN/A
IMAGE"ESP_053850_2170_RED.IMG"N/AN/A
DESCRIPTION"HiRISE projected and mosaicked product"Could potentially be added to {{En}} in descriptionN/A
LINES32134N/AN/A
LINE_SAMPLES25483N/AN/A
BANDS1N/AN/A
SAMPLE_TYPEMSB_UNSIGNED_INTEGERN/AN/A
SAMPLE_BITS16N/AN/A
SAMPLE_BIT_MASK2#0000001111111111#N/AN/A
SCALING_FACTOR1.41615214363203e-04N/AN/A
BANDS1N/AN/A
OFFSET0.060336154982679N/AN/A
BAND_STORAGE_TYPEBAND_SEQUENTIALN/AN/A
CORE_NULL0N/AN/A
CORE_LOW_REPR_SATURATION1N/AN/A
CORE_LOW_INSTR_SATURATION2N/AN/A
CORE_HIGH_REPR_SATURATION1023N/AN/A
CORE_HIGH_INSTR_SATURATION1022N/AN/A
CENTER_FILTER_WAVELENGTH700 <NM>Should be added to wikitext template along with FILTER_NAME as the images will be uploaded as PNG 16 bit grayscaleN/A
MRO:MINIMUM_STRETCH3N/AN/A
MRO:MAXIMUM_STRETCH1021N/AN/A
FILTER_NAME"RED"N/AN/A

Additionally I propose the following the properties


@Meisam: --Askeuhd (talk) 16:08, 7 June 2022 (UTC) Category:Commons batch uploading#Batch%20uploading

freepd.com

Site contains production music tracks, in various genres, mp 3 format.

  • Source to upload from:

http://freepd.com/

    • Do the media URLs follow a pattern?

None found. Tracks seem to be in sub-directories related to nominal genre, MP3 files are named for the track title apparently.

    • Does the site have an API?

Unknown.

    • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?)

Unknown.

    • Did you contact the site owner?

Site owner not contacted.

  • Describe the works to be uploaded in detail (audio files, images by …):

"Production music", in various genres., in MP3 format.

  • Which license tag(s) should be applied?

Site claims tracks are in the public domain:- http://freepd.com/faq.html ; However some of these tracks were previously under CC-BY on the site owners other site at incompetech.

  • Is there a template that could be used on the file description pages? Do you think a special template should be created?

{{Information}} with additional field as was done on the previous batch upload for incompetech.

ShakespeareFan00 (talk) 10:20, 18 December 2017 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

Commons:Batch uploading/timbeek.com/

  • Source to upload from:

http://timbeek.com/ in particular music tracks listed in http://timbeek.com/royalty-free-music/isrc/

    • Do the media URLs follow a pattern?

No general pattern, but there's a master list (not sure if it's complete) of track pages here - http://timbeek.com/royalty-free-music/isrc/, Donwload links in the UI seem to link to numbered subdirectories, but general pattern undetermined or not obvious.

    • Does the site have an API?

Unknown.

    • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?)

Unknown

    • Did you contact the site owner?

Site owner not contacted.

  • Describe the works to be uploaded in detail (audio files, images by …):

A Small set of 'production music' tracks, in assorted genres.


  • Which license tag(s) should be applied?

See: http://timbeek.com/royalty-free-music/license/ , assuming attribution requirments are met the music appears to be under CC-BY 4.0. (see also: http://timbeek.com/royalty-free-music/faq/ and http://timbeek.com/royalty-free-music/copyright/)

  • Is there a template that could be used on the file description pages? Do you think a special template should be created?

{{Information}} with additional fields as was previously implemented for the incomptech.com batch upload(this site seems to use a simmilar approach).

ShakespeareFan00 (talk) 19:05, 15 December 2017 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#timbeek.com

USDA NRCS Plants Database

  • Source to upload from: http://plants.usda.gov/
    • Do the media URLs follow a pattern? Yes.
    • Does the site have an API? No.
    • What else could ease uploading? (is the site valid XHTML, do they use a WCM…?) valid XHTML
    • Did you contact the site owner? No.
  • Describe the works to be uploaded in detail (audio files, images by …): Public domain: 10771 photos and 7064 line drawings, with species information for categorization. There are other copyrighted images as well, some of which may be freely licensed.
  • Which license tag(s) should be applied?

{{PD-USGov-USDA-NRCS}}

  • Is there a template that could be used on the file description pages? Do you think a special template should be created?

Opinions

@Guanaco: There is a lot of copyrighted material within these images, e.g. . (Just because this is a U.S. government web site this does not mean all the material is U.S. government material and by this means freely usable!) Actually I have not found too many images that really can be used (e.g. ). You should at least provide a procedure how to distinguish between copyrighted and free material. --Reinhard Kraasch (talk) 11:02, 9 July 2017 (UTC)

@Reinhard Kraasch: The gallery search function has a filter by copyright status.
I've found that the URLs linked by the thumbnails provide species information within <title>: https://plants.usda.gov/core/profile?symbol=HACA2&photoID=haca2_003_ahp.jpg#
The search is navigable with &page=2, 3, 4, etc.
I'm actually interested in scripting this myself now, though it would be my first batch upload task. Guanaco (talk) 14:23, 9 July 2017 (UTC)
@Guanaco: Well, just go on... On the other hand it always is a good idea to have a second opinion with such a batch upload - especially for the non-technical aspects. --Reinhard Kraasch (talk) 20:52, 10 July 2017 (UTC)
Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

US National Archives

I am hoping to begin a bulk upload of media from the US National Archives in the next few weeks. This will be a very different approach from the first upload, which was based on uploading files from an offline drive and scraping HTML for the metadata. This time around, NARA has an API for our online catalog, and so I am building a bot, using mwclient, to upload using the live metadata and files from the API. Some details:

Dataset

The dataset includes all PD materials at https://catalog.archives.gov (API: https://catalog.archives.gov/api/v1). I plan to begin with a series of ~100,000 WWI-era photos. Technically, there are over 15 million files (and counting) in this dataset.

File names

The script is currently configured to name files with the formula: For single-page items:

  • "File:[TITLE] - NARA - [NAID].ext"
    Where "[TITLE]" is the catalog record's title field, and "[NAID]" is the National Archives Identifier. If this is over the character limit, "[TITLE]" is automatically truncated, with "(...)" appended.

For multi-page items (since the above formula would give all files belonging to one catalog record the same title):

  • "File:[TITLE] - NARA - [NAID] (page X).ext"
Metadata

We are developing a custom metadata mapping, since NARA does not adhere to a metadata standard. You can see the metadata template we use here: {{NARA-image-full}}. Some notes:

While all the records in this catalog come from NARA or partner institutions, there are many different facility locations, and some NARA facilities have their own institutions templates already (e.g. US presidential libraries). Therefore, I am creating institution templates to go along with all NARA locations, and the script will insert the correct institution template based on a mapping.

NARA's authority file is not yet mapped to Wikidata, however that is definitely something that would be useful in the future. For now, we will upload files with NARA's creator and author names and their NAIDs and links back to the catalog authority record. However, including the NAIDs in a Commons template field means that in the future, Wikidata could be used to make creator templates appear instead. Any help with this would be appreciated.

Licenses

Because NARA records are nearly all (>99%) derived from the records of US federal agencies, these uploads will use {{PD-USGov}} or its subtemplates. Most NARA records are in one of about 600 record groups based on their creating agency, so I am using a mapping of NARA record groups to Commons PD-USGov templates so that the bot can apply the more specific agency templates in most cases. Help filling out this mapping would be appreciated.

Nearly all holdings of the US National Archives are in the public domain as a work of the federal government (or, otherwise, due to age). This is marked in the "use restriction" field in the catalog, with a value of "Unrestricted" indicating public domain determination by the archivists. Therefore, the script will be configured to skip over any records in which the use restriction is anything other than "unrestricted" (even "possibly" ones, which could ultimately be PD, but need a human determination).

Categories

All uploads will be automatically categorized by the metadata template into Category:Media contributed by the National Archives and Records Administration and a category for the series they belong to (such as Category:US National Archives series: DOCUMERICA: The Environmental Protection Agency's Program to Photographically Document Subjects of Environmental Concern, compiled 1972 - 1977). Eventually, the script will be designed to create the series category if a file is uploaded for a series which does not yet have one.

When it comes to topical categories, past NARA uploads utilized the {{Uncategorized}} tag to encourage the community to add topical tags. However, since this creates work for the community, I am planning this time around to run uploads a small batch (hundreds to a few thousand) at a time, so I can upload them with one or more topical categories that apply to all records in the batch, rather than uncategorized.

Code

You can find the upload bot's code at https://github.com/usnationalarchives/wikimedia-upload. This project is being developed in public on NARA's official GitHub account. I would welcome collaboration (pull requests or otherwise) there. In addition, the Commons community is welcome to file issue reports on that repo.

Examples

The most recent test uploads can be viewed in Category:US National Archives series: American Unofficial Collection of World War I Photographs. I am still polishing the upload script, but these examples essentially represent what should be expected from the bot once it gets started.

Opinions

The bot account is technically already flagged from the last bulk upload a couple of years ago, however I would like to submit the current plan to community review before restarting uploads. If there are any opinions on the bot's design or the format of uploads or other issues, I am happy to hear them. We'd also like to know whether to limit what is uploaded in any way—as in, would Commons actually be interested in 15 million files, or might some of these, like the millions of census cards, not be of interest. Also, if anyone is interested in helping out with the coding or other tasks, please feel free to let me know. This is a big undertaking. Thanks! Dominic (talk) 17:25, 31 May 2017 (UTC)


Assigned to Progress Bot name Category
User:Dominic Coding User:US National Archives bot Category:Media contributed by the National Archives and Records Administration
Category:Commons batch uploading#Batch%20uploading

ESA-Rosetta-NAVCAM

  • Describe the works to be uploaded in detail (audio files, images by …):
Images the comet 67P/CHURYUMOV-GERASIMENKO by the NAVCAM on the Rosetta spacecraft.


  • Is there a template that could be used on the file description pages? Do you think a special template should be created?

Yann (talk) 14:32, 6 June 2015 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

USC Cinema

Source to upload from

https://archive.org/details/usc-sound-effect-archive

License

The files in this collection claim to be licensed CC BY 4.0. This is not true--all this archive is was someone collating the files and uploading them there. These files were all uploaded by Craig Smith on freesound.com under a CC0. The Gold and Red files are a valid {{CC0}} as Craig Smith works for USC. The Sunset Editorial files are all either {{PD-US-defective notice}} or {{PD-US-defective notice-1978-89}}. The notices are defective because according to the linked blog, all SSE ever got was a credit line. The company was no longer active by 1989, and I checked and there are no copyright registrations under SSE's name. The publication years of the sound effects however, are unknown, so I plan on tagging everything with PD-US-defective notice-1978-89.

Description

This is a set of audio files by the University of Southern California and Sunset Editorial consisting of the original recordings of sound effects used in movies from the 60s to 80s; a few of these sound effects are very famous (like the Wilhelm Scream). This file conveniently maps all the sound effects with a metadata .csv file with descriptions and upload dates and everything, so setting up a batch upload isn't too difficult. I'm prepared to do this upload myself.

Snowmanonahoe (talk) 02:21, 27 May 2023 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading

NIH Bioart

These biology icons are very useful, please upload them all.

Source to upload from

https://bioart.niaid.nih.gov/

License

{{PD-author}}

{{PD-author|BioArt}}

Description

  • They can be used in medical diagrams and various other information graphics and are of high importance because not only are such often used in important health education but also Biorender icons can't be used due to their licensing and these icons could be used as an alternative or even to substitute these.
  • Please add them to Category:NIH BioArt further categories in addition that better enable people to find these would also be good. Please make sure to use descriptive titles and descriptions, probably by using the title on the site and its description and keywords.
  • The website doesn't load properly on my end. Don't know why that is but it makes it even more important to upload these icons here and integrate it into this large media repository.

Prototyperspective (talk) 15:15, 16 May 2025 (UTC)

Opinions

Assigned to Progress Bot name Category
Category:Commons batch uploading#Batch%20uploading Category:NIH BioArt

Old requests (before 2020-01-01)

Batch uploads in progress

Batch uploads on hold

Done (to be moved to past batch uploads)

Failed

Scripters

Currently inactive

Tools

Scripts, Examples and Information

Category:Commons batch uploading Category:Commons requests
Category:Commons batch uploading Category:Commons requests