Commons talk:Video2commons
 |
SpBot archives all sections tagged with {{Section resolved|1=~~~~}} after 1 day and sections whose most recent comment is older than 90 days. For the archive overview, see Special:PrefixIndex/Commons talk:Video2commons/Archive. |
|
|
Before you file a report, please check whether the following list already includes the problem you have.
Known bugs and common errors
- Subtitles are not imported https://github.com/toolforge/video2commons/issues/148
- Since circa 2020, subtitles have not been automatically imported even if the option is selected. Unknown cause, possibly bug in codes. Previous discussions: Commons_talk:Video2commons/Archive_2#Youtube_subtitle_not_imported Commons_talk:Video2commons/Archive_2#Not_importing_subtitles_from_youtube.--RoyZuo (talk) 17:04, 1 January 2023 (UTC) Wish: Make video2commons subtitle import work again & add subtitles to earlier video imports. --Prototyperspective (talk) 12:38, 7 June 2025 (UTC)
Fork youtube2commons with cookies supplied by user？
after reading https://github.com/yt-dlp/yt-dlp/issues/10085
i'm thinking of a solution to https://github.com/yt-dlp/yt-dlp/issues/10128 .
our 1st new cookie only worked for 9.5 days. if using cookies will lead to the account being blocked according to issues/10085, i dont have a way to generate new accounts once a week.
so i have a rough idea. what if we make a v2c fork that focuses on youtube? and there will be an extra step where the user has to supply cookies for their own tasks.
then perhaps, infrequent users would not get rate limited by youtube, whereas frequent users will have to figure out new cookies by themselves. RoyZuo (talk) 12:11, 1 April 2025 (UTC)
- I have also heard that people using vpn are now constantly bumping into the sign up wall. people say that youtube is now trying their best to prevent people from browsing youtube without login. so it seems now we have more frequent problems because youtube becomes restrictive recently. RoyZuo (talk) 12:13, 1 April 2025 (UTC)
- btw, instead of measuring days, the number of videos might be a better indicator. 239 youtube videos were uploaded during 10 days, then the cookies failed. RoyZuo (talk) 06:48, 2 April 2025 (UTC)
- Perhaps we could use random cookies or user agents and keep the one that work until they don't? I just tried 10 times to have v2c convert https://www.youtube.com/watch?v=6T5m3KTdKTg per Special:Diff/1018620498; 60% failed asking v2c to login, and the other 40% failed due to "The downloaded file is empty". — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 00:21, 8 April 2025 (UTC)
- Tvpuppy got it uploaded to File:President Biden Welcomes the Texas Rangers to Celebrate their 2023 World Series Championship Season.webm per Special:Diff/1019134137. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 09:03, 9 April 2025 (UTC)
- Perhaps we could use random cookies or user agents and keep the one that work until they don't? I just tried 10 times to have v2c convert https://www.youtube.com/watch?v=6T5m3KTdKTg per Special:Diff/1018620498; 60% failed asking v2c to login, and the other 40% failed due to "The downloaded file is empty". — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 00:21, 8 April 2025 (UTC)
Failling for flickr
i just tried a flickr video. gave me
An exception occurred: DownloadError: b'ERROR: unable to download video data: HTTP Error 429: Too Many Requests'
v2c seems to be working for other websites though. RoyZuo (talk) 13:39, 7 April 2025 (UTC)
- it's the same error if i use the direct flickr video url e.g. https://live.staticflickr.com/video/48044468858/336f21bb49/1080p.mp4 .
- toolforge server blocked by flickr? RoyZuo (talk) 18:47, 8 April 2025 (UTC)
- @RoyZuo: For that URL, I get '"code": 403,' and '"message": "Invalid signature"'. See also Commons talk:Flickr2Commons#Empty files. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 08:56, 9 April 2025 (UTC)
Help:Server-side upload
Hi, For some unknown reason, for some large files, V2C requests a Server-side upload (SSU). However I have been told that this service is deprecated. Last October 2024, I processed several films and requested a SSU. Now the files are not available anymore, so all this work is lost. :((( Yann (talk) 09:13, 9 April 2025 (UTC)
- @Yann: Mine that worked for RoyZuo was phab:T357403 for uploading https://www.youtube.com/watch?v=cpnOJaZlPaI to File:City Driving 4K- Kraków Poland 2024.webm, but no one has yet reviewed the license visible here. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 09:49, 9 April 2025 (UTC)
- OK, I got the explanation here. So in short, V2C requests a SSU when it gets a 'backend-fail-internal' error. So SSU requests are not directly linked to the file size, as I thought. And indeed, some of the videos which were sent to SSU can be uploaded now (e.g. File:Life with Father (1947) by Michael Curtiz.webm, 2.21 GB). Yann (talk) 19:09, 11 April 2025 (UTC)
Terms of service of source sites?
Does video2commons respect the terms of service of YouTube and other source sites it downloads from? YouTube's terms of use quite clearly forbid automated downloads without written permission from YouTube... This is a hard blocker for ever fully integrating video2commons under Wikimedia's operations. --Brooke Vibber (WMF) (talk) 17:37, 9 April 2025 (UTC)
- @Brooke Vibber (WMF) https://phabricator.wikimedia.org/T236446 I dont know what happend to those talks years ago. RoyZuo (talk) 18:26, 9 April 2025 (UTC)
- Thanks... having read that: looks like no, we don't have an exception arranged with YouTube. We can fully expect frequent rate-limiting or blocking of any Wikimedia Toolforge or other IPs doing forbidden-by-YouTube downloads and it's unlikely we will ever be able to integrate this as a Wikimedia-run tool. --Brooke Vibber (WMF) (talk) 19:31, 9 April 2025 (UTC)
- Video2Commons is not an automated download tool. It downloads the video the user tasks it to. Prototyperspective (talk) 20:27, 9 April 2025 (UTC)
- The tasks are submitted manually by the users, some of whom are loathe to shell out US$13.99/month for YouTube Premium, plus all the necessary hardware expenditures and learning for conversion to a free format. I wonder if YouTube is paying the MP4 patentholders for use of their patented codec technologies. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 22:39, 9 April 2025 (UTC)
rereading: dead link https://yt-dl.org/...
In section of error list: "An exception occurred: DownloadError: ERROR: KTvdqve_naM: "token" parameter not in video info for unknown reason; please report this issue on https://yt-dl.org/bug . Make sure you are using the latest version; see https://yt-dl.org/update on.."
both links -> https://yt-dl.org/bug no longer exist (error 404). Please realign. -- Christian 🇫🇷 FR (talk) 10:14, 11 April 2025 (UTC)
Failed OAuth authentication for Commons
Hi, I got this error:
An exception occurred: UnpickleableExceptionWrapper: b"TaskError(b'pywikibot.Error: NoUsernameError: Failed OAuth authentication for commons:commons: The authorization headers in your request are not valid: No approved grant was found for that authorization token.')" Yann (talk) 19:13, 11 April 2025 (UTC)
- Today I've tried uploading a video and I'm receiving the same error. --NoonIcarus (talk) 01:39, 27 April 2025 (UTC)
- @Yann@NoonIcarus I'm not sure what causes this problem. Have you tried logging out and then in again, then retrying your upload? RoyZuo (talk) 07:55, 27 April 2025 (UTC)
- I personally retried the upload and it worked on the fourth try. I'll let know if it happens again. Thank you very much. --NoonIcarus (talk) 15:17, 27 April 2025 (UTC)
- @Yann@NoonIcarus I'm not sure what causes this problem. Have you tried logging out and then in again, then retrying your upload? RoyZuo (talk) 07:55, 27 April 2025 (UTC)
Discussion on adding some functionality to the Upload Wizard
We are looking at funding this as per Commons_talk:Upload_Wizard#Merging_in_some_aspects_of_Commons:Video2commons. Welcome to feedback. Doc James (talk · contribs · email) 02:12, 20 April 2025 (UTC)
How to import subtitles retrospectively?
Due to the severe bug of subtitles not being imported, many videos don't have subtitles. Is there a way to import them manually to the TimedText (e.g. this video)? Prototyperspective (talk) 18:08, 11 May 2025 (UTC)
- @Prototyperspective See instructions at Commons:Timed Text#Downloading subtitles from YouTube. But I think @Alachuckthebuck can help adding captions to the video. Tvpuppy (talk) 21:17, 11 May 2025 (UTC)
- I can redo the subtitles with Whisper, just give me a list of files that need subtitles. All the Best -- Chuck Talk 22:10, 11 May 2025 (UTC)
- The video above is not in English and even if it was if there already are human-written subtitles those would be better to import since e.g. audio quality can be bad at times, words ambiguous, names, etc. I'll try #Downloading subtitles from YouTube later but it would be better if there was some tool / V2C where one could just enter the url and the Commons file url and it imports the subtitle(s) to the correct timed text + adds {{Closed captions}} (or the cat). Prototyperspective (talk) 22:28, 11 May 2025 (UTC)
- I can redo the subtitles with Whisper, just give me a list of files that need subtitles. All the Best -- Chuck Talk 22:10, 11 May 2025 (UTC)
Python blocking error
I've been using vid2commons extensively for the past several days, as I had a long queue of files to upload from when it was not working earlier this year. Thanks for making/maintaining this tool. It's been working well for a few days but just now, I got:
Error: An exception occurred: BlockingIOError: b'[Errno 11] write could not complete without blocking'
When trying to upload a file from YouTube. Grafana only notes nine instances up. —Justin (koavf)❤T☮C☺M☯ 15:40, 15 May 2025 (UTC)
- @Justin: There only are nine instances. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 16:03, 15 May 2025 (UTC)
- Gotcha. And to be clear, I should have mentioned the aggregated load, not the instances. The load seems to be c. 50. —Justin (koavf)❤T☮C☺M☯ 16:12, 15 May 2025 (UTC)
- Hi, I'm trying to upload two videos related to the 2018 Chongqing bus crash made by @cnsvideo and experienced the same problem. What might be the problem and what should I do next? 4084470 0.smil (talk) 16:56, 15 May 2025 (UTC)
- It's working now. Here's to the next 107,000+ videos. Thanks again. —Justin (koavf)❤T☮C☺M☯ 13:22, 16 May 2025 (UTC)
Tasks are pending for several hours
I have three short videos being imported from YouTube that have the status "Your task is pending..." and have been that way for the better part of a day. I don't see any discussion of this on the main page and Grafana shows nine instances up with <50 aggregate load presently. —Justin (koavf)❤T☮C☺M☯ 18:08, 18 May 2025 (UTC)
- Same thing happened to me before, one time I upload a video and it said it’s pending, but then the videos I uploaded later went through without any problems. I waited for a couple hours and still nothing, so I just remove it from the queue and reuploaded it, and it worked fine. Since then, every time I saw this message (not often), I would assume something went wrong and I just remove the task and reupload. Tvpuppy (talk) 18:53, 18 May 2025 (UTC)
- did yall try refreshing the page? i notice that even though the actual status of a task may have changed, it takes time to show on v2c, unless you refresh the page to see the newest status. RoyZuo (talk) 08:32, 19 May 2025 (UTC)
- Yes —Justin (koavf)❤T☮C☺M☯ 15:58, 19 May 2025 (UTC)
- Yes, same for me. I remember I refreshed it many times throughout the couple hours I waited, it still said pending. Tvpuppy (talk) 21:38, 19 May 2025 (UTC)
- This generally means V2C is processing someone else's task. I think it'd be a good idea to show the tasks from everyone in public view so we'd know what's going on. I'd be able to help (cc @Don-vip) -- DaxServer (talk) 09:33, 20 May 2025 (UTC)
- Hi @DaxServer any help is greatly appreciated, thank you :) I have added you co-maintainer of the various toolforge projects in toolsadmin. You need to create a phabricator ticket however, to ask to become member of the github toolforge org and get write privileges on the video2commons github repository, I can't do it myself. vip (talk) 13:31, 20 May 2025 (UTC)
- I just have restarted the celery workers on all encoder instances, looks like jobs are being picked up again. vip (talk) 13:43, 20 May 2025 (UTC)
- Thank you @Don-vip :D -- DaxServer (talk) 15:22, 20 May 2025 (UTC)
- Hi @DaxServer any help is greatly appreciated, thank you :) I have added you co-maintainer of the various toolforge projects in toolsadmin. You need to create a phabricator ticket however, to ask to become member of the github toolforge org and get write privileges on the video2commons github repository, I can't do it myself. vip (talk) 13:31, 20 May 2025 (UTC)
- This generally means V2C is processing someone else's task. I think it'd be a good idea to show the tasks from everyone in public view so we'd know what's going on. I'd be able to help (cc @Don-vip) -- DaxServer (talk) 09:33, 20 May 2025 (UTC)
New upload error
Error: An exception occurred: DownloadError: b'ERROR: [youtube] YouTube video identifier: Requested format is not available. Use --list-formats for a list of available formats'
This has happened several times now. Grafana shows nine instances up and lately c. 50 aggregate load. —Justin (koavf)❤T☮C☺M☯ 05:26, 22 May 2025 (UTC)
- Can the tool fallback to lower resolution (ideally less-preferable) formats? — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 14:04, 22 May 2025 (UTC)
- I have this error too. --ComputerHotline (talk) 06:58, 24 May 2025 (UTC)
- I have the error too. – Illegitimate Barrister (talk • contribs), 15:39, 24 May 2025 (UTC)
- I also have been receiving this error. --Ser Amantio di Nicolao (talk) 05:03, 25 May 2025 (UTC)
- All good now. Thanks. —Justin (koavf)❤T☮C☺M☯ 23:55, 28 May 2025 (UTC)
New error
An exception occurred: TaskError: b'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/166421aefe5c09a7/dl.unknown_video -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -ss 0 -an -pass 1 -passlogfile /srv/v2c/output/166421aefe5c09a7/dl.unknown_video.vp9.webm.log /dev/null\nExitcode: 134'--TaronjaSatsuma (talk) 10:52, 24 May 2025 (UTC)
Failed to determine the path of the downloaded video. Is the video too large?
b'Failed to determine the path of the downloaded video. Is the video too large?' Is there a limit of size for the files to be uploaded?--TaronjaSatsuma (talk) 10:58, 24 May 2025 (UTC)
Another error
An exception occurred: TaskError: b'b"pywikibot.Error: APIError: titleblacklist-forbidden: \\xe2\\xa7\\xbctitleblacklist-custom-space\\xe2\\xa7\\xbd\\n[message: {\'key\': \'titleblacklist-custom-space\', \'params\': [\' File:.*\\\\\\\\s(\\\\\\\\,|\\\\\\\\.)(a?png|gif|jp[egs]g?|tiff?|xcf|pdf|midi?|kar|svg|djvu?|og[avgx]|flac|opus|spx|wav|web[mp]|mp[ae23g]g?|stl) <reupload | errmsg=titleblacklist-custom-space>\', \'File:\\xeb\\xb3\\xb8\\xed\\x8e\\xb8 1-2\\xed\\x99\\x94 - \\xec\\x84\\xb8\\xec\\x83\\x81 \\xeb\\xb0\\x96\\xec\\x9c\\xbc\\xeb\\xa1\\x9c \\xec\\x9a\\xb0\\xeb\\x8b\\xb9\\xed\\x83\\x95! - \\xec\\xa2\\x8c\\xec\\xb6\\xa9\\xec\\x9a\\xb0\\xeb\\x8f\\x8c \\xec\\x9d\\xb8\\xec\\x96\\xb4\\xea\\xb3\\xb5\\xec\\xa3\\xbc \\xec\\x95\\xa0\\xeb\\x8b\\x88\\xeb\\xa9\\x94\\xec\\x9d\\xb4\\xec\\x85\\x98 - \\xeb\\xaa\\xb0\\xec\\x95\\x84\\xeb\\xb3\\xb4\\xea\\xb8\\xb0 - \\xeb\\xa0\\x88\\xec\\x9d\\xb8\\xeb\\xb3\\xb4\\xec\\x9a\\xb0 \\xeb\\xb2\\x84\\xeb\\xb8\\x94\\xec\\xa0\\xac .webm\']};\\n line: File:.*\\\\s(\\\\,|\\\\.)(a?png|gif|jp[egs]g?|tiff?|xcf|pdf|midi?|kar|svg|djvu?|og[avgx]|flac|opus|spx|wav|web[mp]|mp[ae23g]g?|stl) <reupload | errmsg=titleblacklist-custom-space>;\\n stasherrors: [{\'message\': \'uploadstash-exception\', \'params\': [\'UploadStashBadPathException\', \'El cam\\xc3\\xad no existeix.\'], \'code\': \'uploadstash-exception\', \'type\': \'error\'}];\\n invalidparameter: filename;\\n servedby: mw-api-ext.eqiad.canary-6b59d64cc4-6vp79;\\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]"'--TaronjaSatsuma (talk) 17:07, 1 June 2025 (UTC)
- titleblacklist
- what name did you give the video? RoyZuo (talk) 18:09, 1 June 2025 (UTC)
- Molang's Swimming Adventure with Piu Piu --TaronjaSatsuma (talk) 14:55, 2 June 2025 (UTC)
- @TaronjaSatsuma: There seems to be a custom space in what you originally tried to use, probably from a copy-paste. Please try again, replacing all characters that appear to be spaces with actual spaces. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 15:11, 2 June 2025 (UTC)
- I'll try. thx! TaronjaSatsuma (talk) 15:26, 2 June 2025 (UTC)
- @TaronjaSatsuma: There seems to be a custom space in what you originally tried to use, probably from a copy-paste. Please try again, replacing all characters that appear to be spaces with actual spaces. — 🇺🇦Jeff G. ツ please ping or talk to me🇺🇦 15:11, 2 June 2025 (UTC)
- Molang's Swimming Adventure with Piu Piu --TaronjaSatsuma (talk) 14:55, 2 June 2025 (UTC)
Video conversion error: slowed down
In File:Supersonic contra dance weekend 2025.webm, the video appears to have been noticeably slowed down during the conversion process (the original did not have any slowed movement), even though the audio is normal. Is this a known error? Can it be corrected without having to reuploaded however many videos it's affected? Sdkb talk 19:18, 3 June 2025 (UTC)
Upload error for the past couple of days
I am getting errors of the sort:
Error: An exception occurred: DownloadError: b'ERROR: [youtube] video-id: Video unavailable. This content isn\xe2\x80\x99t available.'
And I have checked several such videos to confirm that they are live on the Web. This has been persistent for about two days. Grafana shows nine instances up and near zero aggregate load. —Justin (koavf)❤T☮C☺M☯ 20:36, 4 June 2025 (UTC)
- I'm getting the same error as well as of 8 June 2025. FunnyMath (talk) 23:11, 8 June 2025 (UTC)
- Same error as of June 11, 2025. Based5290 (talk) 22:09, 11 June 2025 (UTC)
- https://github.com/yt-dlp/yt-dlp/issues/12292 https://github.com/yt-dlp/yt-dlp/issues/10085 . RoyZuo (talk) 07:41, 12 June 2025 (UTC)
- In the link https://github.com/yt-dlp/yt-dlp/issues/10085 from above (thanks, @RoyZuo: ), there is a comment that says:
...supplying a valid PO Token may help prevent getting your account blocked in some cases.
See the PO Token Guide and po_token extractor arg for more details.
Note: requires yt-dlp nightly
- If we go to the PO Token Guide, it says:
TL;DR recommended setup: Either use a PO Token Provider plugin, or manual extraction, to provide the mweb client with a PO Token for GVS requests.
See the notice in the YouTube Extractor Wiki for more information on the current state of downloading videos from YouTube.
- Going to the notice in the YouTube Extractor Wiki, we find:
YouTube is gradually enforcing the use of a "PO Token" to be able to download videos. Due to the nature of these tokens, yt-dlp cannot generate them and they must be provided externally.
By default, yt-dlp will attempt to download videos using clients that do not currently require a PO Token. However, some formats and features may not be available without the token(s).
At this time, if you are having issues with the default clients, it is suggested to use the mweb client with a PO Token. Refer to the PO Token Guide on how to set up yt-dlp for this.
- So, it looks like the problem could be that video2commons is attempting to download YouTube videos without a PO Token. Could someone verify that video2commons currently does not have a PO Token? If that is the case, then we should try providing a valid PO Token to see if it solves the problem. FunnyMath (talk) 03:28, 18 June 2025 (UTC)
- The video downloader from https://cobalt.tools/ currently works for YouTube videos, so a fix should be possible IMO. FunnyMath (talk) 03:41, 18 June 2025 (UTC)
- @FunnyMath: :
- youtube downloading is temporarily disabled due to restrictions from youtube's side. we're already looking for ways to go around them.
- Any other leads? —Justin (koavf)❤T☮C☺M☯ 02:00, 20 June 2025 (UTC)
- Unfortunately, I've got nothing else to say. I'm not enough of a technical expert to help further. I've also checked for the last few days, and the problem still exists for me, so you're not alone. FunnyMath (talk) 02:47, 20 June 2025 (UTC)
- Actually, looking into this more, I found this bug report for the same error ("b'ERROR: [youtube] qaImFO_DgAM: Video unavailable. This content isn\xe2\x80\x99t available."): https://github.com/yt-dlp/yt-dlp/issues/12292
- In that link, someone said:
I'm also having this issue. The cookies work fine with another IP. I think the IP is banned even with valid cookies.
- @FunnyMath: :
- So, another possibility is that the IP address for video2commons is banned by YouTube. Perhaps we could try changing the IP address to see if it works. FunnyMath (talk) 03:10, 20 June 2025 (UTC)
- In this other bug report (https://github.com/yt-dlp/yt-dlp/issues/11426), a person said:
It would seem that a rate-limit is being enforced now. Pace yourself. --sleep-requests, --sleep-interval, --max-sleep-interval are some tools available
- So, another possibility is that the IP address for video2commons is banned by YouTube. Perhaps we could try changing the IP address to see if it works. FunnyMath (talk) 03:10, 20 June 2025 (UTC)
- That person suggested the following sleep settings:
you could try:
--sleep-requests 1.25
--min-sleep-interval 60
--max-sleep-interval 90
- The solution above seems to work for at least two other people who posted in that thread. One person said that they "set --sleep-requests 5 and omitted the other commands. It's slow, but I havent timed out running nearly 24/7..." . Another person said the sleep settings in the second quote above has solved their problem.
- So, another possible solution is to set or adjust the sleep settings for video2commons. Based on my gut feelings, I think the sleep settings would address the root cause of the problem, compared to adding a PO Token or changing IP addresses. FunnyMath (talk) 03:30, 20 June 2025 (UTC)
- I check semi-daily and this still seems to be happening constantly. Grafana shows that very little media are being uploaded with this tool. Is this a good way to get a hold of anyone who maintains it? If there's a better avenue to point out these issues (phab: or Github?) then please let me know. —Justin (koavf)❤T☮C☺M☯ 07:28, 19 June 2025 (UTC)
Cannot upload age-restricted videos (cont'd)
@Don-vip: I apologize for the late reply to your question from Commons_talk:Video2commons/Archive/2024#Cannot_upload_age-restricted_videos.
It has been a long time, so my memory might not be reliable. I think I used the (now obsolete) OAuth plugin to bypass the age-restriction: https://github.com/coletdjnz/yt-dlp-youtube-oauth2 FunnyMath (talk) 06:57, 8 June 2025 (UTC)