Commons talk:Video2commons

From Wikimedia Commons, the free media repository
Jump to navigation Jump to search
SpBot archives all sections tagged with {{Section resolved|1=~~~~}} after 10 days and sections whose most recent comment is older than 365 days. For the archive overview, see Special:PrefixIndex/Commons talk:Video2commons/Archive.

Before you file a report, please check if the following list already includes the problem you have.

File not found[edit]

I am trying to upload from the disk and I am receiving an error File not found. How to debug? --Juandev (talk) 09:30, 3 June 2022 (UTC)Reply[reply]

The maintainer of v2c seems to have left. So proably there is no way to debug. You could say the file size and file type, also if the filename contains "funny" characters and the encoding and encoder of the file. you could upload a screenshot of the error. You could encode the file to webm (vp9) locally and upload with another upload tool. C.Suthorn (talk) 12:19, 3 June 2022 (UTC)Reply[reply]

I'm getting Error: An exception occurred: FileNotFoundError: b"[Errno 2] No such file or directory: '/data/project/video2commons/video2commons/frontend/static/uploads/cf3490de-c6a9-11ed-8805-12dffaea8a17'" on a file called "Racehorse Falls 01.mp4". No "funny" filenames there. 9 seconds of video, 15.4MB. - Jmabel ! talk 23:03, 19 March 2023 (UTC)Reply[reply]

Error uploading file from computer[edit]

Good day. I am trying to upload a mp4 video (502 Mb) from my local PC, but no matter what I try I keep getting the error "Error: An exception occurred: FileNotFoundError: b"[Errno 2] No such file or directory: '/data/project/video2commons/video2commons/frontend/static/uploads/66607222-03a3-11ed-921f-82d0630f66a4'" during the upload process. Anyone understand this error and how to get around it? Huntster (t @ c) 18:42, 14 July 2022 (UTC)Reply[reply]

This may be a temporary malfunction of the tool. Otherwise only the maintainer of v2c can fix it. If you want to get the file uploaded soon, your best bet would be to transcode the file to webm locally, than upload with any other tool. --C.Suthorn (talk) 19:24, 14 July 2022 (UTC)Reply[reply]
Yeah, hopefully that's the case. Unfortunately uploading locally doesn't seem to be an option either; I have a webm version of the file, and Upload Wizard errors out as well. Oh well. Huntster (t @ c) 21:30, 14 July 2022 (UTC)Reply[reply]
@Huntster: A MW-server has been restarted. Uploading with Upload Wizard should work again. --C.Suthorn (talk) 06:38, 15 July 2022 (UTC)Reply[reply]
Yep, converted one of the files last night. Thanks for the update. Btw, do you know if the 4Gb upload limit imposed by Chunked also applies to this tool? Huntster (t @ c) 14:18, 15 July 2022 (UTC)Reply[reply]
@Huntster: I believe that is imposed by the backend filesystem.   — Jeff G. please ping or talk to me 16:24, 15 July 2022 (UTC)Reply[reply]
Thanks, Jeff! Huntster (t @ c) 16:28, 15 July 2022 (UTC)Reply[reply]
Actually the limit is imposed by the MW database storing file size as a 32bit unsigned integer value (=4GiB). The whole DB scheme of MW needs to be evaluated/changed (to 64bit integer for file size) to overcome this limit. --C.Suthorn (talk) 04:32, 16 July 2022 (UTC)Reply[reply]
Very interesting. Has there been any serious consideration express by WM toward updating to 64 bit? Huntster (t @ c) 06:18, 16 July 2022 (UTC)Reply[reply]
@Huntster: I don't know. Considering by Commons:Village_pump#MP4_patents_expiration_date, user:Donald Trungs remark about MP4, I doubt that there will be done something soon. However the Offroader upload tool splits video files into parts of less than 4GiB before upload. --C.Suthorn (talk) 12:57, 18 July 2022 (UTC)Reply[reply]
That's very true. The lack of Foundation support for things like this is frustrating, considering MP4 being the dominant video format and the resources required to properly convert to another format. Offroader looks very useful but I don't use a mobile device for editing or for file storage. Insert sadface. Huntster (t @ c) 17:26, 18 July 2022 (UTC)Reply[reply]
Unfortunately, getting the same error again. If restarting the MW server is what fixes this, would it be possible to create a regular restart schedule? Huntster (t @ c) 22:49, 26 August 2022 (UTC)Reply[reply]
Getting this error as well just now. Vera (talk) 15:40, 26 March 2023 (UTC)Reply[reply]

Error: An exception occurred: APIError: b'toomanyvalues: Too many values supplied for parameter "url"[edit]

I get this error: Error: An exception occurred: APIError: b'toomanyvalues: Too many values supplied for parameter "url". The limit is 50.\n[limit: 50;\n lowlimit: 50;\n highlimit: 500;\n help: See https://commons.wikimedia.org/w/api.php for API usage. Subscribe to the mediawiki-api-announce mailing list at <https://lists.wikimedia.org/postorius/lists/mediawiki-api-announce.lists.wikimedia.org/> for notice of API deprecations and breaking changes.]'

I'm trying to import the audio from this YouTube video. Vera (talk) 20:28, 1 January 2023 (UTC)Reply[reply]

@Vera: Evidently, this worked for you with the upload of File:De Internationale (oudste opname 1925).ogg using bigChunkedUpload 20:46, 1 January 2023.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 03:05, 27 December 2023 (UTC)Reply[reply]

TypeError: b 'NoneType' object is not iterable[edit]

Hi, I saw a new (to me) error: An exception occurred: TypeError: b"'NoneType' object is not iterable"

Context/Reproduction-steps: I was trying to upload a file from GoogleDrive, if that's relevant? It initially recognized the file-type, and let me fill in the {information} box, but then once it was in the 2nd-step on the Task screen it failed after a few seconds.

I've added a mention on the project page, with an empty "Meaning" parameter. I didn't see the error mentioned above or in the archives. Thanks. Quiddity (WMF) (talk) 22:56, 23 February 2023 (UTC)Reply[reply]

Bug 174 - Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)[edit]

Bug report: https://github.com/toolforge/video2commons/issues/174 .--RZuo (talk) 17:57, 2 December 2023 (UTC)Reply[reply]

An exception occurred: DownloadError: b"ERROR: Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)"

Videos in which it occured:

RodRabelo7 (talk) 00:34, 1 May 2023 (UTC)Reply[reply]

@RodRabelo7: try again now maybe? the code was recently updated.--RZuo (talk) 22:08, 2 June 2023 (UTC)Reply[reply]
@RodRabelo7: I managed to upload those videos for you as File:AO VIVO - Presidente Lula assina atos com o governo chinês.webm and File:Lula fala com a imprensa na saída do hotel na China.webm.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 20:57, 11 December 2023 (UTC)Reply[reply]
Got the same error too, on this video. – Illegitimate Barrister (talkcontribs), 17:19, 18 June 2023 (UTC)Reply[reply]
@Illegitimate Barrister: I got https://www.youtube.com/watch?v=MmUp_2NFEy0 uploaded to File:Soviet Army Parade March "In Defense of the Motherland" (Viktor Runov, 1950) - Марш В защиту Родины.webm for you.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 03:54, 27 December 2023 (UTC)Reply[reply]
@RodRabelo7: I got https://www.youtube.com/watch?v=ElX-cJtn2FU uploaded to File:Lula fala com a imprensa na saída do hotel na China.webm and https://www.youtube.com/watch?v=Oz5nw6Xc9jI uploaded to File:AO VIVO - Presidente Lula assina atos com o governo chinês.webm for you.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 00:47, 13 December 2023 (UTC)Reply[reply]

Subtitle error, even when subtitles are unchecked[edit]

Bug report: https://github.com/toolforge/video2commons/issues/174

Getting this error message even though subtitles are unchecked: "An exception occurred: DownloadError: b"ERROR: Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)" – Illegitimate Barrister (talkcontribs), 11:05, 5 August 2023 (UTC)Reply[reply]

I get this error repeatedly. Yann (talk) 19:38, 29 November 2023 (UTC)Reply[reply]

YouTube videos that have a livestream chat attached cannot be uploaded[edit]

An exception occurred: DownloadError: b"ERROR: Unable to download video subtitles for 'live_chat': Expecting value: line 1 column 1 (char 0)"

Even when subtitles are turned off in upload settings, the error still happens. – Illegitimate Barrister (talkcontribs), 06:50, 14 October 2023 (UTC)Reply[reply]

Discussion[edit]

if you want to download the video onto your devices and then upload, see Commons_talk:Video2commons/Archive_1#v2c_on_Windows_for_Dummies.--RZuo (talk) 17:57, 2 December 2023 (UTC)Reply[reply]

@Yann: i tested using yt-dlp on my laptop. ytdlp can download video+audio tracks, no problem.
so now i guess the problem is v2c's setup about subtitles. i havent understood which part of the code handles subtitles and how. i'll investigate a few weeks later if the problem persists.
1 thing to note is, google search says, "JSONDecodeError: Expecting value: line 1 column 1 (char 0)".--RZuo (talk) 17:57, 2 December 2023 (UTC)Reply[reply]
i might have found a solution https://github.com/toolforge/video2commons/pull/175#issuecomment-1837231635 . i pushed a fix. RZuo (talk) 20:11, 2 December 2023 (UTC)Reply[reply]
@RodRabelo7 @Illegitimate Barrister can you plz try again now? RZuo (talk) 18:22, 11 December 2023 (UTC)Reply[reply]
@RZuo: It got uploaded, but the lowest resolution SD version got uploaded even though it was an HD video. – Illegitimate Barrister (talkcontribs), 23:46, 11 December 2023 (UTC)Reply[reply]
without links to your files it's hard to debug. RZuo (talk) 11:20, 12 December 2023 (UTC)Reply[reply]
@RZuo: One example. – Illegitimate Barrister (talkcontribs), 20:44, 20 December 2023 (UTC)Reply[reply]

Telegram group wmcloud[edit]

consider reporting potential problems of the servers to https://t.me/wmcloudirc in future. RZuo (talk) 22:18, 2 June 2023 (UTC)Reply[reply]

Error: Stuck on "Loading..."[edit]

Error: Stuck on "Loading..."Illegitimate Barrister (talkcontribs), 21:02, 5 June 2023 (UTC)Reply[reply]

Care to elaborate? Hard to debug without more information. Chico Venancio (talk) 16:28, 9 June 2023 (UTC)Reply[reply]
Can't upload at all. I go onto Video2Commons.toolforge and all I see is the spinning icon and "Loading..."Illegitimate Barrister (talkcontribs), 16:31, 9 June 2023 (UTC)Reply[reply]
Does the browser console show any errors? I certainly cannot reproduce that. Chico Venancio (talk) 16:32, 9 June 2023 (UTC)Reply[reply]
Clearing cookies might help as well, since it will force you to re-authenticate with commons. Chico Venancio (talk) 16:37, 9 June 2023 (UTC)Reply[reply]
Message: Content Security Policy: The page’s settings observed the loading of a resource at wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=wU1GQKrEoU9e-SQIAAL0 (“default-src”). A CSP report is being sent.Illegitimate Barrister (talkcontribs), 16:55, 9 June 2023 (UTC)Reply[reply]
CSP is set to [Report Only], so it should work. Are you behind any network proxies, by any chance? Proxies may not allow websocket connections to work. Chico Venancio (talk) 17:06, 9 June 2023 (UTC)Reply[reply]
I don't think I'm using any proxies. I also get the message: Cookie “v2c-session” does not have a proper “SameSite” attribute value. Soon, cookies without the “SameSite” attribute or with an invalid value will be treated as “Lax”. This means that the cookie will no longer be sent in third-party contexts. If your application depends on this cookie being available in such contexts, please add the “SameSite=None“ attribute to it.Illegitimate Barrister (talkcontribs), 17:08, 9 June 2023 (UTC)Reply[reply]

Weird, all of a sudden it started working for me! Hopefully it stays working, I've got a huge backlog to get done now. – Illegitimate Barrister (talkcontribs), 14:03, 18 June 2023 (UTC)Reply[reply]

I've been experiencing this issue for the past three days. File:차세대 미드필더 이승모의 첫 인터뷰!.webm successfully got through, but a different video I tried uploading a few minutes after that never made it. I haven't been able to get through the loading page since. plicit 14:20, 27 June 2023 (UTC)Reply[reply]
Stopped working again, darn. – Illegitimate Barrister (talkcontribs), 03:08, 29 June 2023 (UTC)Reply[reply]
Huh, for some reason, V2C just won't upload [1]. It gets up to "Cleaning up..." and just gets stuck there. I had no problem uploading another video just moments after trying the aforementioned link. plicit 11:25, 30 July 2023 (UTC)Reply[reply]
@Explicit: I ran into a blacklisted filename "(오피셜) FC서울, 미드필더 이승모 영입" and Google Translated it to "(Official) FC Seoul recruits midfielder Seungmo Lee" instead to form File:(Official) FC Seoul recruits midfielder Seungmo Lee.webm.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 03:33, 27 December 2023 (UTC)Reply[reply]
@Jeff G.: Thanks! I wonder what the blacklisted word is. I've had no issue with similarly titled videos before. plicit 00:12, 28 December 2023 (UTC)Reply[reply]
@Explicit: '(오피셜) FC서울, 미드필더 이승모 영입 An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'\\\'(1, <ExceptionInfo: TaskError(b\\\\\\\'pywikibot.Error: APIError: titleblacklist-forbidden-edit: The title "File:(\\\\\\\\xec\\\\\\\\x98\\\\\\\\xa4\\\\\\\\xed\\\\\\\\x94\\\\\\\\xbc\\\\\\\\xec\\\\\\\\x85\\\\\\\\x9c) FC\\\\\\\\xec\\\\\\\\x84\\\\\\\\x9c\\\\\\\\xec\\\\\\\\x9a\\\\\\\\xb8, \\\\\\\\xeb\\\\\\\\xaf\\\\\\\\xb8\\\\\\\\xeb\\\\\\\\x93\\\\\\\\x9c\\\\\\\\xed\\\\\\\\x95\\\\\\\\x84\\\\\\\\xeb\\\\\\\\x8d\\\\\\\\x94 \\\\\\\\xec\\\\\\\\x9d\\\\\\\\xb4\\\\\\\\xec\\\\\\\\x8a\\\\\\\\xb9\\\\\\\\xeb\\\\\\\\xaa\\\\\\\\xa8 \\\\\\\\xec\\\\\\\\x98\\\\\\\\x81\\\\\\\\xec\\\\\\\\x9e\\\\\\\\x85.webm" has been banned from creation. It matches the following disallowed titles list entry: " .*\\\\\\\\xec\\\\\\\\x98\\\\\\\\xa4\\\\\\\\xed\\\\\\\\x94\\\\\\\\xbc.*"' per the error on screen. Evidently, those are the two characters "오피" which Google Translate to "office".   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 00:19, 28 December 2023 (UTC)Reply[reply]
The entire word is "오피셜", which is just Konglish for "official". plicit 03:40, 28 December 2023 (UTC)Reply[reply]
Stopped for me, too. Logging out and deleting a 0 byte cookie did not help. On a positive note, we now have transcodes for all four of my video uploads in the past three hours.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 22:31, 11 December 2023 (UTC)Reply[reply]
My Chrome Console said the following:
Extended content

Navigated to https://video2commons.toolforge.org/
jquery.min.js:4 XHR finished loading: GET "https://video2commons.toolforge.org/api/csrf".
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
/favicon.ico:1
        
        
       GET https://video2commons.toolforge.org/favicon.ico 500 (Internal Server Error)
index.js:83 [Report Only] Refused to connect to 'wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=vo70RCXQr37VKmoYAAAT' because it violates the following Content Security Policy directive: "default-src 'self' 'unsafe-eval' 'unsafe-inline' blob: data: filesystem: mediastream: *.toolforge.org wikibooks.org *.wikibooks.org wikidata.org *.wikidata.org wikimedia.org *.wikimedia.org wikinews.org *.wikinews.org wikipedia.org *.wikipedia.org wikiquote.org *.wikiquote.org wikisource.org *.wikisource.org wikiversity.org *.wikiversity.org wikivoyage.org *.wikivoyage.org wiktionary.org *.wiktionary.org *.wmcloud.org *.wmflabs.org wikimediafoundation.org mediawiki.org *.mediawiki.org wss://video2commons.toolforge.org". Note that 'connect-src' was not explicitly set, so 'default-src' is used as a fallback.

r.doOpen @ index.js:83
r.open @ index.js:83
r.probe @ index.js:83
r.onOpen @ index.js:83
r.onHandshake @ index.js:83
r.onPacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
n @ index.js:83
e.decodePayload @ index.js:83
r.onData @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
i.onData @ index.js:83
i.onLoad @ index.js:83
hasXDR.e.onreadystatechange @ index.js:83
XMLHttpRequest.send (async)
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
index.js:83 XHR finished loading: GET "https://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=polling&t=OnR3G51".
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
jquery.min.js:4 XHR finished loading: GET "https://video2commons.toolforge.org/api/iosession".
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
(anonymous) @ video2commons.min.js:1
r.emit @ index.js:83
r.emit @ index.js:83
r.onconnect @ index.js:83
r.onpacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.ondecoded @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
a.add @ index.js:83
r.ondata @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
n @ index.js:83
e.decodePayload @ index.js:83
r.onData @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
i.onData @ index.js:83
i.onLoad @ index.js:83
hasXDR.e.onreadystatechange @ index.js:83
XMLHttpRequest.send (async)
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
index.js:83 XHR finished loading: GET "https://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=polling&t=OnR3G84&sid=vo70RCXQr37VKmoYAAAT".
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.onData @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
i.onData @ index.js:83
i.onLoad @ index.js:83
hasXDR.e.onreadystatechange @ index.js:83
XMLHttpRequest.send (async)
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
index.js:83 XHR finished loading: POST "https://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=polling&t=OnR3GEb&sid=vo70RCXQr37VKmoYAAAT".
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doWrite @ index.js:83
(anonymous) @ index.js:83
(anonymous) @ index.js:83
o @ index.js:83
(anonymous) @ index.js:83
(anonymous) @ index.js:83
e.encodePacket @ index.js:83
i @ index.js:83
i @ index.js:83
c @ index.js:83
e.encodePayload @ index.js:83
r.write @ index.js:83
r.send @ index.js:83
r.flush @ index.js:83
r.sendPacket @ index.js:83
r.write.r.send @ index.js:83
(anonymous) @ index.js:83
r.encode @ index.js:83
r.packet @ index.js:83
r.packet @ index.js:83
r.emit @ index.js:83
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
(anonymous) @ video2commons.min.js:1
r.emit @ index.js:83
r.emit @ index.js:83
r.onconnect @ index.js:83
r.onpacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.ondecoded @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
a.add @ index.js:83
r.ondata @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
r.onPacket @ index.js:83
n @ index.js:83
e.decodePayload @ index.js:83
r.onData @ index.js:83
(anonymous) @ index.js:83
r.emit @ index.js:83
i.onData @ index.js:83
i.onLoad @ index.js:83
hasXDR.e.onreadystatechange @ index.js:83
XMLHttpRequest.send (async)
i.create @ index.js:83
i @ index.js:83
o.request @ index.js:83
o.doPoll @ index.js:83
r.poll @ index.js:83
r.doOpen @ index.js:83
r.open @ index.js:83
r.open @ index.js:83
r @ index.js:83
r @ index.js:83
r.open.r.connect @ index.js:83
r @ index.js:83
r @ index.js:83
r @ index.js:83
checkStatusSocket @ video2commons.min.js:1
checkStatus @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
z @ jquery.min.js:4
(anonymous) @ jquery.min.js:4
load (async)
send @ jquery.min.js:4
ajax @ jquery.min.js:4
n.<computed> @ jquery.min.js:4
loadCsrf @ video2commons.min.js:1
init @ video2commons.min.js:1
(anonymous) @ video2commons.min.js:1
i @ jquery.min.js:2
fireWith @ jquery.min.js:2
ready @ jquery.min.js:2
J @ jquery.min.js:2
video2commons.toolforge.org/:1 Uncaught (in promise) Error: A listener indicated an asynchronous response by returning true, but the message channel closed before a response was received

  — 🇺🇦Jeff G. please ping or talk to me🇺🇦 22:36, 11 December 2023 (UTC)Reply[reply]

Task is Pending[edit]

It looks like the tool is broken, as my uploads can't get past "task is pending". Elisfkc (talk) 15:36, 7 June 2023 (UTC)Reply[reply]

Same. Says "Loading..." forever for me. – Illegitimate Barrister (talkcontribs), 20:06, 8 June 2023 (UTC)Reply[reply]
Hard to debug without more information. When it happened? With what file? Was it from a URL or from local upload? Since we have ongoing uploads daily I'd say the tool is not (too) broken. Chico Venancio (talk) 16:31, 9 June 2023 (UTC)Reply[reply]
I get the error message: index.js:83 [Report Only] Refused to connect to 'wss://video2commons-socketio.toolforge.org/socket.io/?EIO=3&transport=websocket&sid=bUNGulxKYfDkwhLOAAMf' because it violates the following Content Security Policy directive: "default-src 'self' 'unsafe-eval' 'unsafe-inline' blob: data: filesystem: mediastream: *.toolforge.org wikibooks.org *.wikibooks.org wikidata.org *.wikidata.org wikimedia.org *.wikimedia.org wikinews.org *.wikinews.org wikipedia.org *.wikipedia.org wikiquote.org *.wikiquote.org wikisource.org *.wikisource.org wikiversity.org *.wikiversity.org wikivoyage.org *.wikivoyage.org wiktionary.org *.wiktionary.org *.wmcloud.org *.wmflabs.org wikimediafoundation.org mediawiki.org *.mediawiki.org wss://video2commons.toolforge.org". Note that 'connect-src' was not explicitly set, so 'default-src' is used as a fallback.Illegitimate Barrister (talkcontribs), 17:21, 9 June 2023 (UTC)Reply[reply]
That issue seems to be fixed, but now I am getting "An exception occurred: AttributeError: b"module 'pywikibot.data.api' has no attribute 'APIError'"". Elisfkc (talk) 16:40, 13 June 2023 (UTC)Reply[reply]
It indicates there was an API error with the upload (from mediawiki). I just fixed an issue so the error message will be more specific, like pywikibot.exceptions.UploadError: exists-normalized: File exists with different extension as or pywikibot.exceptions.UploadError: was-deleted. Chico Venancio (talk) 20:22, 13 June 2023 (UTC)Reply[reply]
Ok, I'm now getting "An exception occurred: AttributeError: b"module 'pywikibot' has no attribute 'Error'"". I am trying to upload a video from YouTube at the moment, specifically this one. I am also trying to upload a couple of videos from Facebook, such as this one. Elisfkc (talk) 16:38, 14 June 2023 (UTC)Reply[reply]
A problem with deploying changes resurrected that one. Should be fixed. Chico Venancio (talk) 22:29, 14 June 2023 (UTC)Reply[reply]
Thanks, it works now! It does seem to not be uploading the captions that came with the YouTube video. Any way that can be fixed too? Elisfkc (talk) 04:13, 15 June 2023 (UTC)Reply[reply]
@Elisfkc: You had File:President Biden Welcomes the Kansas City Chiefs to the White House.webm deleted?   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 20:29, 11 December 2023 (UTC)Reply[reply]
File is at File:President Biden Welcomes the 2022 Kansas City Chiefs to the White House.webm Elisfkc (talk) 03:01, 15 December 2023 (UTC)Reply[reply]

Weird, all of a sudden it started working for me too! Hopefully it stays working, I've got a huge backlog to get done now. – Illegitimate Barrister (talkcontribs), 14:03, 18 June 2023 (UTC)Reply[reply]

I've had the same error for a couple of days, but it worked smooth in June. Weird! TaronjaSatsuma (talk) 18:04, 5 July 2023 (UTC)Reply[reply]
@Elisfkc, Illegitimate Barrister, and TaronjaSatsuma: it's moving now again. RZuo (talk) 14:38, 7 July 2023 (UTC)Reply[reply]
@Jeff G. I think it may have been a case of me trying to get the captions or something. I'll look later. Elisfkc (talk) 20:05, 14 December 2023 (UTC)Reply[reply]

I'm having that "Your task is pending..." issue right now, trying to upload a quite short and small (40 MB) video. Uploading the video itself seems to work, then I can add the description, but it's getting stuck at "Your task is pending..." Gestumblindi (talk) 21:42, 20 July 2023 (UTC)Reply[reply]

I see the same. Today and for last several days. Sneeuwschaap (talk) 11:53, 24 July 2023 (UTC)Reply[reply]
To my surprise, video2commons actually finished my pending task now, and uploaded the file (File:Hsb brocken pfingsten 2023.webm) - more than a week later! Gestumblindi (talk) 19:34, 28 July 2023 (UTC)Reply[reply]

"Something went terribly wrong"[edit]

Got another error:

Something went terribly wrong, and we failed to find the cause automatically. Please file an issue in GitHub.

Please file an issue in GitHub: Traceback (most recent call last): File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1519, in full_dispatch_request return self.finalize_request(rv) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1540, in finalize_request response = self.process_response(response) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1888, in process_response self.session_interface.save_session(self, ctx.session, response) File "/data/project/video2commons/www/python/src/../../../video2commons/frontend/redisession.py", line 89, in save_session self.redis.delete(self.prefix + session.sid) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 1567, in delete return self.execute_command('DEL', *names) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 901, in execute_command return self.parse_response(conn, command_name, **options) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 915, in parse_response response = connection.read_response() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/connection.py", line 756, in read_response raise response redis.exceptions.ResponseError: MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.

19:37, 30 June 2023 (UTC) – Illegitimate Barrister (talkcontribs), 19:37, 30 June 2023 (UTC)Reply[reply]

Broken[edit]

Hi fellows! A friend is reporting that for at least 2 days the v2c in browser states "Your task is pending...". Could someone check this? Thanks! Ixocactus (talk) 21:02, 24 July 2023 (UTC)Reply[reply]

I and others have noticed this as well, see above. It seems that this important tool is in a poor state and poorly mantained, as it seems to be broken more often than not... Gestumblindi (talk) 18:15, 27 July 2023 (UTC)Reply[reply]
Ops. Thanks Gestumblindi, sorry for duplication. Now the tool is back. But I agree that this need more technical support. Cheers. Ixocactus (talk) 05:28, 28 July 2023 (UTC)Reply[reply]
Was broken for me earlier but back again, hopefully it stays working. – Illegitimate Barrister (talkcontribs), 11:06, 5 August 2023 (UTC)Reply[reply]
For me, it has once against been stuck on "Loading..." for a week now. I wonder why the tool works for some and not for others? Anyway, I'm curious about something to someone who has access to a functioning V2C. Would anyone be able to provide a direct link to the "Add task" function? I wonder if this could work as a loophole to get me past the loading page and somehow allow me to upload videos anyway. plicit 00:18, 6 August 2023 (UTC)Reply[reply]
Same above I got. It broke itself and failed to load after uploading a video. - The Harvett Vault | he/him | user | talk - 07:26, 12 August 2023 (UTC)Reply[reply]

An exception occurred[edit]

DownloadError: b'ERROR: \r[download] Got error: HTTP Error 403: Forbidden. Giving up after 10 retries' Kelly The Angel (talk) 09:15, 16 August 2023 (UTC)Reply[reply]

i dont understand, why File:A walk with the Tigress.webm could be imported from youtube today. mine from youtube gets this error for a few days now. RZuo (talk) 20:23, 18 August 2023 (UTC)Reply[reply]
probably an error from ytdlp, similar to https://github.com/ytdl-org/youtube-dl/issues/3721 . RZuo (talk) 20:26, 18 August 2023 (UTC)Reply[reply]
On uploading: this video with this URL, I got the error:
An exception occurred: DownloadError: b'ERROR: \r[download] Got error: HTTP Error 403: Forbidden. Giving up after 10 retries'
Noting, this is the same as above. JimKillock (talk) 12:50, 19 August 2023 (UTC)Reply[reply]
YTDL is working for me for the videos failing here, so using that is a possible workaround, if far less convenient. Is there any way to check how up to date the YTDL version is that Video2commons is using? JimKillock (talk) 08:43, 20 August 2023 (UTC)Reply[reply]
it was recently switched to ytdlp, so it's not ytdl anymore.
i'm having the same problem with https://www.youtube.com/watch?v=-y8G7ID9aM8 . i dont understand why some other videos from youtube could be uploaded in the mean time. RZuo (talk) 07:43, 26 August 2023 (UTC)Reply[reply]
Do we know which version of YTDLP it is using? If we can compare with CMD line results and verify it is the same we can at least report the problem to YTDLP. Or, if YTDLP is working, we can ask for it to be updated here? JimKillock (talk) 12:19, 26 August 2023 (UTC)Reply[reply]
@RZuo: I managed to get File:Barmont Maple in Huntsville prepares for maple syrup production.webm uploaded for you.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 19:58, 11 December 2023 (UTC)Reply[reply]
@JimKillock: It appears that you already got this video uploaded as File:Michāēl coquus est - Mike is a cook - 60 Latin mini-stories -1.webm via https://tubulus.openlatin.org/videos/watch/cRGX31ijTWChUzn44uZeph .   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 03:48, 27 December 2023 (UTC)Reply[reply]

Same problem, tried 5 different videos. – Illegitimate Barrister (talkcontribs), 09:33, 6 September 2023 (UTC)Reply[reply]

Video2commons is broken more often than not, I think, and apparently, there's nobody available for the thorough fixing / revision this tool would need... Gestumblindi (talk) 17:57, 6 September 2023 (UTC)Reply[reply]

For some reason this bug only applies to YouTube. This tool works perfectly with Archive.org, Aparat and Odnoklassniki. Kelly The Angel (talk) 04:47, 8 September 2023 (UTC)Reply[reply]
It shows this error Download failed. creating YoutubeDL instance without local cache. However, youtube-dl currently doesn't seem to work anymore. Yt-dlp at the latest version still works fine and seems to be better anyway by now so maybe it should be swapped for yt-dlp?
Until that is done, you can download videos with yt-dlp using commands of uploads in this new cat: Category:Videos downloaded with yt-dlp with command included. Prototyperspective (talk) 16:57, 9 September 2023 (UTC)Reply[reply]
afaicu, v2c has been using ytdlp since april 2023 https://github.com/toolforge/video2commons/pull/162 . RZuo (talk) 19:43, 9 September 2023 (UTC)Reply[reply]
Thank you - if we know what version of YTDLP is used by v2c then we can check if it is a bug at YTDLP, tho, and ask someone to simply upgrade YTDLP here. YTDLP is in a constant cat and mouse game with YT shifting its formats, one would expect. Is anyone able to find this out? JimKillock (talk) 10:33, 10 September 2023 (UTC)Reply[reply]
Just a note: if yt-dlp is used, then why did the error "..creating YoutubeDL instance.."? Prototyperspective (talk) 10:45, 10 September 2023 (UTC)Reply[reply]
I expect that is just the message given by v2c and it hasn't been updated? As YTDL and YTDLP are forks of the same project they probably got swapped out behind the scenes with not too much work, and whatever messages v2c gives us at the frontend were perhaps not changed? Your code snippet linked seems to bear this out, the code references "ytdlp" (dl = yt_dlp.YoutubeDL(params)). JimKillock (talk) 10:49, 10 September 2023 (UTC)Reply[reply]

I'm still getting the same error, though it seems there have been other successful uploads recently [2]. John P. Sadowski (NIOSH) (talk) 03:54, 22 September 2023 (UTC)Reply[reply]

No recent successful uploads. This tool seems to be completely broken☹️ Kelly The Angel (talk) 13:20, 9 October 2023 (UTC)Reply[reply]
I managed to upload some videos, however despite being HD they were uploaded in 144p (again, despite being UHD/HD). – Illegitimate Barrister (talkcontribs), 23:12, 9 October 2023 (UTC)Reply[reply]
File:Inside a McDonald's restaurant in 1984.webm, for example? Transcode status on the page says "Error on 23:07, 9 October 2023"; maybe rather a Commons than a Video2commons issue in this case... Gestumblindi (talk) 09:50, 10 October 2023 (UTC)Reply[reply]
@Illegitimate Barrister: I managed to add resetting the transcodes for two formats on that file to the job queue. I also managed to upload File:Inside a McDonald's restaurant in 1984 (larger).webm to replace it (this tool won't let me overwrite).   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 19:50, 11 December 2023 (UTC)Reply[reply]

Error: Unable to download webpage[edit]

I wanted to upload a freely-licensed video (https://newsmediab.tasnimnews.com/Tasnim/Uploaded/Video/1402/03/02/1402030214310229727644641.mp4), but I got the following error:

Error: An exception occurred: DownloadError: b"ERROR: [generic] None: Unable to download webpage: <urlopen error [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1123)> (caused by URLError(SSLCertVerificationError(1, '[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: unable to get local issuer certificate (_ssl.c:1123)')))"

Is there anything I can do? HeminKurdistan (talk) 15:04, 28 September 2023 (UTC)Reply[reply]

Stalled[edit]

Hi, I imported 3 small videos yesterday (around 20s each), and I still get "Your task is pending". Any idea? Yann (talk) 12:45, 4 October 2023 (UTC)Reply[reply]

I managed to upload some videos, however despite being HD they were uploaded in 144p (despite being UHD/HD). – Illegitimate Barrister (talkcontribs), 23:12, 9 October 2023 (UTC)Reply[reply]
Same issues of Illegitimate Barrister from me. --A1Cafel (talk) 09:26, 15 October 2023 (UTC)Reply[reply]

Stuck[edit]

Hello! I've been trying to upload some rather large videos for the past 2 days. They're 1.5gb ~20 min long. Well, it's just 1 video but I've tried uploading in all 3 different formats, trying to make it work. Nothing works. The tasks have been pending since forever and no progress is made no matter how much I wait. What could be going on? Should I maybe just wait even more? (I've tried waiting for longer than 24 hours.) Any help would be appreciated. - Klein Muçi (talk) 11:23, 5 October 2023 (UTC)Reply[reply]

I managed to upload some videos, however despite being HD they were uploaded in 144p (despite being UHD/HD). – Illegitimate Barrister (talkcontribs), 23:12, 9 October 2023 (UTC)Reply[reply]

Bug 173 - Youtube videos uploaded in bad resolution (often 144p)[edit]

Bug Report: https://github.com/toolforge/video2commons/issues/173

I uploaded some videos, however despite being HD they were uploaded in 144p (despite being UHD/HD). – Illegitimate Barrister (talkcontribs), 23:13, 9 October 2023 (UTC)Reply[reply]

Same issues from me. --A1Cafel (talk) 09:25, 15 October 2023 (UTC)Reply[reply]
Phew, at least it's not just me. plicit 03:58, 18 October 2023 (UTC)Reply[reply]
Same problem with File:Gone with the Wind and the Lies America Tells- Sarah Churchwell in conversation.webm Kelly The Angel (talk) 13:54, 27 October 2023 (UTC)Reply[reply]
It has been fixed, but issues seem to be occurred again. --A1Cafel (talk) 15:57, 8 November 2023 (UTC)Reply[reply]
Hi, I got this issue too with 2 videos: File:Popeye the Sailor - Aladdin and His Wonderful Lamp (1939) (Remastered HD).webm and File:POPEYE THE SAILOR MAN- Aladdin and His Wonderful Lamp (1939) (Remastered) (HD 1080p) - Margie Hines.webm. Yann (talk) 15:45, 25 November 2023 (UTC)Reply[reply]
And this is not a one-time glitch, but a serious lasting issue. It happened again with the same video. Yann (talk) 18:04, 25 November 2023 (UTC)Reply[reply]
Another example today. – Illegitimate Barrister (talkcontribs), 10:43, 30 November 2023 (UTC)Reply[reply]
This is a recurrent issue, so I created Category:Videos with bug 173. Yann (talk) 12:30, 30 November 2023 (UTC)Reply[reply]
i found the problem and wrote on github.
basically, youtube now has various Youtube Format IDs. our old default "vp9" now only refers to 144p.
someone needs to code up the solution. i dont have time for now.--RZuo (talk) 14:58, 30 November 2023 (UTC)Reply[reply]
i gave a basic fix, pending commit. RZuo (talk) 15:23, 30 November 2023 (UTC)Reply[reply]
Some videos can be uploaded, and the smaller the more chances they get through. Surprisingly, some long HR videos got uploaded, i.e. File:Beat the Devil (H. Bogart - G. Lollobrigida, 1953) HD.webm: 1 h 29 min 20 s, 1,280 × 720 pixels, 1.34 Mbps overall, file size: 855.16 MB. Yann (talk) 21:56, 1 December 2023 (UTC)Reply[reply]
@Yann: Could that be because it came from dailymotion.com?   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 03:57, 2 December 2023 (UTC)Reply[reply]
@Jeff G.: I also got one from YT: File:The Chase (1946) by Arthur Ripley.webm. Yann (talk) 10:51, 2 December 2023 (UTC)Reply[reply]
Looks completely random AFAICT.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 11:14, 2 December 2023 (UTC)Reply[reply]
@Yann err... the file has an intro by a modern guy, but no youtube cc licence or pd declaration. i think you need to cut it. RZuo (talk) 14:02, 2 December 2023 (UTC)Reply[reply]
and for why it could be downloaded in high resolution. it doesnt have a vcodec of "vp9", so v2c chose the best video track possible (ID 137), i guess.
Extended content
[youtube] GSun8gB92es: Downloading webpage
[youtube] GSun8gB92es: Downloading ios player API JSON
[youtube] GSun8gB92es: Downloading android player API JSON
[youtube] GSun8gB92es: Downloading m3u8 information
[info] Available formats for GSun8gB92es:
ID EXT RESOLUTION FPS CH | FILESIZE TBR PROTO | VCODEC VBR ACODEC ABR ASR MORE INFO
---------------------------------------------------------------------------------------------------------------------
sb2 mhtml 48x27 0 | mhtml | images storyboard
sb1 mhtml 80x45 0 | mhtml | images storyboard
sb0 mhtml 160x90 0 | mhtml | images storyboard
233 mp4 audio only | m3u8 | audio only unknown [en] Default
234 mp4 audio only | m3u8 | audio only unknown [en] Default
139 m4a audio only 2 | 33.19MiB 49k https | audio only mp4a.40.5 49k 22k [en] low, m4a_dash
140 m4a audio only 2 | 88.08MiB 129k https | audio only mp4a.40.2 129k 44k [en] medium, m4a_dash
251 webm audio only 2 | 74.57MiB 110k https | audio only opus 110k 48k [en] medium, webm_dash
17 3gp 176x144 6 1 | 52.34MiB 77k https | mp4v.20.3 mp4a.40.2 22k [en] 144p
269 mp4 256x144 26 | ~140.35MiB 201k m3u8 | avc1.4D400C 201k video only
160 mp4 256x144 26 | 43.23MiB 64k https | avc1.4D400C 64k video only 144p, mp4_dash
230 mp4 640x360 26 | ~555.27MiB 797k m3u8 | avc1.4D401E 797k video only
134 mp4 640x360 26 | 167.47MiB 246k https | avc1.4D401E 246k video only 360p, mp4_dash
18 mp4 640x360 26 2 | 260.96MiB 375k https | avc1.42001E mp4a.40.2 44k [en] 360p
605 mp4 640x360 26 | ~450.23MiB 646k m3u8 | vp09.00.21.08 646k video only
22 mp4 1280x720 26 2 | 644.39MiB 925k https | avc1.64001F mp4a.40.2 44k [en] 720p
232 mp4 1280x720 26 | ~ 1.76GiB 2591k m3u8 | avc1.64001F 2591k video only
136 mp4 1280x720 26 | 541.82MiB 796k https | avc1.64001F 796k video only 720p, mp4_dash
270 mp4 1920x1080 26 | ~ 3.40GiB 5003k m3u8 | avc1.640028 5003k video only
137 mp4 1920x1080 26 | 1.04GiB 1561k https | avc1.640028 1561k video only 1080p, mp4_dash

RZuo (talk) 15:11, 2 December 2023 (UTC)Reply[reply]

  1. File:Gone with the Wind and the Lies America Tells- Sarah Churchwell in conversation.webm
  2. File:POPEYE THE SAILOR MAN- Aladdin and His Wonderful Lamp (1939) (Remastered) (HD 1080p) - Margie Hines.webm
  3. File:Suspect Tased After Attempting To Steal a Corvette From a Valet Parking Agent.webm
for these videos yall linked above, when you go to youtube and pick the quality (resolution), you will see an option "1080p premium". i guess we can assume all such videos will have this problem. videos without this dont have this problem (for now).
the problem is https://gist.github.com/MartinEesmaa/2f4b261cb90a47e9c41ba115a011a4aa#high-video-quality-of-video-only . nobody knows if they will roll this out to all videos.
i already gave a fix that will stop selecting video tracks based on vcodec (numbers like vp09.00.51.08), waiting for it to be committed on github. RZuo (talk) 14:13, 2 December 2023 (UTC)Reply[reply]

Scope of damage[edit]

1. Affects other videos (not only 144p)

for https://www.youtube.com/watch?v=ZZOovh7cKSI , yt-dlp shows the best track with vcodec "vp9" is only 1280x720, but other tracks can go up to 2160p.

i uploaded File:Nobu Okada Interview 2019.webm on 7 July 2023. it's down from 1080p to 360p. maybe problem like this has been around for a while, but we might not have noticed if it's not so bad as 144p.--RZuo (talk) 06:50, 3 December 2023 (UTC)Reply[reply]

https://commons.wikimedia.org/w/index.php?sort=create_timestamp_desc&search=filetype%3Avideo+fileheight%3A%3C222+youtube+incategory%3A%22Uploaded+with+video2commons%22
potentially affected videos (fileheight<222). RZuo (talk) 10:14, 3 December 2023 (UTC)Reply[reply]
Right. The oldest I could find with this bug is File:Helicopter Footage Shows High-Speed Chase of Florida Man Wanted in Doctor's Stabbing.webm, uploaded on October 10th.--Yann (talk) 12:00, 3 December 2023 (UTC)Reply[reply]
sadly, no. 😂
File:Rosie the Therapy Dog.webm
File:Pet therapy teams make a difference to Lakeview Hospice patients.webm
File:Nobu Okada Interview 2019.webm 7 July 2023
(╯°□°)╯︵ ┻━┻ --RZuo (talk) 12:13, 3 December 2023 (UTC)Reply[reply]
OK, I added 2 in the category, but I don't see any higher resolution for File:Pet therapy teams make a difference to Lakeview Hospice patients.webm. Yann (talk) 12:24, 3 December 2023 (UTC)Reply[reply]
youtube has 480p. here 360p. RZuo (talk) 12:33, 3 December 2023 (UTC)Reply[reply]
Ah yes, right. I reuploaded this video, and it is now OK. Yann (talk) 13:12, 3 December 2023 (UTC)Reply[reply]
Idem for File:Rosie the Therapy Dog.webm. Yann (talk) 13:27, 3 December 2023 (UTC)Reply[reply]
thx a lot! you doing this merging page trick is much easier than if i do download and overwrite. RZuo (talk) 13:40, 3 December 2023 (UTC)Reply[reply]
File:Nobu Okada Interview 2019.webm OK now. V2C works fine here, so the issue for these videos was a different one. Yann (talk) 14:15, 3 December 2023 (UTC)Reply[reply]
it's the same problem. i wrote on github.
basically, the problem is, if the track that has vcodec=vp9 is inferior, v2c still picks it, because it's designed to prioritise in this order: codec > extension > resolution.
i think this certainly is not correct. we should prioritise resolution (quality), then codec and extension. RZuo (talk) 14:53, 3 December 2023 (UTC)Reply[reply]
and v2c uploads them in highest resolution now, because all the tracks dont have vcodec=vp9 anymore, so it defaults to picking the best track as set by yt-dlp's parameter "bestvideo". RZuo (talk) 15:24, 3 December 2023 (UTC)Reply[reply]
@Yann How did you do that? The merging trick, i mean. MilkyBoba (talk) 06:44, 11 December 2023 (UTC)Reply[reply]
The process is 1. Deleting the destination name, 2. Renaming the file, 3. Undeleting the deleted file. Yann (talk) 09:20, 11 December 2023 (UTC)Reply[reply]
@Yann So.. only an admin that is able to do that? MilkyBoba (talk) 10:33, 11 December 2023 (UTC)Reply[reply]
Yes. You request a merge on Commons:History merging and splitting/Requests‎. Yann (talk) 10:43, 11 December 2023 (UTC)Reply[reply]
@RZuo: I managed to upload https://www.youtube.com/watch?v=ZZOovh7cKSI to File:Cremyll Ferry, Plymouth, UK (4K, 60 FPS, 2023.04.07).webm for you.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 04:34, 27 December 2023 (UTC)Reply[reply]

2. Problem intensified probably around Aug 2023

this problem might have become more common due to YouTube rolling out "‘enhanced’ 1080p for Premium subscribers" to desktop in aug 2023.[1]--RZuo (talk) 12:13, 3 December 2023 (UTC)Reply[reply]

Summary[edit]

Cause

A Youtube video typically has various video and audio tracks. For each track, there is a string called "VCODEC" or "VBR ACODEC".

The current way v2c selects which tracks to upload is:

        'bestvideo[vcodec={{vcodec}}][filesize<{max}]+'
        'bestaudio[acodec={{acodec}}]/'
        'bestvideo[ext={{vext}}][filesize<{max}]+'
        'bestaudio[ext={{aext}}]/'
        'bestvideo+bestaudio/best'

Assuming you choose the default "webm (VP9/Opus)". This means, the code will first select the best track with vcodec=vp9; only if no track has vcodec=vp9, will it select the best tract with ext=webm; and so on. Sometimes, tracks with vcoded=vp9 are not the best resolution, then v2c ends up uploading these worse tracks. (Sometimes, no track has vcodec=vp9, then v2c selects tracks based on the next criteria and uploads good tracks.)

Affected videos

This bug has affected youtube videos uploaded since Jul 2023 (earliest we have found so far). Many videos were uploaded in 144p, but the bug has also let videos be uploaded in less optimal resolutions but not 144p. See #Scope of damage for more details.

What you should do

I have pushed fixes on github, waiting for commit. If you can code, please help out on github. I am a novice in coding.

You can wait and not use v2c for now. We will notify you once this bug is fixed.

You can also use yt-dlp to check a video ( yt-dlp -F URL ). If no track, or the best track, has vcodec=vp9, you can safely use v2c.

For affected videos, append Category:Videos with bug 173 if not already done so. You can also fix it by yourself:

  1. download from youtube to your device
  2. overwrite the problematic file with the local file on your device (you might need User:Rillke/bigChunkedUpload.js).

--RZuo (talk) 08:08, 3 December 2023 (UTC)Reply[reply]

@RZuoThanks a lot for the investigation and PR. I have merged and deployed it, on my tests it does seem to fix the issue. Chico Venancio (talk) 18:27, 11 December 2023 (UTC)Reply[reply]
@Chicocvenancio thank you so much Chico for always getting v2c back to work! RZuo (talk) 18:32, 11 December 2023 (UTC)Reply[reply]
@RZuo I can't overwrite my files, and i got "This file is bigger than the server is configured to allow." error; MilkyBoba (talk) 03:38, 2 January 2024 (UTC)Reply[reply]
@MilkyBoba how big is your file? Commons:Maximum file size is 4 GiB (4,294,967,296 bytes). RZuo (talk) 06:45, 2 January 2024 (UTC)Reply[reply]

Stuck in loading[edit]

It's been a few days that Video2commons gets stuck indefinitely in loading after I log in. Any such experience? HeminKurdistan (talk) 18:09, 26 October 2023 (UTC)Reply[reply]

Audio cut off[edit]

I just uploaded this file using Video2commons:

File:ARRL 2023 CW Sweepstakes action movie.agr.webm

The video is fine but the audio cuts off after a few seconds. Is there any thing I needed to do differently? The audio is the whole point of the file.--agr (talk) 17:17, 23 November 2023 (UTC)Reply[reply]

@ArnoldReinhold: there is sound throughout the video for me. can you check again? maybe it was because you just uploaded the video and commons servers were still transcoding it.--RZuo (talk) 17:57, 2 December 2023 (UTC)Reply[reply]
It is working properly for me now. It didn’t occur to me that proceeding wasn’t finished. Thank you for your help. Easiest fix ever. —agr (talk) 13:00, 3 December 2023 (UTC)Reply[reply]

MaybeEncodingError[edit]

Bug report: https://github.com/toolforge/video2commons/issues/176

Hi, I got this error while uploading [3]. This is a big file, but if the error is due to the size (it doesn't seem so from the message), there should be a warning before, instead of processing the file for 3 days and then failing. Yann (talk) 11:19, 5 December 2023 (UTC)Reply[reply]

An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/debadae0b49d62d0/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/debadae0b49d62d0/dl.mp4.vp9.webm.log /srv/v2c/output/debadae0b49d62d0/dl.mp4.vp9.webm\\\\\\\\nExitcode: 153\\\')>, None)"\')'

@Yann: I don't think it's the size. Got this "MaybeEncodingError" today (see below) for a rather small (32 MB, 15 seconds) video from my device. Gestumblindi (talk) 17:48, 10 December 2023 (UTC)Reply[reply]
I too got the same error. Have some 20 videos to upload but can't as it failed with the error
An exception occurred: MaybeEncodingError:
does that happen because of empty variables of the template? thanks QueerEcofeminist[they/them/their] 16:01, 14 December 2023 (UTC)Reply[reply]

Unable to download JSON metadata[edit]

Bug report: https://github.com/toolforge/video2commons/issues/177

Hi, I got an error while downloading https://www.dailymotion.com/video/x5qb7u9 Yann (talk) 20:14, 8 December 2023 (UTC)Reply[reply]

An exception occurred: DownloadError: b'ERROR: [dailymotion] x5qb7u9: Unable to download JSON metadata: HTTP Error 401: Unauthorized (caused by <HTTPError 401: Unauthorized>); please report this issue on https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using yt-dlp -U'

  • This one is probably because the video is too big. Yann (talk) 15:25, 11 December 2023 (UTC)Reply[reply]
    Seems the fallback to server side upload in case of mediawiki api errors had a bug since the port to python 3. It should be fixed. Chico Venancio (talk) 18:08, 11 December 2023 (UTC)Reply[reply]

argument must be str, not bytes[edit]

Bug report: https://github.com/toolforge/video2commons/issues/178

Hi, I got this message while uploading God's Little Acre (1958) from YT. Yann (talk) 10:38, 9 December 2023 (UTC)Reply[reply]

This has been fixed. Chico Venancio (talk) 19:02, 12 December 2023 (UTC)Reply[reply]

An exception occurred: TypeError: b'write() argument must be str, not bytes'

It happened again with the same video. Yann (talk) 19:19, 10 December 2023 (UTC)Reply[reply]

Hopeless case?[edit]

It seems that this tool is broken in so many ways and it's only a matter of a lot of luck if you manage to successfully upload a video. My most recent try today (uploading a moderately sized video of 15 seconds duration from my device) resulted in this cryptic error message:

An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'"(1, <ExceptionInfo: TaskError(\\\'/mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/555119d3bac84652/dl.unknown_video -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -f webm -ss 0 -b:a 128000 -ar 48000 -acodec libopus -pass 2 -passlogfile /srv/v2c/output/555119d3bac84652/dl.unknown_video.vp9.webm.log /srv/v2c/output/555119d3bac84652/dl.unknown_video.vp9.webm\\\\\\\\nExitcode: 137\\\')>, None)"\')'

Then I clicked on "Restart" and got "An exception occurred: OSError: b'[Errno 12] Cannot allocate memory'". It's sad that apparently no one is really maintaining that tool as it would be a great help with uploading videos to Commons (which is otherwise even more cumbersome). Gestumblindi (talk) 17:46, 10 December 2023 (UTC)Reply[reply]

Server crashed[edit]

Hi, Now I get The connection to the server has failed. Please refresh this page or file an issue in GitHub. Yann (talk) 21:42, 11 December 2023 (UTC)Reply[reply]

Large error messages were making the frontend be killed for large memory consumption. It has been fixed. Chico Venancio (talk) 19:04, 12 December 2023 (UTC)Reply[reply]
@Chicocvenancio: I am getting this now.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 00:44, 13 December 2023 (UTC)Reply[reply]
And now I am not. I restarted my five failed tasks (one of which had a huge error message), and now they are all "pending..."   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 00:58, 13 December 2023 (UTC)Reply[reply]
Well, the conversion of one file "b'Failed to determine the path of the downloaded video. Is the video too large?'". Four remain (one uploading, one running, and two downloading).   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 12:31, 13 December 2023 (UTC)Reply[reply]
This status has not changed in over eight hours (since my last post above). The files are:
  • (오피셜) FC서울, 미드필더 이승모 영입 (Uploading...)
  • Dixiana 1930 (colorised, 4k, 60FPS) (Downloading to /srv/v2c/output/4406a31893a4b14c/dl.mp4.part, 3%)
  • God's Little Acre (Mann, 1958) — High Quality 1080p (Downloading to /srv/v2c/output/b87fa8eef23eb047/dl.f137.mp4.part, 40%)
  • Georges Méliès- Le Voyage de la Famille Bourrichon (1913) (Running cmd: /mnt/nfs/labstore-secondary-project/gentoo-prefix/usr/bin/ffmpeg -y -i /srv/v2c/output/be4138031c008768/dl.mp4 -max_muxing_queue_size 4096 -threads 16 -row-mt 1 -crf 20 -qmin 1 -qmax 51 -b:v 0 -vcodec libvpx-vp9 -tile-columns 4 -auto-alt-ref 1 -lag-in-frames 25 -speed 4 -f webm -an -pass 1 -passlogfile /srv/v2c/output/be4138031c008768/dl.mp4.vp9.webm.log /dev/null)
  — 🇺🇦Jeff G. please ping or talk to me🇺🇦 20:59, 13 December 2023 (UTC)Reply[reply]
@Jeff G.: I think I already uploaded these movies. Yann (talk) 21:10, 13 December 2023 (UTC)Reply[reply]
@Yann: Ok, but that's no reason for the conversions to be stuck in those states.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 22:45, 13 December 2023 (UTC)Reply[reply]
@Jeff G.: Right. I got a lot of issues, but never an upload stuck in the middle. Actually for Dixiana and God's Little Acre, I only got lower quality copies. Yann (talk) 22:52, 13 December 2023 (UTC)Reply[reply]
Same situation, 56 hours in...   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 21:04, 15 December 2023 (UTC)Reply[reply]
@Yann: I found File:Le Voyage de la Famille Bourrichon (1913) by Georges Méliès.webm in your uploads, so I tried to abort that task; now it "is being aborted..."   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 21:18, 15 December 2023 (UTC)Reply[reply]
Same situation, 3 days in (aborting is 18+ hours in). Are any maintainers reading this?   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 16:11, 16 December 2023 (UTC)Reply[reply]
@Jeff G.: It seems I run into this. Trying to upload 2 very short videos, 16s and 19s, and it takes ages. :( Yann (talk) 20:21, 16 December 2023 (UTC)Reply[reply]
Paging @Chicocvenancio.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 20:24, 16 December 2023 (UTC)Reply[reply]
Ages indeed. I'm now at 13 days.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 06:56, 26 December 2023 (UTC)Reply[reply]
All of those tasks went away (not on the screen any more) by 03:05, 27 December 2023 (UTC). I was able to complete some, as documented in these edits. I have two uploads on task in pass 2 for Yann: https://www.youtube.com/watch?v=q8Q3bxHZZ00 as File:God's Little Acre (Mann, 1958) — High Quality 1080p.webm and https://player.pbs.org/viralplayer/3036869056/ as File:Lakeshore Classic Movies - The House on Haunted Hill (1959).webm.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 11:15, 27 December 2023 (UTC)Reply[reply]
@Yann: Both files are now uploaded, please attend to the licensing.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 15:40, 27 December 2023 (UTC)Reply[reply]
The 1080p transcodes on the former file errored out, I reset them.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 00:11, 28 December 2023 (UTC)Reply[reply]
@Yann: I managed to upload https://www.youtube.com/watch?v=clI2zhCgB3s to File:Vallée de la Séveraissette, Hautes-Alpes.webm for you. You already uploaded https://www.youtube.com/watch?v=zQASfAc5iI0 to File:Montagne de Faraut et pic de l'Aiguille, Hautes-Alpes, France.webm.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 04:50, 27 December 2023 (UTC)Reply[reply]
four.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 12:51, 18 December 2023 (UTC)Reply[reply]
Five days I have been waiting for uploads, over two days for abort.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 13:42, 19 December 2023 (UTC)Reply[reply]

WorkerLostError[edit]

Hi, I also got An exception occurred: WorkerLostError: b'Worker exited prematurely: signal 15 (SIGTERM) Job: 188.' and again An exception occurred: WorkerLostError: b'Worker exited prematurely: signal 15 (SIGTERM) Job: 18.' with https://player.pbs.org/viralplayer/3036869056/ Yann (talk) 22:04, 11 December 2023 (UTC)Reply[reply]

Allowing uploads over deleted files[edit]

Hi, Right now V2C doesn't allow uploading a file over a deleted file. This is very inconvenient. Chico Venancio: Could it be fixed? Also upload will fail if the file already exists, but after the whole process which could take hours. Ideally, V2C should detect before if the name is available, and if not, proposes to rename the video. Yann (talk) 20:42, 12 December 2023 (UTC)Reply[reply]

 Support.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 00:39, 13 December 2023 (UTC)Reply[reply]

Pending tasks[edit]

I just updated my tool to call video2commons when mp4 files are to be uploaded.

My first attempts are stuck in "pending" state, I don't know if I did something wrong or if video2commons is down. The category is currently not updated, and the video Cloud VPS encoders (04,05,06) seem not busy.

@Chico Venancio can you please check if these tasks cause any problem to v2c?

- 651c8302-45e8-4154-9ec3-ecc4385ec1c7

- f5dc71ae-82ee-4566-96c3-a141a0f01029

Cheers, vip (talk) 20:33, 16 December 2023 (UTC)Reply[reply]

@Chicocvenancio, Don-vip, Yann, and RZuo: v2c has not been used to facilitate an upload in two days.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 14:17, 17 December 2023 (UTC)Reply[reply]
@Matanya maybe you can help too? vip (talk) 15:21, 17 December 2023 (UTC)Reply[reply]
three.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 12:47, 18 December 2023 (UTC)Reply[reply]
Found an error with the healthcheck script that should make things recover within 10 minutes now. There is still an issue that I have not been able to track down with exceptions including the full bytes of the video, consuming large amounts of memory and crashing redis and/or workers. This is causing legitimate errors to propagate into other jobs. Celery is a bit of a pain to debug, so I make no promises to be able to fix this soon. Chico Venancio (talk) 20:53, 18 December 2023 (UTC)Reply[reply]
@Chicocvenancio: Thanks. Some people are getting uploads through.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 13:44, 19 December 2023 (UTC)Reply[reply]
@DarwIn: You seem to be getting uploads through, what's your secret?   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 06:53, 26 December 2023 (UTC)Reply[reply]
@Jeff G. I've no idea... But after Chico bug fix they have been generally working well, apart from some errors, mainly related to live chats on YouTube, and have been quite fast... Crossing my fingers that it stays this way 😬 Darwin Ahoy! 13:09, 26 December 2023 (UTC)Reply[reply]

I too have a pending task since more than 12 hours now: 85b5ce9b-8c63-4f73-9c2a-10fbe5543bae I have never used the tool before, so I wonder whether this is normal. --Blahma (talk) 07:28, 18 December 2023 (UTC)Reply[reply]

V2C down[edit]

Well, it was working again, but now I'm seeing a new error code.
Please file an issue in GitHub: Traceback (most recent call last): File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1519, in full_dispatch_request return self.finalize_request(rv) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1540, in finalize_request response = self.process_response(response) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1888, in process_response self.session_interface.save_session(self, ctx.session, response) File "/data/project/video2commons/www/python/src/../../../video2commons/frontend/redisession.py", line 101, in save_session self.redis.expire(self.prefix + session.sid, File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 1591, in expire return self.execute_command('EXPIRE', name, time) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 901, in execute_command return self.parse_response(conn, command_name, **options) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 915, in parse_response response = connection.read_response() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/connection.py", line 756, in read_response raise response redis.exceptions.ResponseError: MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.

plicit 14:15, 18 December 2023 (UTC)Reply[reply]

Idem for me: https://github.com/toolforge/video2commons/issues/181
Please file an issue in GitHub: Traceback (most recent call last): File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 2073, in wsgi_app response = self.full_dispatch_request() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1519, in full_dispatch_request return self.finalize_request(rv) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1540, in finalize_request response = self.process_response(response) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/flask/app.py", line 1888, in process_response self.session_interface.save_session(self, ctx.session, response) File "/data/project/video2commons/www/python/src/../../../video2commons/frontend/redisession.py", line 89, in save_session self.redis.delete(self.prefix + session.sid) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 1567, in delete return self.execute_command('DEL', *names) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 901, in execute_command return self.parse_response(conn, command_name, **options) File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/client.py", line 915, in parse_response response = connection.read_response() File "/data/project/video2commons/www/python/venv/lib/python3.9/site-packages/redis/connection.py", line 756, in read_response raise response redis.exceptions.ResponseError: MISCONF Redis is configured to save RDB snapshots, but it is currently not able to persist on disk. Commands that may modify the data set are disabled, because this instance is configured to report errors during writes if RDB snapshotting fails (stop-writes-on-bgsave-error option). Please check the Redis logs for details about the RDB error.
Yann (talk) 15:47, 18 December 2023 (UTC)Reply[reply]

V2C should integrated into MW[edit]

Hi, I created a report. Please weight in phab:T353659. Yann (talk) 16:16, 18 December 2023 (UTC)Reply[reply]

@511KeV what file did you try to upload that gave you the error https://commons.wikimedia.org/w/index.php?title=Commons:Video2commons&diff=prev&oldid=832213383 ? RZuo (talk) 17:46, 20 December 2023 (UTC)Reply[reply]

Requested format is not available[edit]

Bug report: https://github.com/toolforge/video2commons/issues/183

Hi, I got a new error while trying to upload [4]. Error: An exception occurred: DownloadError: b'ERROR: [youtube] iQj3Ztysw8A: Requested format is not available. Use --list-formats for a list of available formats' Yann (talk) 11:02, 31 December 2023 (UTC)Reply[reply]

This is probably a more general issue, as I got the same with [5] and [6]. Yann (talk) 11:18, 31 December 2023 (UTC)Reply[reply]
V2C is completely broken (again). All videos are rejected with this message. Yann (talk) 14:17, 31 December 2023 (UTC)Reply[reply]
According to phab:T236446, "YT has started to block downloads from video2commons again since around 2023-12-29 22:30." Yann (talk) 20:52, 31 December 2023 (UTC)Reply[reply]
i wonder how those youtube downloader websites avoid getting caught by youtube. they must be downloading much more than v2c.
wonder if v2c could make use of similar techniques to go around evil google. :/ RZuo (talk) 01:13, 1 January 2024 (UTC)Reply[reply]
If you know how GG blocks V2C (IP / software ID / something else...), we can certainly overcome the block. Yann (talk) 13:56, 1 January 2024 (UTC)Reply[reply]
@Yann I understand they are blocking the Toolforge IPs, if we used our own or some kind of proxy it would probably work (or YT could block these too 😐). Darwin Ahoy! 17:01, 1 January 2024 (UTC)Reply[reply]
I'm confused by the above: "V2C is completely broken (again). All videos are rejected with this message." … "YT has started to block downloads from video2commons" Is this problem specific to videos from YouTube, or a more general V2C problem? - Jmabel ! talk 03:36, 2 January 2024 (UTC)Reply[reply]
@Jmabel: Just YouTube. All the conversions to uploads in the last three days have been from other sites.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 04:22, 2 January 2024 (UTC)Reply[reply]
does anyone know how the block last time was lifted? like the ips are allowed to download again after a certain period (months?), or toolforge had new ips? RZuo (talk) 09:09, 2 January 2024 (UTC)Reply[reply]

Certificate verify failed: certificate has expired[edit]

Hi, Now I get this while uploading https://vk.com/video-136471876_456242040 Yann (talk) 14:58, 1 January 2024 (UTC) An exception occurred: DownloadError: b"ERROR: [vk] Unable to download JSON metadata: [SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1056) (caused by CertificateVerifyError('[SSL: CERTIFICATE_VERIFY_FAILED] certificate verify failed: certificate has expired (_ssl.c:1056)')); please report this issue on https://github.com/yt-dlp/yt-dlp/issues?q= , filling out the appropriate issue template. Confirm you are on the latest version using yt-dlp -U"Reply[reply]

@Chicocvenancio Ping. Darwin Ahoy! 17:02, 1 January 2024 (UTC)Reply[reply]
@Yann, DarwIn, and Chicocvenancio: The certificate for *.vk.com does not expire until Tuesday, February 20, 2024 at 5:00:00 AM according to Chrome on my laptop.   — 🇺🇦Jeff G. please ping or talk to me🇺🇦 01:44, 2 January 2024 (UTC)Reply[reply]
I'll look into it. This one might take a bit because it might need the OS to be upgraded and we don't yet have a functional way to recreate the nodes from scratch. Chico Venancio (talk) 15:42, 2 January 2024 (UTC)Reply[reply]
@Yann @Jeff G. @DarwIn: Seems the OS upgrade isn't needed to fix this. It is a cloud-vps wide issue and it should be fixed soon. Chico Venancio (talk) 16:11, 3 January 2024 (UTC)Reply[reply]
@Chicocvenancio Thank you very much for the heads up. Darwin Ahoy! 18:12, 3 January 2024 (UTC)Reply[reply]
phab:T354295 is the immediate task. Chico Venancio (talk) 14:04, 9 January 2024 (UTC)Reply[reply]

Too many open files[edit]

OSError: b'[Errno 24] Too many open files' Kelly The Angel (talk) 15:17, 6 January 2024 (UTC)Reply[reply]

Yes, I also get this error time to time. It seems the server is overloaded. It works after restarting some time later. Yann (talk) 15:23, 6 January 2024 (UTC)Reply[reply]

MaybeEncodingError: PicklingError[edit]

Bug report: https://github.com/toolforge/video2commons/issues/184

Hi, Another error now :((( while trying to upload [7]. Yann (talk) 07:57, 11 January 2024 (UTC)Reply[reply]

An exception occurred: MaybeEncodingError: b'(\'\\\'PicklingError("Can\\\\\\\'t pickle <class \\\\\\\'video2commons.exceptions.TaskError\\\\\\\'>: import of module \\\\\\\'video2commons.exceptions\\\\\\\' failed")\\\'\', \'\\\'(1, <ExceptionInfo: TaskError(b"pywikibot.Error: UploadError: exists-normalized: File exists with different extension as \\\\\\\'Z\\\\\\\\xc3\\\\\\\\xa9ro_de_conduite_(1933)_par_Jean_Vigo.jpg\\\\\\\'.")>, None)\\\'\')'