Xowa: DownloadCentral shows 2016-09 wikis instead of 2016-10 (Simple Question!)

[Ope30]

Firstly, thank you so much for publishing the 2016-10 wikis! I really appreciate that. And, the main reason I created this issue is to ask you, the dates in the Download Central say they're still from September, is that true? Or did you forgot to rename them? And, yeah, I downloaded the newest version. ^^

Also, if you want you can close this issue and I will just make a new one for finding possible bugs, you know. Or, you can leave this open. Up to you. :p

[gnosygnu]

Oops! I forgot to update the Download Central database.

You can fix this now on your side.

• Start on Download Central (home/wiki/Special:XowaDownloadCentral)
• Look at the "Available" table
• Click the "blue down arrow" all the way to the right

This will bring down the latest version of the Download Central database.

I'll do another release later today to fix it.

Thanks!

[gnosygnu]

I uploaded the latest version to https://github.com/gnosygnu/xowa/releases/v3.10.3.2

The only difference with this version is the Download Central database. You don't need this version if you clicked the Download arrow ("blue down arrow") on the "Available" table. I created v3.10.3.2 just so other users wouldn't be confused.

As always, thanks for discovering the bug!

[Ope30]

Heya! I just wanted to say, that I downloaded the German Wikipedia, and I tested it.

Categories are no longer slow! I load them instantly. The same thing goes for "Begriffserklärung", it's not bugged and it only took me an half second. Very nice work you did there!

Categories are also appearing at the very bottom. So far they're working contentedly!

I don't know, but, I feel like I'm loading articles/images quicker as I used to do. :-d

So far, there's nothing that bothers me at all, and there's actually nothing I found other than:

-The Navigation/Interaction is missing
-When you open Wikidata you're no longer seeing the "Wikidata" image
-Opening commons.wikipedia (the wiki itself, I only have it to get a bigger view of images, not every image though I think) also has no longer the "Commons Wikipedia" image. I actually wanted to re-download commons.wikipedia and Wikidata anyways, but doing that would be painful, you know. As I know there's a other way getting them other than getting them using the Import List, how? Would like to do it using IDM.

This is so far what I found. There's really nothing else. If I find something I'll post it here. By the way, sorry for asking you again. I'm assuming the dates (commons.wikipedia images, etc) are hopefully the same again this time? I know you said you'll always pick same dates, just wanted to be sure.

Regarding the English Wikipedia, I didn't download it yet. Will do it now.

[gnosygnu]

Heya! I just wanted to say, that I downloaded the German Wikipedia, and I tested it.

Categories are no longer slow! I load them instantly. The same thing goes for "Begriffserklärung", it's not bugged and it only took me an half second. Very nice work you did there!

Categories are also appearing at the very bottom. So far they're working contentedly!

I don't know, but, I feel like I'm loading articles/images quicker as I used to do. :-d

Great! Thanks for confirming everything with the new category format! I tested things on my side, but it is immensely helpful when someone else tries as well. I appreciate it!

• The Navigation/Interaction is missing

Ugh. It fell out of my build script. I'll upload a manual patch later this week to my google drive account. You'll have to download about 200 MB, but hopefully nothing else.

-When you open Wikidata you're no longer seeing the "Wikidata" image

Hmm... well, first, let's see if the following fixes it:

• Go to home/wiki/Options/Security
• Make sure "Web access" is checked
• Close XOWA
• Delete the following folder: C:\xowa\useranonymous\wiki\www.wikidata.org
• Open XOWA
• Go to any wikidata page. You'll see the logo.

Now, this is my _guess_ for what happened:

• You downloaded the latest XOWA app, and unzipped it to a new folder. For example, "C:\xowa_app_windows_64_v3.10.3.2"
• When XOWA first opens wikidata, it checks "C:\xowa_app_windows_64_v3.10.3.2\useranonymous\wiki\www.wikidata.org" to see if an image is there (as well as a lot of other CSS artifacts)
  
  
  
  • If it's there, it just uses it and leaves
  
  
  • If it's not, it tries to connect online to wikidata to bring down the files
  
  
  • If no internet connection is available, it just copies a default XOWA logo and CSS from the XOWA package
  
  

So my guess depends on:

• You're using a new folder for XOWA (since you indicate it "no longer" shows)
• "Web access" was disabled when you ran XOWA in this folder

Note that the same process happens with commons, or any other wiki that is imported through Import Online / Import Offline

-Opening commons.wikipedia (the wiki itself, I only have it to get a bigger view of images, not every image though I think) also has no longer the "Commons Wikipedia" image.

Should be the same as above. Try with C:\xowa\useranonymous\wiki\commons.wikimedia.org

I actually wanted to re-download commons.wikipedia and Wikidata anyways, but doing that would be painful, you know.

Yeah, you really don't need either if you're using wikis from "Download Central". You only need Wikidata if you're using wikis from "Import Online" / "Import Offline"

As I know there's a other way getting them other than getting them using the Import List, how? Would like to do it using IDM.

Yup, neither have been uploaded to download central. I can upload "www.wikidata.org", but I don't think you need them unless you want to see pages like this: https://www.wikidata.org/wiki/Q2

This is so far what I found. There's really nothing else. If I find something I'll post it here.

I'll keep this ticket open a few days until I upload the dewiki fix. If I close it, feel free to open another one.

By the way, sorry for asking you again. I'm assuming the dates (commons.wikipedia images, etc) are hopefully the same again this time? I know you said you'll always pick same dates, just wanted to be sure.

Yup. Same dates. I added another argument to my build script. Also, the next batch hasn't started yet (https://dumps.wikimedia.org/backup-index.html), so I couldn't make a mistake even if I tried. :)

Regarding the English Wikipedia, I didn't download it yet. Will do it now.

Cool. Hopefully that should be trouble-free too. :)

[Ope30]

Alrighty. So, I tested the English Wikipedia, and to be honest, I didn't find any bugs/issues in it (so far)!

-Navigation/Interaction works using the English Wikipedia
-Categories are pretty faster now, even in the English Wikipedia, what an improvement!
-The English Wikipedia is faster overall, especially using the Random Page function
-en.wikipedia.org/wiki/Category:All_stub_articles does work now
-Tested several categories, none of them were broken so far, also realized that they have the Table of Contents now? Pretty cool!

Pretty surprised regarding the English Wikipedia. Everything worked the way it should. Now, the only thing is the Navigation/Interaction thingy, that the German one is missing. Hope you can find a fix for that. Other than that, great. Just great.

Thanks by the way, I fixed it. ^^

[gnosygnu]

Alrighty. So, I tested the English Wikipedia, and to be honest, I didn't find any bugs/issues in it (so far)!

Great!

-Navigation/Interaction works using the English Wikipedia

Yup. Definitely part of English Wikipedia. Just forgot it for German Wikipedia.

-Categories are pretty faster now, even in the English Wikipedia, what an improvement!

Good to hear

-The English Wikipedia is faster overall, especially using the Random Page function

Honestly, surprised. Added no specific performance changes. But still good to hear!

-en.wikipedia.org/wiki/Category:All_stub_articles does work now

Cool

-Tested several categories, none of them were broken so far, also realized that they have the Table of Contents now? Pretty cool!

Yup. I added that to German Wikipedia too. Try de.wikipedia.org/wiki/Category:Mann . :)

Pretty surprised regarding the English Wikipedia. Everything worked the way it should.

Again, thanks for the confirm!

Now, the only thing is the Navigation/Interaction thingy, that the German one is missing. Hope you can find a fix for that. Other than that, great. Just great.

Yeah, will load the patch for that tomorrow or day after. Working on English sister wikis now.

Thanks by the way, I fixed it. ^^

Nice. :)

[Ope30]

Yup. Definitely part of English Wikipedia. Just forgot it for German Wikipedia.

No problemo.

Yup, neither have been uploaded to download central. I can upload "www.wikidata.org", but I don't think you need them unless you want to see pages like this: https://www.wikidata.org/wiki/Q2

Also, I just realized, that new articles added with multiple languages don't have the Wikidata link, that means I have to download the latest one to see it, and, I see, you added a new one, pretty cool actually, just wish it didn't take a day to download, you know. :p

Could you, after all, upload the one you put into the Import List? Sorry, it really takes a long time using the Import Function. Lol.

[gnosygnu]

Could you, after all, upload the one you put into the Import List? Sorry, it really takes a long time using the Import Function. Lol.

Sure, will upload to archive.org and Download Central. Uploading French Wikipedia now, so probably won't have bandwidth available till Wed / Thu.

[gnosygnu]

Okay. I uploaded the patch for German Wikipedia and the missing left sidebar. When you get a chance, try the following

• Go to Download Central (home/wiki/Special:XowaDownloadCentral)
• Look at the "Available" table and click the "blue down arrow" all the way to the right.
  
  
  
  • You should get a message like "Added 2016-10 French wiki, 2016-10 German wiki patch"
  
  
• Add "Deutsch Wikipedia - Patch (2016-10) [401.2 MB]" to the queue and run it
• Restart XOWA
• Go to "de.wikipedia.org". You'll see the missing left sidebar

This update also has the 2016-10 French Wikipedia. It also needed a separate "French Wikipedia - Patch" for the sidebar. This should be the only other wiki that needs an additional patch.

I'm working on wikidata, and that'll probably be ready by Thursday / Friday. I'll post here when done.

Let me know if there's anything else. Thanks!

[Ope30]

I can confirm that the patch worked for both FR-DE Wikipedia. Thank you! :D

Can also confirm that fr.wikipedia.org/wiki/Catégorie:Article_contenant_un_appel_à_traduction_en_anglais works! It used to be bugged for me, now it works. ^^

Regarding every wiki I downloaded (2016-10), everything works so far. I didn't find any bug yet, but if I will, of course I will keep you up-to-date, you know. This release is so surprisingly positive. For real. :-p

I'm working on wikidata, and that'll probably be ready by Thursday / Friday. I'll post here when done.

Nice. Can't wait!

Let me know if there's anything else. Thanks!

Oh yeah, ehm, well. I actually wanted to redownload commons.wikipedia. Is that okay for you, uploading that as well? I know it's not that useful, you know, I'm just doing it to be up-to-date, and to be honest, I might stay like this for a while, I mean, I don't want to redownload the 2016-11 wiki this time, I thought I'm going to redownload in march or or maybe earlier. I'm absolutely satisfied regarding this release.

[gnosygnu]

I can confirm that the patch worked for both FR-DE Wikipedia. Thank you! :D

Nope, thank you! I wouldn't have noticed the issue without your report. :)

Can also confirm that fr.wikipedia.org/wiki/Catégorie:Article_contenant_un_appel_à_traduction_en_anglais works! It used to be bugged for me, now it works. ^^

Cool. Seems like an important category for multilingual readers. ;)

Regarding every wiki I downloaded (2016-10), everything works so far. I didn't find any bug yet, but if I will, of course I will keep you up-to-date, you know. This release is so surprisingly positive. For real. :-p

Very nice to hear. Do keep me posted, but really hope I don't hear anything!

I'm working on wikidata, and that'll probably be ready by Thursday / Friday. I'll post here when done.

Nice. Can't wait!

2016-10 Wikidata is up. I tried to integrate it into Download Central, but it's going to need another XOWA release. You can still download it manually with the following steps:

• Go to https://archive.org/download/Xowa_wikidatawiki_latest
• Download all files that have "2016-10"
• Put them in "C:\xowa\wiki\www.wikidata.org"
• Select them all and unzip them with 7-zip (or any other decompresser that supports batch decompression)
• Delete the ".zip" and ".md5" files
• Run XOWA and visit www.wikidata.org/wiki/Q2

Oh yeah, ehm, well. I actually wanted to redownload commons.wikipedia. Is that okay for you, uploading that as well? I know it's not that useful, you know, I'm just doing it to be up-to-date, and to be honest, I might stay like this for a while, I mean, I don't want to redownload the 2016-11 wiki this time, I thought I'm going to redownload in march or or maybe earlier. I'm absolutely satisfied regarding this release.

I'll work on uploading that next. May need to wait until after the English sister wikis though. Will keep you posted. Thanks!

[Ope30]

Thanks for uploading Wikidata. Tested it and it seems to be working fine. ^^

I'll work on uploading that next. May need to wait until after the English sister wikis though. Will keep you posted. Thanks!

Awesome. Really can't wait! By the way, are the small wikis all on the same date? Is that even needed?

Edit: I've found a bug and a article with two missing images. de.wikipedia.org/wiki/Duisburg_Hauptbahnhof is the article.
Regarding the bug, after reloading articles (same goes for reloading categories, the bug occurred before (using the 2016-09 wikis) it forces the page to be empty, I mean, text, images, everything is gone.

[gnosygnu]

Thanks for uploading Wikidata. Tested it and it seems to be working fine. ^^

Wow, that was fast! Thanks again for the confirm.

Awesome. Really can't wait! By the way, are the small wikis all on the same date? Is that even needed?

Yup, the small wikis will be the same date. My build script now takes care of it.

Edit: I've found a bug and a article with two missing images. de.wikipedia.org/wiki/Duisburg_Hauptbahnhof is the article.

Short story: it looks like the dump excluded all files added between 2016-09-22 and 2016-10-01. I won't know if it's an XOWA problem or a Wikimedia problem until the morning. In the meantime, all the 2016-10 wikis will be missing new files added in that time window.

Long story:
I checked the page and the two files were added "recently" on 2016-09-27

• https://commons.wikimedia.org/wiki/File:Duisburg_Hauptbahnhof_-_Duisburg_Central_Station_(Bj._1931_ff.)_(1).jpg
• https://commons.wikimedia.org/wiki/File:Duisburg_Hauptbahnhof_-_Duisburg_Central_Station_(Bj._1931_ff.)_(2).jpg

I checked my dump database and it looks like they didn't make it

• SELECT * FROM image WHERE img_name = 'Duisburg_Hauptbahnhof_-_Duisburg_Central_Station_(Bj._1931_ff.)_(1).jpg';
• SELECT * FROM image WHERE img_name = 'Duisburg_Hauptbahnhof_-_Duisburg_Central_Station_(Bj._1931_ff.)_(2).jpg';

I looked at the last cutoff, and it's "20160922165454"

• SELECT * FROM image ORDER BY img_timestamp DESC LIMIT 10;

It's possible that XOWA somehow missed the last records after 2016-09-22. I'd like to think that's not the issue, but won't know until I re-download the 17 GB image file, and do other processing on it.

Regarding the bug, after reloading articles (same goes for reloading categories, the bug occurred before (using the 2016-09 wikis) it forces the page to be empty, I mean, text, images, everything is gone.

Damn. That's a bug in the HTML databases. "Reload Page" doesn't work.

I'll fix that in the next release. In the meantime, another way to reload the page is to go to the URL bar and press enter again. You would use these two keystrokes:

• Alt + D (place cursor in the URL bar) . Also, Control + L
• Enter (reloads the page in the URL bar)

[Ope30]

Short story: it looks like the dump excluded all files added between 2016-09-22 and 2016-10-01. I won't know if it's an XOWA problem or a Wikimedia problem until the morning. In the meantime, all the 2016-10 wikis will be missing new files added in that time window.

It's possible that XOWA somehow missed the last records after 2016-09-22. I'd like to think that's not the issue, but won't know until I re-download the 17 GB image file, and do other processing on it.

Oh damn. Well. I guess I have to redownload again, I mean the 2016-11 wikis probably. Would downloading few files and replacing them help in any way? I really don't want to redownload, lol, but if there's no other way I'll do it. Still I hope I don't have to redownload, hope there is a solution!

I'll fix that in the next release. In the meantime, another way to reload the page is to go to the URL bar and press enter again.

Alrighty!

[gnosygnu]

It turns out it was an issue on my side. I don't know what it was, but it looks like the final part of the image dump was not processed. Any image added after 2016-09-22 would not have been included

Oh damn. Well. I guess I have to redownload again, I mean the 2016-11 wikis probably. Would downloading few files and replacing them help in any way? I really don't want to redownload, lol, but if there's no other way I'll do it. Still I hope I don't have to redownload, hope there is a solution!

I might be able to do a patch for German Wikipedia and English Wikipedia. However, it's really easier for me to make a new 2016-11 batch than to patch an old 2016-10 one. And I can't patch the English wikis I uploaded today (Wiktionary, Wikivoyage, etc)

Let me know if you're interested in a German / English Wiki only patch. If so, I'll take a look at it middle of next week.

Thanks.

[Ope30]

I might be able to do a patch for German Wikipedia and English Wikipedia. However, it's really easier for me to make a new 2016-11 batch than to patch an old 2016-10 one. And I can't patch the English wikis I uploaded today (Wiktionary, Wikivoyage, etc)

Let me know if you're interested in a German / English Wiki only patch. If so, I'll take a look at it middle of next week.

Sounds good actually, but I think I'll redownload everything (2016-11). What about the other big/small wikis, for example the swedish/EN wiktionary one, do they have the same problem? If that's the case, I'll really just redownload everything. And like you said, it'd be easier for you to make a new one, let's better get into that direction. But what about the small wikis you uploaded today? That's the big question for me, if they have the same problem regarding the dump, then I would have to redownload them in the future as well but you just uploaded/worked on them, lol, that's the thingy. Still, if they don't, I won't redownload them in the future because that's not really needed, you know. Just wanted them to have categories, Navigation etc. Newer ones don't matter for me, they're not that big anyways. But yeah, if you also prefer redownloading everything I'll do it.

Do the 2016-11 wikis have all the fixes/added things that the previous ones had? For example, you added something for categories, which I really liked, or working categories and so on, you know, all that stuff. I would love to see that again. :c

[gnosygnu]

What about the other big/small wikis, for example the swedish/EN wiktionary one, do they have the same problem?

The English wikis (wiktionary, wikisource) have the same issue. Any wikis uploaded after yesterday won't. For example, I'm working on the German wikis now, and they will have any images between 2016-09-22 and 2016-10-01

I'll look at making another patch for German Wikipedia and English Wikipedia. Depending on how that goes, I may do the same for the English wikis. It'll probably be a few days before I can say for certain.

Do the 2016-11 wikis have all the fixes/added things that the previous ones had?

Yup. All known issues will be fixed for 2016-11 wikis and beyond.

Hope that helps. Thanks.

[Ope30]

That would be so awesome if you create a patch for all wikis ( especially sv, es, it ,nl, fr, russ), you know, because I'm assuming they're having the same problem. I will definitely download the patches/ them if needed, size doesn't matter for me. Pretty sure this takes some time. So, take your time. I'm patiently waiting. ^^

[gnosygnu]

Hey, the short answer is that only the following wikis should be affected:

• 2016-10 English Wiki
• 2016-10 German Wiki
• 2016-10 French Wiki
• 2016-10 English Wiktionary, Wikisource, Wikiquote, Wikivoyage, Wikibooks, Wikiversity, Wikinews, Species

All other new wikis should not be affected, including

• 2016-10 German Wiktionary, Wikisource, Wikiquote, Wikivoyage, Wikibooks, Wikiversity, Wikinews

With that said, those wikis which are affected should be a small fractional amount. I'm talking < .1% of images in English / German Wikipedia. If you're seeing other missing images, let me know and I'll confirm.

As for the patch, I'll try to do it, but it won't be until mid week. I'll definitely let you know.

Hope that helps. Thanks.

[gnosygnu]

Tonight's v3.10.4.1 release fixed the refresh issue.

In addition, I uploaded a patch for dewiki. In total, there were 5,500 missing images (out of 5.4 million). So .1% was not a bad estimate.

To get the patch, please try the following:

• Download the latest release from https://github.com/gnosygnu/xowa/releases
• Go to Download Central (home/wiki/Special:XowaDownloadCentral)
• Look at the "Available" table and click the "blue down arrow" all the way to the right.
• Add "Deutsch Wikipedia - Patch: Images (2016-10) [1.95 GB]" to the queue and run it
• Restart XOWA
• Go to "de.wikipedia.org/wiki/Duisburg_Hauptbahnhof". You'll see the two missing images.

I'll upload English Wikipedia and the other English wikis later this week.

Let me know if you find any other discrepancies. Thanks!

[Ope30]

Awesome. I checked it out and it seems to be working. Thank you, it was really needed. :D
By the way, I always use IDM to download and WinRar to extract, I usually backup before replacing files but I forgot to do it this time. Did I do it correctly?

So .1% was not a bad estimate.

Yeah, I know it's not that much lol. I'm just too sensitive regarding missing images. I just want it to be completed, you know.

I'll upload English Wikipedia and the other English wikis later this week.

Great!

[markusmaresch]

Concur with above comment. Great feature with the filters !!

One question on: English Wikipedia - Image Update (2016-09)
This is shown as available, yet I am quite certain, that I have 2016-10 already on my system. Looking into the details, "2016-09" goes up until file-ns.000-db.065.xowa, while I already have 066, dated Oct 22 on my system. So this looks, like it is an old update. Should I update anyway to make it go away ? and then update a newer one ? Or just ignore ? Thanks.

[gnosygnu]

Awesome. I checked it out and it seems to be working. Thank you, it was really needed. :D

@Ope30 Cool! Thanks for confirming!

By the way, I always use IDM to download and WinRar to extract, I usually backup before replacing files but I forgot to do it this time. Did I do it correctly?

Yeah, you can use other programs to download and extract. Backing up is the safe route, but hopefully there's no need to ever roll back. For the patch, there's no reason to roll back. If there's a problem, I'll just release another patch. :)

So .1% was not a bad estimate.

Yeah, I know it's not that much lol. I'm just too sensitive regarding missing images. I just want it to be completed, you know.

No worries. Just wanted to clarify that there weren't many pages affected.

Let me know if you run across anything else. Thanks!

[gnosygnu]

Concur with above comment. Great feature with the filters !!

@markusmaresch . Thanks for the encouragement! Download Central was getting very busy, so the filters were definitely needed.

One question on: English Wikipedia - Image Update (2016-09)
This is shown as available, yet I am quite certain, that I have 2016-10 already on my system. Looking into the details, "2016-09" goes up until file-ns.000-db.065.xowa, while I already have 066, dated Oct 22 on my system. So this looks, like it is an old update. Should I update anyway to make it go away ? and then update a newer one ? Or just ignore ? Thanks.

I'm guessing you download 2016-09 through a separate program (not XOWA's Download Central)? If so, then XOWA will still list it in Download Central, since it doesn't know that you downloaded it outside the program.

I'll add a way to manually remove items from the "Available" and "Imported" table. But for now, you can just ignore them. No matter what, I wouldn't update 2016-09 though; you'll need to upload 2016-10 afterwards to make sure the files are correct.

Let me know if that doesn't makes sense. Thanks!

[gnosygnu]

@Ope30 I uploaded the 2016-10 French Wikis and the English wiki patch just now. Same drill as above:

• Go to Download Central (home/wiki/Special:XowaDownloadCentral)
• Look at the "Available" table and click the "blue down arrow" all the way to the right.
• Add "English Wikipedia - Patch: Images (2016-10)" to the queue and run it
• Repeat as necessary for the 2016-10 French wikis
• Restart XOWA

FYI: the number of new images for the English Wikipedia patch is about 9,500. I'll be working on the patch for the English wikis later, but they may not come out until the weekend (or even next week).

Let me know if there's anything else. Thanks!

[Ope30]

@Ope30 I uploaded the 2016-10 French Wikis and the English wiki patch just now.

Awesome. Thanks alot. ^^ Everything seems to be working, for now. :p
I actually didn't find any missing images in the English Wikipedia, probably because it's so big, you know.

FYI: the number of new images for the English Wikipedia patch is about 9,500. I'll be working on the patch for the English wikis later, but they may not come out until the weekend (or even next week).

Alrighty! Will definitely download them!

By the way, they're now no longer missing any image other than the ones that have the hour-difference, or?

[gnosygnu]

Awesome. Thanks alot. ^^ Everything seems to be working, for now. :p
I actually didn't find any missing images in the English Wikipedia, probably because it's so big, you know.

Cool. Hopefully it stays that way. ;)

By the way, they're now no longer missing any image other than the ones that have the hour-difference, or?

Yup. No difference unless it falls in that gap between the dumps (commons versus any wiki) or there is sort of a bug (_fingers crossed_).

[Ope30]

I think I'll download the 2016-11 wikis anyways in the future. Is that okay for you?

[gnosygnu]

Well, there'll be a 2016-11 version of English Wikipedia and maybe German Wikipedia / French Wikipedia, but I'm not planning to do 2016-11 versions of the other wikis (English Wiktionary, German Wikisource, French Wikivoyage, etc.). I'd like to update these on a quarterly basis. It takes some time on my side to generate, proof, and upload, and I'd rather spend my time updating the other wikis.

Let me know how you feel, and I'd be willing to reconsider. Thanks!

[gnosygnu]

Also, for what it's worth, I uploaded 2016-10 commons and all the Polish wikis. Same drill as above:

• Go to Download Central (home/wiki/Special:XowaDownloadCentral)
• Look at the "Available" table and click the "blue down arrow" all the way to the right.
• Download the new entries
• Restart XOWA

[Ope30]

Well, there'll be a 2016-11 version of English Wikipedia and maybe German Wikipedia / French Wikipedia, but I'm not planning to do 2016-11 versions of the other wikis (English Wiktionary, German Wikisource, French Wikivoyage, etc.). I'd like to update these on a quarterly basis. It takes some time on my side to generate, proof, and upload, and I'd rather spend my time updating the other wikis.

Exactly. I only planned to redownload the big ones atleast one more time this month, not the small ones. ^^

Also, for what it's worth, I uploaded 2016-10 commons and all the Polish wikis. Same drill as above:

Nice. I truly appreciate it. :-D I'll get them.

As I remember, you said they're not missing any images, or? Talking about the Polish one. :d

Edit: It seems I can't download Commons, the page doesn't exist. :/

Edit 2: So, I tested some new wikis that you uploaded (mostly the 2016-10 ones). So far there has been no issue, also goes for the Polish Wikipedia, it has the Navigation bar and categories.
Especially the english ones, the small ones, I'm glad you worked on them. They seem to be working. They have the Navigation bar and working categories as well, finally. :p

Pretty nice work you did there. :D

[gnosygnu]

As I remember, you said they're not missing any images, or? Talking about the Polish one. :d

Yup. All 2016-10 wikis after the 2016-10 English wikis will be fine. So will any 2016-11, 2016-12, etc. ;)

Edit: It seems I can't download Commons, the page doesn't exist. :/

Ah, this looks like it'll need a new XOWA build for it to work through download central. You can download it manually at https://archive.org/download/Xowa_commonswiki_latest

Edit 2: So, I tested some new wikis that you uploaded (mostly the 2016-10 ones). So far there has been no issue, also goes for the Polish Wikipedia, it has the Navigation bar and categories.
Especially the english ones, the small ones, I'm glad you worked on them. They seem to be working. They have the Navigation bar and working categories as well, finally. :p

Pretty nice work you did there. :D

Cool. Good to hear. :)

[Ope30]

Yup. All 2016-10 wikis after the 2016-10 English wikis will be fine. So will any 2016-11, 2016-12, etc. ;)

Nice! I'll probably only download the big 2016-11 German and English wikipedia.

Ah, this looks like it'll need a new XOWA build for it to work through download central. You can download it manually at https://archive.org/download/Xowa_commonswiki_latest

I tested it and can confirm that it's not a broken build or something (so far), it works. ^^
Again, thank you for uploading it!

Just curious, are you currently working on the small German wikis? I think I already asked you this, but, do you have any details regarding the Swedish Wikipedia or any others yet? I really can't wait to download them, lol. Just asking you.

[gnosygnu]

Nice! I'll probably only download the big 2016-11 German and English wikipedia.

Cool. I'm going to try to put up English and German as soon as Wikimedia gets their dumps up

I tested it and can confirm that it's not a broken build or something (so far), it works. ^^
Again, thank you for uploading it!

No problem. Thanks for testing!

Just curious, are you currently working on the small German wikis?

Honestly, I don't follow. The small German wikis were posted last week. See http://xowa.org/home/wiki/Wiki_setup/German_wikis

Also, note that some of the wikis say "2010-09" but they're actually "2010-10". It's "2016-09" because the last article is "2016-09-30"

I think I already asked you this, but, do you have any details regarding the Swedish Wikipedia or any others yet? I really can't wait to download them, lol. Just asking you.

I'm actually working on the Swedish wikis now. :) Should be sometime this week.

[Ope30]

Honestly, I don't follow. The small German wikis were posted last week. See http://xowa.org/home/wiki/Wiki_setup/German_wikis

Sorry, my bad lol. I didn't know you uploaded them. :d

I'm actually working on the Swedish wikis now. :) Should be sometime this week.

Great! Can't wait. ^^

Edit: I tested the small wikis and there is only one problem that I found. When you click on an image and you go back, every image disappears, also, when you go one page back (clicking on an image doesn't matter) then one page forward, every image disappears as well. This goes (so far) only for DE-EN Wikinews. All the other wikis are fine. Just wanted to point that out!

[gnosygnu]

Sorry, my bad lol. I didn't know you uploaded them. :d

No problem. I was just worried you found an issue and weren't using them. :)

Edit: I tested the small wikis and there is only one problem that I found. When you click on an image and you go back, every image disappears, also, when you go one page back (clicking on an image doesn't matter) then one page forward, every image disappears as well. This goes (so far) only for DE-EN Wikinews. All the other wikis are fine. Just wanted to point that out!

Thanks for the report! That's a strange bug. I was able to reproduce it on my side. It looks like it only affects wikinews, though I need more time to figure out why. I'll definitely have a fix for it in the next release.

[gnosygnu]

I uploaded the 2016-10 Swedish wikis tonight. You can get them through Download Central. Let me know if you have any issues.

Thanks!

[Ope30]

Thank you for uploading them. ^^
There's only one problem, I can't find them in the Download Central although I clicked on the Blue Arrow. :(

For your information, the bug with disappearing images also goes for FR-PL Wikinews.

Edit: By the way, I think you forgot to upload the Polish Wikiversity. :d

[gnosygnu]

Thank you for uploading them. ^^
There's only one problem, I can't find them in the Download Central although I clicked on the Blue Arrow. :(

Oops. My mistake. I uploaded the wrong files last night. I uploaded the right ones now.

For your information, the bug with disappearing images also goes for FR-PL Wikinews.

Yup, it's a wikinews issue. I'm trying to figure out a "clean" way to fix it, but it looks like it needs a new release.

Edit: By the way, I think you forgot to upload the Polish Wikiversity. :d

Hmm... I don't think one exists.

• Dead link at https://pl.wikiversity.org/
• Contrast with https://en.wikiversity.org/

Let me know if I'm missing anything.

Thanks!

[Ope30]

Hmm... I don't think one exists.

Right. My bad!

I checked the Swedish wikis and it seems they're working fine! Other than the Wikinews one, everything is okay! Thanks so much for uploading them! And yeah, if they need a new release, I'll probably just replace them.

[gnosygnu]

I checked the Swedish wikis and it seems they're working fine!

Great! Thanks for checking! :)

Other than the Wikinews one, everything is okay! Thanks so much for uploading them! And yeah, if they need a new release, I'll probably just replace them.

I put in a fix for the Wikinews issue. If you want to give it a try, please do the following:

• Download the release candidate from my Google drive: https://drive.google.com/open?id=0B9cb52zjL2rIdnVGNEZQRmkyalk
• Unzip to your XOWA directory. You want to replace the existing files.
• Go Backwards / Forwards with any Wikinews page. Images should remain
• If for some reason, you need to rollback, you can always download the latest release from https://github.com/gnosygnu/xowa/releases/download/v3.10.4.1/xowa_app_windows_64_v3.10.4.1.zip and unzip to your XOWA directory.

Let me know if there's anything else. Thanks!

[Ope30]

I put in a fix for the Wikinews issue. If you want to give it a try, please do the following:

Nice! Yeah, it may be working for you, but unfortunately it isn't working for me. :(
To be clear, images are still disappearing when going back and forward even using the newest release you posted. :/ But, it's okay actually. It's not annoying at all. Also you don't have to fix this unless you want to and of course I'm going to try it out! I mean I know that it is probably working for you, but for some reason it's not working for me.

Let me know if there's anything else.

Yeah, ehm, if I may ask, what is the next wiki you're going to work on? :P
Could you please work on the Nederlands and Russian wikis? These are the ones I would love to have next! Thanks.

[gnosygnu]

Nice! Yeah, it may be working for you, but unfortunately it isn't working for me. :(
To be clear, images are still disappearing when going back and forward even using the newest release you posted.

Hmmm... I just tried again now and it did work. Here's my steps

• Make sure XOWA is closed
• Download the release candidate from my Google drive (see link above)
• Unzip to D:\xowa_test
• Moved my en.wikinews.org (HTML dump only) to D:\xowa_test\wiki\en.wikinews.org
• Opened XOWA
• Navigated to en.wikinews.org/wiki/Main_Page
• Clicked on "Wikinews interviews India's first female Paralympic medalist Deepa Malik"
• Pressed the Back arrow on the toolbar (also Alt + Left or Main Menu -> History -> Backward)
  
  
  
  • Went back to the Main Page and the images still showed
  
  
• Pressed the Forward arrow on the toolbar (also Alt + Right or Main Menu -> History -> Forward)
  
  
  
  • Went back to "Wikinews_interviews_India's_first_female_Paralympic_medalist_Deepa_Malik" and the images still showed
  
  

If you can, give it a try and let me know if it still doesn't work.

Yeah, ehm, if I may ask, what is the next wiki you're going to work on? :P
Could you please work on the Nederlands and Russian wikis? These are the ones I would love to have next! Thanks.

Actually, I was working on 2016-10 Spanish next based on this: https://github.com/gnosygnu/xowa/issues/87#issuecomment-252256995 ("en, de, fr, sv, es, it, nl, and ru")

Let me know if you'd rather Dutch / Russian next, and I'll push Spanish further down in the cycle. I think it'll take at least a week to get 2016-11 Dutch out because I'll have to download the 2016-11 wikidata and commons wiki and also take a look at 2016-11 English Wikipedia

[Ope30]

Hmmm... I just tried again now and it did work. Here's my steps

Yeah, that seems to be working! I just realized that commons.wikimedia is causing it because I'm opening an image, then I get directed to Commons, then I go one page back and everything disappears. Still, I also tried it without commons and you definitely fixed it. :D Thanks. ^^

Actually, I was working on 2016-10 Spanish next based on this: #87 (comment) ("en, de, fr, sv, es, it, nl, and ru")

Alright! Let's get into the Spanish Wikipedia.

Let me know if you'd rather Dutch / Russian next, and I'll push Spanish further down in the cycle. I think it'll take at least a week to get 2016-11 Dutch out because I'll have to download the 2016-11 wikidata and commons wiki and also take a look at 2016-11 English Wikipedia

It's okay, the Spanish one sounds good! And yeah, I would have to redownload Wikidata as well, not sure about commons.

[gnosygnu]

I just realized that commons.wikimedia is causing it because I'm opening an image, then I get directed to Commons, then I go one page back and everything disappears.

Nice catch! That's a small bug on my side. I fixed it now and uploaded a new preview build: https://drive.google.com/open?id=0B9cb52zjL2rIektZNFVOcFVvQ3M

It's okay, the Spanish one sounds good! And yeah, I would have to redownload Wikidata as well, not sure about commons.

Cool. 2016-10 Spanish is building now. I'll know within a day if there are any major issues. If there are, then I'll probably put it off to the side and start working on 2016-11 English, 2016-11 Dutch and 2016-11 Russian before coming back to 2016-11 Spanish.

Also, I'm going to mark this ticket closed in a few days since it's mostly about 2016-10 wiki updates. I created a new one for 2016-11 wikis over here: https://github.com/gnosygnu/xowa/issues/95

Let me know if there's anything else. Thanks!

[Ope30]

Nice catch! That's a small bug on my side. I fixed it

Yeah, can confirm that, great job!

Cool. 2016-10 Spanish is building now. I'll know within a day if there are any major issues. If there are, then I'll probably put it off to the side and start working on 2016-11 English, 2016-11 Dutch and 2016-11 Russian before coming back to 2016-11 Spanish.

Agreed. Also please please don't forget to have them all at the same date, you know. Just wanted to remind you because that's very important. :-p

Also, I'm going to mark this ticket closed in a few days since it's mostly about 2016-10 wiki updates

Okay. I will be posting there if I find anything!

[gnosygnu]

Nice catch! That's a small bug on my side. I fixed it

Yeah, can confirm that, great job!

Cool. Thanks for the confirmation!

Agreed. Also please please don't forget to have them all at the same date, you know. Just wanted to remind you because that's very important. :-p

Yup. Won't forget again so don't feel like you have to keep reminding me. ;)

Also, I'm going to mark this ticket closed in a few days since it's mostly about 2016-10 wiki updates

Okay. I will be posting there if I find anything!

Ok. One last note in this thread. I posted the patches for the smaller 2016-10 English wikis. You can update it through Download Central. All told, the number of missing pictures was very small. The downloads are large because I can't just send down the missing images: I have to send down the entire database file with the missing images.

en.d: 7
en.s: 308
en.v: 325
en.q: 17
en.b: 55
en.u: 15
en.n: 2

Let me know if there's anything else. Thanks!

[Ope30]

Ok. One last note in this thread. I posted the patches for the smaller 2016-10 English wikis. You can update it through Download Central. All told, the number of missing pictures was very small. The downloads are large because I can't just send down the missing images: I have to send down the entire database file with the missing images.

Great! I mean, it wasn't needed at all, but I'm grateful you uploaded them! I downloaded them and replaced several files and everything seems to be working. ^^

One thing though, could you tell me your size of your DE-EN Wikipedia? Only the big one, I would like to compare them, you know.
Mine, the German one, is 55,3 GB and the English one is 153 GB.

[gnosygnu]

Great! I mean, it wasn't needed at all, but I'm grateful you uploaded them! I downloaded them and replaced several files and everything seems to be working. ^^

Cool. Thanks as always for double-checking!

One thing though, could you tell me your size of your DE-EN Wikipedia? Only the big one, I would like to compare them, you know.
Mine, the German one, is 55,3 GB and the English one is 153 GB.

• English is 153 GB for me too (164,906,024,960 bytes)
• German is also 55 GB (59,324,653,568 bytes)

I'd like to reduce English, but that will probably wait until 2017-01 (or later).

Anyway, hope that helps. Thanks.

[gnosygnu]

As discussed above, I'm going to mark this ticket closed as the 2016-10 series is done. For new comments, please add them to https://github.com/gnosygnu/xowa/issues/95. Thanks.