Old News

From MulpWiki
Jump to: navigation, search

02. October 2016[edit]

I rewrote my code for scraping desuarchive.org and downloading the appropriate pastes. Because of this the format I use for the downloadable archive has been changed.

I plan to overhaul the code I have for my bot next and have it then upload the new pastes here.

20. May 2016[edit]

Installed an extension that displays page categories in alphabetical order.

17. April 2016[edit]

Rolled in an update containing 1400 new or updated articles. Because of a typo they accidentally ended up in Category:Botv1.3.

17. January 2016[edit]

Rolled in an update containing 1100 new or updated articles. They can be found at Category:Botv1.4

A download version of the site's stories can be found here (fixed the link).

13. October 2015[edit]

Rolled in an update containing 900 new or updated articles. They can be found at Category:Botv1.3.

Unfortunately I incorrectly tagged all stories last updated in August of 2015 with this category, even if they existed in exactly this format in the previous bot version, leading to about 200 articles that are listed under Category:Botv1.3, even though there is no actual change to them.

I also algorithmically added a tag for a Satyr OC: Category:Pogo

30. August 2015[edit]

Due to inconvenience when trying to find stories containing an OC, I've added a list where you can submit OCs you want the bot to add tags for. They will be added the next time I roll in an update.

17. August 2015[edit]

Rolled in a story update containing 660 new articles. To only get stories added by this update go to Category:Botv1.2.

01. July 2015[edit]

I wrote a JavaScript gadget that displays an article's categories on top of the page. I have enabled it by default, even for unregistered users, but you can disable it in your preferences if you have an account. The gadget is fairly simple, but if it for some reason causes problems for you, please let me know!

Unfortunately I couldn't get it to work with the MobileFrontend extension, so categories are still not being displayed when using mobile view.

Also I switched back to a slower, but cheaper server because I miscalculated the total monthly costs, sorry.

29. June 2015[edit]

The update process is now finished. Unfortunately I used the Nuke extension incorrectly and accidentally deleted some already revised pages. I restored them the best I could, but since it's apparently impossible to mark a delete action with the bot tag with mediawiki I can't properly find them all. Furthermore edits that occurred during the updating process might have been lost.

I also rented more bandwidth for the website so it should run slightly faster now.

28. June 2015[edit]

Sorry for not updating the wiki like I promised. I fell sick shortly after my announcement and only got around to doing it now.

Since I changed the way the bot generates the pages, I'll first delete all non-revised pages and then recreate them. This will take a few hours.

Status Update: Due to minor technical difficulties the whole updating process will take longer than anticipated; It will be finished tomorrow at the latest.

Technical Stuff

  • I originally planned to put category lists on top of each page through an extension, but unfortunately there is no extension written for that purpose. I'll likely fiddle around with JavaScript to try and find a solution
  • Fixed the bug where part of the last edit was cut off.
  • Changed the way the bot puts pages in categories. I didn't add exceptiond for short articles, but the bot will now correctly use the clop and clopfic categories and mark respective chapters when necessary. Furthermore the bot now not only considers the total amount of lines containing keywords (previously added tags when at least 4% positive), but also now checks for high character appearance within chapters (now also adds tags when at least 12% of at least one chapter positive). The bot now also makes use of tags the author provided in the paste title.
  • Added category pages for all writefags.
  • Added a mass delete method to the bot.


27. May 2015[edit]

It has been a few weks since I uploaded a whole lot of pastebins to the wiki, and I plan to update the articles soon. After that I'll update the articles once every few weeks. Overall I'd call the automated creation of articles a success. Traffic increased significantly with about a thousand total daily pageviews (across all articles) and an all-time high in traffic costs totaling at 0.02$ instead of just 0.01$.

Technical Stuff

I'll likely also improve the bot a little:

  • I'll add an element that puts the categories at the top of the page, especially for mobile use.
  • I'll fix the issue with the Last Edit being displayed incorrectly.
  • I'll slightly rework the automated category detection, so that extremely short articles don't get tagged because of just one line containing a keyword.
  • I'll create category pages for all the writefags.
  • I'll add a mass delete method to the bot.

If there's something else you'd like me to have the bot do or if you have some more general suggestions, please write your feedback in the Main Page's discussion page!

Other things I'd like to work on:

  • A JavaScript Gadget for quickly making small edits in articles without reloading the page by pressing a shortcut
  • A rating extension for articles and if possible a way to include those ratings in the advanced search

Also, please answer this poll about mobile device usage.

Thanks.

28. April 2015[edit]

Added an extension for usage with mobile devices. To return to desktop view, go to the bottom of the page.

Unfortunately the extension for highlighting greentext is not compatible with the mobile frontend extension, so all text will be black while in mobile view. I also added a collapsed second main page below the normal one only visible in mobile use, though it shouldn't be a problem unless you enjoy being retarded on purpose.

Since the MobileFrontend extension is still under development, it's currently not possible to edit the sidebar. I added a link to the advanced search to the mobile Main Page under content.


24. April 2015[edit]

After I made some tools for collecting pastebin links, and then downloading those pastes, I have now started using a bot to upload all those pastes to MulpWiki. Roughly 21,500 articles have been created like this, but at least 10% of those should be deleted, because they are unrelated and just got swept in with the rest. (To put his into perspective, Fimfiction has a little over 80,000 stories, though their stories are longer on average).

I grouped multiple chapters together as best as I could, but it didn't work perfectly, mostly because there's no convention for naming pastes, or simply because of inconsistencies in the paste names.

The articles have been checked for character occurence and tagged accordingly. I also checked for erotic language and added clop tags when appropriate.

If you find a page that does not belong on this site and should be deleted, please mark it accordingly!

Also, if you're feeling productive, review the articles you've read and add tags accordingly! Thanks!