Searchable BlitzBasic forum archive
about 2 weeks ago I started writing an app to download all forum topics from the BlitzBasic archive mojolabs.nz, this is now done and I won't be sharing the app but I will share the forum files. While this might be copyright infringement I am not making any money out of this so I think I'm safe legally. I split the forums up into languages and you can download them here: BlitzMax, MonkeyX, Blitz3d, BlitzPlus, Blitz3d SDK, Code Archives and Community (Note there are no topics from General Discussion).
I gave up waiting for Google to provide a full index of the BlitzBasic archive (as it may never happen) and found a desktop search engine named Regain that works just like Google once it's indexed the files, which it does really quickly. However, you will need to install Java 1.6+. On MacOS this should already be done, on Windows you will probably want Java SE (Standard Edition) JDK8 from Oracle choosing the relevant architecture (the dev kit has more features than the runtime environment), on Linux there may be a default JRE in the repositories but if not you can manually install it, just get the relevant JDK8 download from Oracle and follow this DigitalOcean how-to for Ubuntu/Debian.
Once you have Java you can set up Regain. For the download get the desktop zip, it seems there is no MacOS version but the Linux version works on Mac. Extract the regain folder to anywhere handy, open a command prompt and "cd" to this folder, to run type "java -jar regain.jar" and it should launch in the taskbar, if it starts indexing you will have to wait a while. Right-click the icon and select Preferences, this opens a page in your default browser, add a directory (it must be a full path) to the forums folder and Save, go to the Status page to know when it's finished indexing, then just go to the Search page. You should get results like this:
105697.html (Relevance: 1%) GLSL Shaders in BlitzMAX News Forums Code Logs Gallery Specs Search GLSL Shaders in BlitzMAX BlitzMax Forums/BlitzMax Programming/GLSL Shaders in BlitzMAX TomToad (Posted 2016) [#1] Been trying to ... a bit of googling. TomToad (Posted 2016) [#20] Now messing with the vertex shaders. Made a nice text/html ~/forums/bmx-forums/forums/bmx-programming/105697.html - 49.61 kB - Jan 20, 2018 Cached
That's it, have fun!
This is awesome Mark, thanks! Actually I went ahead and did another slow patient web crawl a few weeks ago using php, but it is not quite complete. This will come in really handy and will soon do a cdn mirror copy just in case.
Yes, that was another reason why I did this because many other people will do a crawl if nothing searchable exists.
Another thing I should have mentioned is with my copy you can also navigate by the forum pages and if a topic was moved you can navigate to that too and code archive source files are also there. However, you can't navigate to the forums from a topic.
Awesome, thanks again Mark. This will be a valuable source of info and resources. cheers.
Reply To Topic
Please log in to reply