Author Topic: Enabling GZip on VGMaps's server  (Read 36230 times)

0 Members and 1 Guest are viewing this topic.

Offline _L_

  • Newbie
  • *
  • Posts: 3
Enabling GZip on VGMaps's server
« on: December 27, 2014, 07:59:37 am »
I was wondering if it's possible for VGMaps's server to have gzip enabled. (If you're not familiar, it's a text compression setting that reduces the bandwidth of HTML pages.) I'm asking because it currently has gzip disabled, and I think it would benefit the site a lot given that it consists of several 5MB HTML pages.

Offline Revned

  • Hero Member
  • *****
  • Posts: 1094
Re: Enabling GZip on VGMaps's server
« Reply #1 on: January 01, 2015, 01:28:28 pm »
Good observation.

Jon, if you could figure out how to turn this on it would be a huge improvement. The savings could be as high as 80-90% on the html pages. It would speed up browsing considerably for slow connections, and would even likely be noticeably faster for fast connections.

Offline _L_

  • Newbie
  • *
  • Posts: 3
Re: Enabling GZip on VGMaps's server
« Reply #2 on: February 12, 2015, 04:11:41 am »
No word about this?

Offline JonLeung

  • Administrator
  • *****
  • Posts: 3695
Re: Enabling GZip on VGMaps's server
« Reply #3 on: February 12, 2015, 07:43:09 am »
Sorry, I hadn't set aside time to look into this and then I forgot about it.  I'll take a look soon.
« Last Edit: February 12, 2015, 11:44:15 am by JonLeung »

Offline alucard

  • Full Member
  • ***
  • Posts: 111
Re: Enabling GZip on VGMaps's server
« Reply #4 on: March 25, 2015, 09:04:29 pm »
The problem will not be solved by gzip, the problem is that there are way, way too many links on pages.

How many links are on this page?

https://www.vgmaps.com/Atlas/index.htm

1,000?

What about this page?

https://www.vgmaps.com/Atlas/NES/index.htm

600,000?

The problem is putting the links to every single individual NES map all on 1 page, and then the same done for each system. That entire page with 600,000 or more links, plus hundreds and hundreds of images for game logos has to be loaded, even if you just want to look at maps for 1 individual game.

The entire site needs to be restructured and redone. It needs a better navigation system and modern html and css coding.

I can redo the entire site for you if interested.

Offline Revned

  • Hero Member
  • *****
  • Posts: 1094
Re: Enabling GZip on VGMaps's server
« Reply #5 on: March 25, 2015, 11:46:19 pm »
It certainly won't be solved by enabling gzip, but it would be a decent improvement for the immediate term. On my good connection it takes 4 seconds just to download the NES index HTML. Cutting that down to 400ms would be a great start.

The NES index has 8860 links. That's pretty crazy, but doesn't appear to be a huge contributing factor. It's the 300+ logos. They take over 6 seconds to load for me.
« Last Edit: March 25, 2015, 11:49:55 pm by Revned »

Offline JonLeung

  • Administrator
  • *****
  • Posts: 3695
Re: Enabling GZip on VGMaps's server
« Reply #6 on: March 26, 2015, 08:46:38 am »
Would it be preferable to not have logos?  Would it be worth the trade-off to have faster pages?  I like them because it makes it visually easier to browse through a whole console's library, partly why I'm not a fan of each game having their own page (besides the number of pages that would involve).  If everything was just text and tables, well, that'd be pretty boring, wouldn't it be?  (Sometimes editing a title logo takes way too long, though...)

I could cut down the number of links by combining cells for the creator column, as maps for each game are usually by the same creator.  To cut down on text in general, I could also combine other cells where the details are redundant across each row (such as "main area/world/stage" or whether it's "ripped"/"original", etc.).  Or even eliminate one of the "area/world/stage" columns in games where two columns are not necessary.  However, I have avoided doing that before because I was worried that if we wanted to leave open the possibility of migrating to a new system, that if I had tables with various combined cells or inconsistent numbers of columns, that it might make any auto-migration procedures more complicated...probably?  Thoughts?

I've said before that an upgrade should include a considerable time-saving benefit on my end.  And I would have to find someone I really trust to help, and it might have to be someone local that I can work with more directly considering the scope of it all.  VGMaps is always growing, but I'd like to think it's still a rather linear growth, that even though it may be more difficult as time goes by based on the volume, it's not going to be exponentially more complicated between if it's 10,000 maps or 100,000 maps.  I hope.
« Last Edit: March 26, 2015, 08:49:29 am by JonLeung »

Offline alucard

  • Full Member
  • ***
  • Posts: 111
Re: Enabling GZip on VGMaps's server
« Reply #7 on: March 26, 2015, 01:40:09 pm »
gzip wont be worth the time, the more and more links and images that get added to each main index page just adds to the problem. So the best solution is for each game to have their own individual page, so the URL's will be something like:

vgmaps.com/nes/batman

vgmaps.com/nes/batmanreturns

vgmaps.com/snes/smb

vgmaps.com/snes/smb2

etc, etc.

That way the NES, SNES, etc Map index pages can just be links to those pages, so it wont need the game logos on the Atlas index pages, nor would it have links to the thousands of maps for every single game all on one page. The logos and individual map links would be on the individual pages (vgmaps.com/snes/smb would display the game logo, and all links to maps of that game)

A few other things:

1. You should use all lowercase letters on URL's, not like this: (Atlas/SuperNES) and (NewsArchives/MapsOfTheMonth)

2. The URL's of the pages are too long (vgmaps.com/Atlas/SuperNES/index.htm) should be changed to (vgmaps.com/snes)

(vgmaps.com/NewsArchives/MapsOfTheMonth-2015.htm) to (vgmaps.com/motm/2015)

(vgmaps.com/Atlas/index.htm) to (vgmaps.com/atlas) etc, etc

A simple code can be used to automatically forward (Atlas/SuperNES/index.htm) to (snes), so anyone who has that bookmarked will automatically be sent to the correct page, and they get sent immediately without even noticing that the page was forwarded.

3. You should also stop using .htm extensions completely

4. Some of the fonts on the home page are way too small, the fonts on the left Atlas Menu's, and the fonts for the site updates.

5. New tables need to be created for the map links, new modern tables styled with CSS, different than the ones the site currently has.

6. The website needs a new logo, maybe that same font can be used, but the current logo reminds me of web sites created back in the 1990's.

7. Those Casino ads on the main home page should probably go, any sites that display ads like that usually get a bad reputation, also people tend to think those ads lead to virus or spam sites.

8. Project Wonderful should probably go as well, there are much better ad networks out there, I can recommend some.

For me, setting up the new layout and how the links will be displayed on the main Atlas pages, changing/forwarded the longer .htm URL's, and creating the codes best suited for the CSS tables for the map links is all very easy. I already have the entire layout in my head without even having to write anything down to remember. It will be an easy to use layout.

But the long, hard part will be adding the thousands of maps to the new layout. But in the end it will be all worth it, with the new layout you can easily add thousands and thousands of maps without hurting load time for users.

Offline Revned

  • Hero Member
  • *****
  • Posts: 1094
Re: Enabling GZip on VGMaps's server
« Reply #8 on: March 26, 2015, 05:30:44 pm »
If enabling gzip is just a checkbox somewhere, why not enable it? A full rewrite of the site wouldn't launch overnight. Not disagreeing that it is desperately needed.

Offline _L_

  • Newbie
  • *
  • Posts: 3
Re: Enabling GZip on VGMaps's server
« Reply #9 on: April 06, 2015, 03:19:19 am »
Yes, please, please enable gzip before considering any website redesigns. It has to be done regardless of the state of the HTML: every modern site has it enabled.

Offline Revned

  • Hero Member
  • *****
  • Posts: 1094
Re: Enabling GZip on VGMaps's server
« Reply #10 on: April 07, 2015, 06:01:49 pm »
Looks like you need to paste a configuration line into a .htaccess file at the top level directory:
https://support.godaddy.com/help/article/6946/enabling-mod_deflate-with-your-hosting-account

Offline JonLeung

  • Administrator
  • *****
  • Posts: 3695
Re: Enabling GZip on VGMaps's server
« Reply #11 on: April 14, 2015, 10:24:58 am »
Well, I reconfirmed my hosting plan, and put the appropriately required lines in the .htaccess file.  Now what?  The HTTP Compression Test seems to say VGMaps.com is compressed now, is that really it?  Did it affect all pages?  Do they load faster?  Was it really that simple?  If so, I really am boneheaded for not getting around to it earlier...sorry.

Offline Revned

  • Hero Member
  • *****
  • Posts: 1094
Re: Enabling GZip on VGMaps's server
« Reply #12 on: April 14, 2015, 12:56:05 pm »
Yes, looks like it's working on all the HTML pages. Seems snappier to me!

Offline Peardian

  • Hero Member
  • *****
  • Posts: 627
  • Busy busy
Re: Enabling GZip on VGMaps's server
« Reply #13 on: April 26, 2015, 10:23:04 pm »
Snappy indeed! It only took a single second to load the HTML for the entire SNES page, and loading the whole page only took ~6 seconds from start to finish.
MM (10%) - SMA3 (33%) - DNS (0%)

Come check out the Nintendo 64 Mapping Workshop!

Offline vgmapsuser

  • Newbie
  • *
  • Posts: 3
Re: Enabling GZip on VGMaps's server
« Reply #14 on: May 04, 2015, 02:37:27 pm »
I can't believe how big of a difference that made.  It saves me 92% on average on the HTML and over 50% overall.  Thanks!