Forum Developments

View the Forum Registry

XML Get RSS Feed for this thread


Self-edit this thread


0 Subject: Forum slow?

Posted by: youngroman
- [4665106] Thu, Jul 24, 2008, 05:28

I noticed this for a few days and checked it with a different internet connection too:

on the forum main page I click on the link of one of the sub-forums (like http://rotoguru1.com/cgi-bin/view.pl?board=slam). my browser goes into wait state for a few seconds before he gets the response from your site. this happens not all the time but it happens more frequently. I'd say currently every other time.

all other pages are working fine. have you changed something in the last few days?

I have this problems with:
- @home with Opera on Vista
- @home with IE7 on Vista
- @work with Opera on Vista
- @work with Firefox3 on Vista
- @work with IE7 on Vista
- @work with Opera on XP
- @work with Firefox3 on XP
- @work with IE7 on XP

@home and @work are using different internet providers with different routing paths to rotoguru1.com, so this seems to be a problem on your side
1Guru
      ID: 330592710
      Thu, Jul 24, 2008, 09:21
Nothing's changed. I've noticed an occasional wait as well. Perhaps there is a delay issue with one of the ad providers?
2biliruben
      Leader
      ID: 589301110
      Thu, Jul 24, 2008, 09:29
I've seen it on politics, in particular. I can get to the most recent thread, but not the forum thread listing.
3youngroman
      Donor
      ID: 02934823
      Thu, Jul 24, 2008, 11:10
I checked with the Tamper Plugin in Firefox and got a slow (3.987s waiting, 4.649s total) response from

http://www.rotoguru1.com/cgi-bin/view.pl?board=golf&lastpost=1216909185

or (9.884s waiting, 10.545s total)

URL=http://www.rotoguru1.com/cgi-bin/view.pl?board=dev&lastpost=1216909776

it seems not to be an issue of how active a forum is, because i get those long times in the Forum Developments forum too, and there is hardly any action.
4Guru
      ID: 330592710
      Thu, Jul 24, 2008, 11:59
I've made no changes to the forum software.

I haven't detected any unusual activity.

Occasionally, I get a slight delay when load a page - but it is not persistent, and typically only a few extra seconds.

Unless there is more of a pattern to this, I'm at a loss to diagnose.

Perhaps there is an intermittent nextwork glitch somewhere close to the source?
5StLCards
      Dude
      ID: 31010716
      Thu, Jul 24, 2008, 12:03
I've noticed it as well, especially the baseball forum. I am pretty sure it is related to ads. I think it might be google ads or something as that seems to be something I remember the connection saying it was waiting on at one time.

I usually use IE 7 but don't believe it was any better with firefox.
6youngroman
      Donor
      ID: 02934823
      Thu, Jul 24, 2008, 15:24
when I use a ad-blocker the site is as slow as without.

I am clueless as well. since all other pages are working there has to be a difference to view.pl

maybe somthing reached its limit. I remember an application at work that had a log-file reaching 2GB (file size limit on Solaris 2.5) and then it was slow as hell because every append to the file failed and took some time. other possible reasons that I check regularly when one of our applications at work is not performing as expected:
- check memory usage
- check number of file-handles in use (a socket uses a file-handle too)
- number of parallel requests (open sockets) vs. defined maximum
- check database response times
- current number of connections to database vs. defined maximum

not much I can do with my browser tough
7Guru
      ID: 330592710
      Thu, Jul 24, 2008, 16:04
Are you guys seeing this as a persistent issue? Because I've only noticed it a couple of times per day. And I do recall that it was waiting for a google ad when it happened this morning.

If it is ad-related, however, it would not impact only the view.pl program. It would also impact the thread reader.

I don't even understand (nor do I know how to monitor) most of the potential issues listed in [6].
8StLCards
      Dude
      ID: 31010716
      Thu, Jul 24, 2008, 16:14
For me it's hit and miss. A few minutes ago I clicked in to the baseball forum and I counted off 11 seconds before I got in. About 6 seconds for the football forum.

Other times it goes faster with maybe up to a 2 second delay.
9blue hen
      ID: 30311814
      Thu, Jul 24, 2008, 16:37
It's not "persistent" - it doesn't happen regularly or every time. But it does keep coming back every few times I come back to the site.
10youngroman
      Donor
      ID: 02934823
      Thu, Jul 24, 2008, 16:48
it can all be done more or less on the Unix shell. the commands depend on the Unix you are running (Linux, Solaris, BSD, ...)

common commands are:
processes: ps -ef
memory: top or prstat
file-handles: lsof
sockets/connections: netstat
defined limits (file-handles): ulimit
11blue hen
      ID: 30311814
      Fri, Jul 25, 2008, 10:44
It said "waiting for rotoguru1.com" if that helps.
12holt
      ID: 341542412
      Sun, Jul 27, 2008, 06:00
I've also noticed some long waits. after 5-10 seconds I usually click the link again and eventually it opens. started noticing it sometime this summer but not sure exactly when. I also use ad blocker btw. I doubt that it's ads loading.
13holt
      ID: 341542412
      Sun, Jul 27, 2008, 06:02
just had a load time of 23 seconds opening the football forum, for example.
14youngroman
      Donor
      ID: 02934823
      Wed, Jul 30, 2008, 19:21
I haven't noticed a slow load-time in the last 2 days. is the problem gone?
15holt
      ID: 15621316
      Sun, Aug 03, 2008, 05:36
I still experience slow load times, as in so slow that I end up clicking the link a few times before it responds. a lot of the time the link opens immediately though.
16PuNk42AE
      Donor
      ID: 036635522
      Tue, Aug 26, 2008, 23:08
Has it been slow for anyone else tonight? Anytime I goto refresh a forum it is slow as crap and I give up and go back then click the forum again.
17biliruben
      Leader
      ID: 589301110
      Wed, Aug 27, 2008, 00:42
Yeah.
18StLCards
      ID: 15727522
      Thu, Sep 04, 2008, 00:38
very, very slow for the most part over the past few weeks. Often 15 seconds to load the baseball page, but it feels like an eternity while waiting.
19blue hen
      ID: 30311814
      Fri, Sep 05, 2008, 12:58
I only noticed in the last couple of days, but this is definitely back.
20StLCards
      Dude
      ID: 31010716
      Fri, Sep 05, 2008, 14:32
seems very fast today for me
21StLCards
      Dude
      ID: 31010716
      Fri, Sep 12, 2008, 23:12
I take back what I said in #20.
22Guru
      ID: 330592710
      Sat, Sep 13, 2008, 15:41
Last night was notably bad. Today it has been a mixed bag. Much of the time, response time is fast, but occasionally there have been delays of as much as 45 seconds.

I've done some investigating, and it appears to be happening when the program is determining which threads to display. In most cases, this is the 50 most recently appended threads. But if filters are being used, this can be a much more complex process.

I need to think about ways to adjust this process that will avoid the slowdowns. In the meantime, I'll appreciate your patience.

23Guru
      ID: 330592710
      Mon, Sep 15, 2008, 13:18
Update -

By cleaning out a lot of dormant threads from some of the largest forums, I've been able to get some speed improvements. Over the past 24 hours, more than half of the accesses of the view.pl program have run in 2 seconds or less. But overall, the number of very slow accesses seems to be growing, and I don't consider the status quo to be acceptable.

My first inclination is to suspect that the hard drive may be slowing down, which I imagine would indicate a hardware issue. I have asked the server host to look into this.

Meanwhile, I think there are way that I can rewrite a portion of the code to run much faster, and I will begin working on this. It will probably take several days - maybe a week - to fully assess if this can solve the problem - or at least avoid the symptoms. Hopefully, if there is a hardware issue, it can be diagnosed and solved faster.

In any event, please be patient - and be aware that I am working diligently to try to figure out the problem and the solution.

24Guru
      ID: 330592710
      Tue, Sep 16, 2008, 15:07
Latest developments:

1. I rewrote some of the forum code yesterday, and that produced significant improvements. Since about 5:30pm ET Monday (when the change was implemented), 91% of all forum accesses were processed in less than two seconds, with the vast majority completed in one second or less. However there were still some long delays, with 1% of all accesses requiring at least 30 seconds. So, pretty good... but not good enough.

2. Since I suspect the problem is related to the hard drive, I am having it cloned and replaced overnight. At approximately 3am ET, this server will be taken offline to accomplish the process. I expect the downtime to be less than an hour, but this will depend on the condition of the existing drive and whether any issues are encountered during the copying procedure.

So, I'm hoping that by tomorrow morning, performance will be back to what we've all come to expect as normal.
25Guru
      ID: 330592710
      Wed, Sep 17, 2008, 07:24
The hard drive replacement has been completed.

Forum Developments

View the Forum Registry

XML Get RSS Feed for this thread


Self-edit this thread




Post a reply to this message: (But first, how about checking out this sponsor?)

Name:
Email:
Message:
Click here to create and insert a link
Click here to insert a block of hidden (spoiler) text
Ignore line feeds? no (typical)   yes (for HTML table input)


Viewing statistics for this thread
Period# Views# Users
Last hour11
Last 24 hours11
Last 7 days44
Last 30 days109
Since Mar 1, 200748671233