SmugMug Network Connectivity Issues

bham · January 3, 2007

********** UPDATE FROM SMUGMUG HERE ***********
Folks, we're sorry if you are experiencing trouble accessing your site. It's not our servers, or our software, as the site is working for most folks. But we know YOU are affected. It's a networking issue and we're trying to understand it and get things back to normal as fast as we possibly can. More as we get it.

Update: 1pm NY time 1/4/07
Things should be back to normal, but our engineers are still working on & investigating the connectivity issues. They're also working on more permanent fix.

*************************************************

I drag and drop it says gathering data then it either give me an upload error, can find site, etc. After 11 tries in a row this is a problem. Other sites I am having no problem with, tested speed ok.:scratch

Now Java screen not coming up, getting a red X in top left corner. It show its loads but when finished show the red X.

Now that is ok and again gathering data then gives an error message: java.net.connectexception: connection timed out: connect

Doing this over and over and over. What gives?

Andy · January 3, 2007

bham wrote:

Doing this over and over and over. What gives?

Who is your ISP, we're hearing a few reports of same behavior, but Smug's working just fine.

PBolchover · January 3, 2007

I'm having similar problems, from Roadrunner...

pbolchover.smugmug.com

PBolchover · January 3, 2007

In case it helps, here is my tracert to pbolchover.smugmug.com:

C:\Documents and Settings\Paul>tracert pbolchover.smugmug.com

Tracing route to pbolchover.smugmug.com [63.81.134.23]
over a maximum of 30 hops:

  1     *        *        *     Request timed out.
  2     8 ms    10 ms     9 ms  gig3-1-4.hstntxtid-rtr1.houston.rr.com [24.28.97
.69]
  3     8 ms     8 ms     8 ms  gig12-0-0.hstntxtid-rtr3.houston.rr.com [24.93.3
4.94]
  4    27 ms    19 ms    22 ms  72.179.205.1
  5    18 ms    17 ms    25 ms  4.79.180.65
  6    23 ms    31 ms    17 ms  ae-24-56.car4.Dallas1.Level3.net [4.68.122.176]

  7    57 ms    53 ms    54 ms  CWIE-LLC.car4.Dallas1.Level3.net [4.71.122.10]
  8    59 ms    54 ms    52 ms  ge1-2.fr3.phx2.llnw.net [69.28.171.129]
  9    52 ms    54 ms    55 ms  ge2-1.fr4.phx2.llnw.net [69.28.171.102]
 10    54 ms    53 ms    54 ms  ge2-1.fr3.phx1.llnw.net [69.28.171.89]
 11    64 ms    55 ms    53 ms  ge1-2.fr3.lax.llnw.net [69.28.171.82]
 12    54 ms    56 ms    53 ms  ve5.fr4.lax.llnw.net [69.28.171.206]
 13    62 ms    78 ms    62 ms  ge1-3.fr3.sjc.llnw.net [69.28.171.118]
 14     *        *        *     Request timed out.
 15    65 ms    73 ms    62 ms  hera.smugmug.com [63.81.134.23]

Trace complete.

mpmcleod · January 3, 2007

PBolchover wrote:

I'm having similar problems, from Roadrunner...

pbolchover.smugmug.com

Similar problems using Time Warner Houston Roadrunner (houston.res.rr.com). Here is a screen cap of the error.

Running the following Java version
Description Your Environment

Java Runtime Vendor:
Sun Microsystems Inc.
Java Runtime Version
1.5.0_07

firefox version 1.5.0.9

Andy · January 3, 2007

Hi, sorry you are having troubles, thus far we only know it's a RR issue. Wish I had more to tell you.

System · January 3, 2007

Smugmug page loading errors...
Pages on my site are either taking forever to load or coming up errors. Wassup wit dat?

bham · January 3, 2007

Andy wrote:

Hi, sorry you are having troubles, thus far we only know it's a RR issue. Wish I had more to tell you.

What is RR?

Did a wugnet speed test, 504kb up 4.47mb down.

Also now other smugmug pages acting funny.

Andy · January 3, 2007

bham wrote:

What is RR?

Did a wugnet speed test, 504kb up 4.47mb down.

Who is your ISP please

And a traceroute would be really helpful for diagnosis, if you can give one

System · January 3, 2007

Saw the bulk uploading post...Comcast high speed cable in Chicago.

bham · January 3, 2007

Andy wrote:

Who is your ISP please

And a traceroute would be really helpful for diagnosis, if you can give one

Charter

How to traceroute again?

A few pages loaded from smugmug with some text down the left side only and a white page. Odd.

Andy · January 3, 2007

There are net issues out there, sorry. Can't say what it is, exactly, but something's up from you (and others) to us. Sorry.

mpmcleod · January 3, 2007

Andy wrote:

Who is your ISP please <img src="https://us.v-cdn.net/6029383/emoji/ear.gif" border="0" alt="" >

And a traceroute would be really helpful for diagnosis, if you can give one

Good grief this seems slow tonight.

Tracing route to pbolchover.smugmug.com [63.81.134.23]
over a maximum of 30 hops:

1 <1 ms <1 ms <1 ms 192.168.168.254
2 9 ms 9 ms 10 ms 10.50.32.1
3 11 ms 12 ms 10 ms gig9-1-4.hstntxtid-rtr1.houston.rr.com [24.28.102.237]
4 12 ms 13 ms 9 ms gig12-0-0.hstntxtid-rtr3.houston.rr.com [24.93.34.94]
5 24 ms 23 ms 25 ms 72.179.205.5
6 70 ms 32 ms 22 ms 4.71.12.17
7 20 ms 21 ms 20 ms ae-24-52.car4.Dallas1.Level3.net [4.68.122.48]
8 25 ms 32 ms 37 ms CWIE-LLC.car4.Dallas1.Level3.net [4.71.122.10]
9 45 ms 48 ms 49 ms ge1-2.fr3.phx2.llnw.net [69.28.171.129]
10 52 ms 47 ms 48 ms ge2-1.fr4.phx2.llnw.net [69.28.171.102]
11 48 ms 50 ms 47 ms ge2-1.fr3.phx1.llnw.net [69.28.171.89]
12 57 ms 70 ms 58 ms ge1-2.fr3.lax.llnw.net [69.28.171.82]
13 56 ms 59 ms 67 ms ve5.fr4.lax.llnw.net [69.28.171.206]
14 64 ms 75 ms 65 ms ge1-3.fr3.sjc.llnw.net [69.28.171.118]
15 * * * Request timed out.
16 76 ms 67 ms 66 ms hera.smugmug.com [63.81.134.23]

Trace complete.

wellman · January 3, 2007

SmugMug's down for me. Provider is Charter Tennessee. Tracert below...

Tracing route to wellman.smugmug.com [63.81.134.23]
over a maximum of 30 hops:

  1     9 ms     3 ms     2 ms  192.168.0.1
  2    15 ms     9 ms    10 ms  10.164.0.1
  3    16 ms    11 ms    11 ms  24-158-109-225.dhcp.kgpt.tn.charter.com [24.158.
109.225]
  4    17 ms     9 ms    19 ms  24-158-96-226.static.kgpt.tn.charter.com [24.158
.96.226]
  5    26 ms    21 ms    25 ms  12.124.59.113
  6    46 ms    38 ms    38 ms  gbr1-p70.attga.ip.att.net [12.123.197.186]
  7    45 ms    41 ms    39 ms  tbr1-p013502.attga.ip.att.net [12.122.12.13]
  8    42 ms    39 ms    38 ms  tbr2-cl17.wswdc.ip.att.net [12.122.10.69]
  9    44 ms    38 ms    38 ms  12.123.8.37
 10     *        *        *     Request timed out.
 11    43 ms    44 ms    43 ms  tge9-3.fr3.lga.llnw.net [69.28.171.158]
 12    74 ms    59 ms    60 ms  ge2-1.fr3.ord.llnw.net [69.28.171.193]
 13   122 ms   108 ms   107 ms  tge1-3.fr4.sjc.llnw.net [69.28.171.66]
 14   100 ms   101 ms   104 ms  ve5.fr3.sjc.llnw.net [69.28.171.209]
 15     *        *        *     Request timed out.
 16   133 ms   124 ms     *     hera.smugmug.com [63.81.134.23]
 17   123 ms     *        *     hera.smugmug.com [63.81.134.23]
 18     *      136 ms     *     hera.smugmug.com [63.81.134.23]
 19     *      126 ms     *     hera.smugmug.com [63.81.134.23]
 20   127 ms   122 ms   131 ms  hera.smugmug.com [63.81.134.23]

Trace complete.

wellman · January 3, 2007

Just saw all the other posts between when I started writing and when I posted... Bad intenet, bad! :nono

dogwood · January 3, 2007

wellman wrote:

Just saw all the other posts between when I started writing and when I posted... Bad intenet, bad! :nono

Very bad internet tonight!

Won't even let me create a new gallery and there's all kinds of delays trying to access my site.

Andy · January 3, 2007

I've spoken to our Director of Ops, he'll make a post when he has some news.

Wireless · January 3, 2007

We started getting a bad route that caused our BGP session to one of our providers to flap for about two or so hours. I have shut down that session, so it shouldn't flap anymore.

If you were uploading during one of those "flaps", you probably had your upload session reset briefly as your provider recalculated a route back to us.

If you can get to dgrin, you can get to SmugMug... They are on the same network, and would be impacted equally with this incident tonight. If you are seeing other effects, it's something else.

DavidTO · January 3, 2007

Wireless wrote:

We started getting a bad route that caused our BGP session to one of our providers to flap for about two or so hours. I have shut down that session, so it shouldn't flap anymore.

If you were uploading during one of those "flaps", you probably had your upload session reset briefly as your provider recalculated a route back to us.

I understand none of this. But I do want to make sure that you've checked your LRFs.... and maybe your BBLs?

mpmcleod · January 3, 2007

Wireless wrote:

We started getting a bad route that caused our BGP session to one of our providers to flap for about two or so hours. I have shut down that session, so it shouldn't flap anymore.

If you were uploading during one of those "flaps", you probably had your upload session reset briefly as your provider recalculated a route back to us.

If you can get to dgrin, you can get to SmugMug... They are on the same network, and would be impacted equally with this incident tonight. If you are seeing other effects, it's something else.

Still having problems here. Something about the Java connection?

brandofamily · January 4, 2007

Is the server down?
Anything that links to SM is not showing up.. Server down?

DavidTO · January 4, 2007

Sure seems like it.

dogwood · January 4, 2007

brandofamily wrote:

Anything that links to SM is not showing up.. Server down?

Seems like it's related to this:

http://www.dgrin.com/showthread.php?t=50662

I'm still having troubles too... :cry

Wireless · January 4, 2007

The last ~10 minute outage was due to a snafu at one of our providers, sorry about that. They are recorrecting their configs now. We're back to a prior state that should have more stability.

I'm also checking with Limelight, another provider to see if they are having issues this evening. Update: They are not, but are indicating Comcast might be.

It's entirely possible there are multiple things going on tonight. The issue I'm working on is back into a state which is is not causing connectivity issues at the moment.

Shima · January 4, 2007

My mom was having troubles viewing some of my galleries tonight, guessing it was all related

That's a shame too since she doesn't get to check up on my site super often, and tonight was her night to sift through photos
...
I just told her to go back again tomorrow so maybe she'll look at even more this time

mpmcleod · January 4, 2007

Wireless wrote:

The last ~10 minute outage was due to a snafu at one of our providers, sorry about that. They are recorrecting their configs now. We're back to a prior state that should have more stability.

I'm also checking with Limelight, another provider to see if they are having issues this evening. Update: They are not, but are indicating Comcast might be.

It's entirely possible there are multiple things going on tonight. The issue I'm working on is back into a state which is is not causing connectivity issues at the moment.

Now I am getting a few photos uploaded followed by:

DavidTO · January 4, 2007

I can get on sometimes, but can't log in. Or if I can log in, I can't create a gallery.

It's wonky, for sure.

Rando · January 4, 2007

I'm on Mediacom in SW Georgia and my gallery doesn't load up. What gives?

Rando · January 4, 2007

Mine is now failing to open. Hope they get this straightened out soon, I have a bunch to upload tonight.

Cindy · January 4, 2007

Still can't upload here and...
...occasionally IE6 reports one of those stupid error pages... page not found.
Edit: Actually IE reports the page can not be displayed right now... try again later, etc., etc.

And here I was just trying keep my new years resolution to upload a daily pic daily (and now it's allready a new day)... So much for new years resolutions... wasn't my fault for breaking it this year though... :lol4

Dbl · January 4, 2007

Both my sites are down, pro site and personal. I have Comcast but I am having no issues on any other site except Smugmug.

SmugMug Network Connectivity Issues

Comments