[15-Jun-2008] Downtime today

[hairingtons]

ive missed three turns. and also a whole turn that i took in a tournament game has been wiped. and doesnt exist. and my opponent has took advantage of this in all three games. very annoying.

[sensfan]

I would like this REMOVED from the freemium forces.

[nikola_milicki]

Conquer Club was down for most of the day today

My understanding of the events is this: something went wrong at the hosting company, and they switched to backup generator, which caused a problem with cooling fans, which made the temperature rise, which cased a filesystem error on our database server's, which caused the data to be corrupted and the database engine to crash. I was out of town and only became aware of this when the hosting company called me hours later, at which point they began to restore the database from a backup which thank-god was taken only about an hour before the site went down.

The game is back up, but over the next hour or so we'll be running additional repair processes on the forum data so some forum functions may not work for the next little while. The Game Logs for archived games need to be repaired - and that takes some time - so they may be missing for several days. Other than that I'm hopeful we'll have everything back up and running normally.

As for missed turns, I just added 12 hours to the round time of each active game. Unfortunately this time extension will not help everyone - if a game has already undergone an "end-of-round check" and someone missed a turn - it's too late and it can't be undone. I've never done this before so I hope there are no side-effects!

If you were in a speed game that was interrupted by the downtime, please open a support ticket from the Help page and we may delete it (reversing the points). All casual games will continue.

I'm really sorry about this. I'll keep you all posted of any developments and I'll be following this up with the hosting company and with myself to see how we can better handle such mishaps in the future.

for some of us just sorry wont do!!!!!!!!!!!!!!!
I spend a lot of my time here every day planning and thinking out my moves, then a crash happens and many games are lost and many important moves are missed, very important tourney moves or braking bonuses in games against strippers, that sucks!!!
like I said my time is worth more then just a single word starting with s

*very very disappointed*

[william18]

Grimm Mafia has disappeared. Can you please look on this.

[mulit]

we understand and aplaud
at war now!!!
this is the right attitude
let the others online games see and copy

[t-o-m]

I would like this REMOVED from the freemium forces.

oh go buy premium then you'll get moved from FF.
stop complaining - this is everywhere, so shut it.

[the_lion]

its ok lack, we still love you

f*ck that... this is shit. Turns were missed because of this "down time." No one thought to run some update statements that would give those who lost turns due to downtime the ability to take their turns. Unless you count whatever that shit is that some folks appeared to have 36 hours to take their turns. What a bunch of fucking amatures.

has your period passed now lion?

good now enough complaining, not lack's fault

When you dislodge lacks cock from your throat, perhaps you could actually read what I wrote. No one is laying blame on anyone for the system failure. Its the recovery plan that sucks ass. MANY people missed turns, which may have caused then their games. The way to reconcile this??? add a bunch of hours to a bunch of games that made zero sense??? Give me a break. How would I have done it you ask? lol well. I would not have brought the system back online until the solution to take the clock back had been in place.

but whatever, its only a stupid game site.

okay tom... you can spit now.

[t-o-m]

isnt mr lion the clever cloggs of the month, well done ass-wipe

just a stoopid gaming site? oh thats right, i remember now, the stupid gaming site that you payed $25 for! glad to see that you invest in other things that resemble you...stoooopid...

Its the recovery plan that sucks ass.

and that lack was out of town...

I would not have brought the system back online until the solution to take the clock back had been in place.

but then that means that poor people like you would start complaining and wanting the extra 3.5 cents back - dont you need that? that almost a whole years work...er i mean - lying around the cardboard box for the day. tell me, dick-face, do you think that you're better than lack and THE_LION KNOWS EVERYTHING! (because we know thats SO true...) he did what he thought right.

okay tom... you can spit now.

you seem to have a lot of experience with this...please tell us all more about your 'spitting' in the context that you're speaking of - im sure we'd all ebenfit from that extra bit of sleep whilst you speak.

well ta ta for now lion, dont get too horney with your remarks...

When you dislodge lacks cock from your throat,

isnt it nice (not really) that you have fantacies like that...

[wcaclimbing]

Just cause you can get to this thread from flame wars doesn't mean its actually a flame thread

[t-o-m]

Just cause you can get to this thread from flame wars doesn't mean its actually a flame thread

yeahh lion

[william18]

Grimm Mafia has disappeared. Can you please look on this.

[FloresDelMal]

Grimm Mafia has disappeared. Can you please look on this.

really we were more than 80 pages into the game

[william18]

Grimm Mafia has disappeared. Can you please look on this.

really we were more than 80 pages into the game

Heard Twill found it, just waiting for lack to check up on it.

[devinsaway]

is this like some debate thing???....anyway thx lack

[the_lion]

isnt mr lion the clever cloggs of the month, well done ass-wipe

just a stoopid gaming site? oh thats right, i remember now, the stupid gaming site that you payed $25 for! glad to see that you invest in other things that resemble you...stoooopid...

Its the recovery plan that sucks ass.

and that lack was out of town...

I would not have brought the system back online until the solution to take the clock back had been in place.

but then that means that poor people like you would start complaining and wanting the extra 3.5 cents back - dont you need that? that almost a whole years work...er i mean - lying around the cardboard box for the day. tell me, dick-face, do you think that you're better than lack and THE_LION KNOWS EVERYTHING! (because we know thats SO true...) he did what he thought right.

okay tom... you can spit now.

you seem to have a lot of experience with this...please tell us all more about your 'spitting' in the context that you're speaking of - im sure we'd all ebenfit from that extra bit of sleep whilst you speak.

well ta ta for now lion, dont get too horney with your remarks...

When you dislodge lacks cock from your throat,

isnt it nice (not really) that you have fantacies like that...

I guess you can't read. I didn't complain one time about the system being down... not once. I complain about the manner in which it was brought back on line.

I manage web sites for a living. Hell yes, there would have to be a recovery plan in place if the system goes down for any length of time. In fact, I believe that there is one, it just wasn't implemented today, for some stupid reason. I seem to remember this happening before.

And you're too funny... asking for advice on sucking cock. Apparently, not only do you suck, you are terrible at it. go figure. poor tom... a failure at everything you do. sorry to hear it pal, maybe you can be a success in your next life, or the afterlife, or whatever it is that you believe in.

[AndyDufresne]

I suggest moving most of your conversation, the lion, to the flame wars (or PM if you want to get into personal details ).


--Andy

[Gozar]

As others have said before me....

Hooray for missing turns!

*clap clap*......

[vampir2124]

just wondering, if the turns being missed in a tournament, were the cause of a swing in the tournaments result, whether this would just be considered the same as bad dice per se or if there were some recovery possible.

not going to get angry over it, just interested to see what is possible.

[Cubbiebum]

I lost four armies in the reset, a country, and missed a turn that I never had a chance of playing (no email notification and checked yesterday and said it wasn't my turn). Boy I love getting screwed out of a game.

[Twill]

Tournament games are at the discretion of the tournament organizer, so contact them to see if they want to count it or re-play it.

Cubbie, sorry you missed your turn, it doesn't happen often (or we try to have it not happen often). This downtime was out of our hands.

And on the upside, a RAM upgrade scheduled a couple weeks ago just went through. Lack will probably have more details for you tomorrow, but for now, the server is looking stable and all systems are green.

Oh, and lion, tom, flaming is not on here. It doesn't matter who started it.

Have a good one,
Twill

[Strider53]

[quote="Twill"]Simor, you're clearly upset, and going to keep pounding it home to us. We run our servers in one of the best data centers available right now. It's not cheap and it's not something that we skimp on - our servers, and their maintenance, are CC's single largest cost.

Twill - Simor seems to know a little about technology, but clearly does not really understand networking infrastructure technology at all. Shit happens with machines and technology. It cannot be prevented 100% of the time with ANY technology. A lot of people need to put a few hours of downtime on a game site in life perspective. You are being very patient with the whiners and complainers. I commend you for this as much as keeping the site up and running.

[jiminski]

Twill - Simor seems to know a little about technology, but clearly does not really understand networking infrastructure technology at all. Shit happens with machines and technology. It cannot be prevented 100% of the time with ANY technology. A lot of people need to put a few hours of downtime on a game site in life perspective. You are being very patient with the whiners and complainers. I commend you for this as much as keeping the site up and running.

sheese get a room..

[Twill]

Hey folks.

Some of you may have seen the 5 minute hiccup we just had.

It seems that a restore process left over from the weekend's crash decided to bork the server.
The bad news is that we had a few minutes of downtime while the server was crashing

The good news though is that Lack and Rackspace got to test out some of the new emergency response "stuff" they added after the weekend's crash and the two were talking with each other within a minute of the crash happening.

The problem should be fixed and shouldn't happen again soon.

sorry about the downtime.

Twill

p.s. for those of you who missed it, we do now have a lot more RAM in the server box now to. Check the announcement here

[Twill]

Quick update:

Things might be a little slow for the next few minutes as we check tables for data errors or problems.

This shouldn't disrupt games too much but is needed to make sure that everyone's games are still in one piece after the crash

Twill

[Twill]

Update 2:

Table checks done, no corruption found

Phew!

Everything should be back to normal now

Twill