I know it's a controversial change, but with time I hope you'll get used to it.
There might be a few messages missing for a while, but they'll come back. If the past 36 hours has been "listnook is on fire!", the analogous situation right now is that the fire is out, but the wood is still wet and smoldering. We'll be cleaning up for a while. Translated into reality: The site should still be wonky for another day or two, but *usably* wonky.
I know there are a lot of nerds in the audience dying for the full post-mortem, and I promise you'll get it. But ketralnis understands it better than anyone, and he hasn't been to sleep since Tuesday night.
So please be patient and pardon our destruction.
Can you post ketralnis's home number please, so we can all call him to thank him for his hard work?
45
raldiMay 6, 2010
+93
Each time he breaks the site, I'll post another digit of his number.
4
---
Edit: To be fair, this one was really a group-fail. But that's okay, because all of our phone numbers start with 4.
93
[deleted]May 7, 2010
+35
[removed]
35
[deleted]May 7, 2010
+3
[deleted]
3
trimalchioMay 7, 2010
+2
I love this, please make this a new rule for the listnook admins. Actually, I think all popular websites should have some mechanism like this to encourage responsible deployment.
2
jedbergMay 6, 2010
+47
867-5309
47
[deleted]May 7, 2010
+18
[deleted]
18
jedbergMay 7, 2010
+36
Yeah, but don't tell his girlfriend.
36
davidreiss666May 7, 2010
+6
Just don't tell either of them about the web cam in the shower.
6
galaxnMay 7, 2010
+19
867-5309*e-ein!*
19
[deleted]May 6, 2010
+9
[deleted]
9
SidzillaMay 7, 2010
+60
Just for the record, did you try turning it off and then turning it back on again?
60
raldiMay 7, 2010
+54
As a matter of fact, yes.
54
[deleted]May 7, 2010
+25
[deleted]
25
oditogreMay 7, 2010
+4
[You reminded me of this](http://www.youtube.com/watch?v=tDacjrSCeq4). Listnook admins, take note. :)
4
[deleted]May 7, 2010
+6
How many times?
It takes three, you know.
6
brendhanMay 6, 2010
+6
Okay let's look at some things here.
Thursday of last week.
Several sub listnooks lost their content.
Many users lost their comments and or saved sites.
Then yesterday listnook overall took a dive.
Several admins were rebuilding content for users and sub listnooks by hand.
Then listnook took a dive. My guess is that all the problems are related or
that in the rebuild by hand some forgot to close a function and it took going
through all the hand rebuilds to find the problem. Cassandra may have just been
the by product of a typo.
6
raldiMay 6, 2010
+22
Most listnook problems go like this:
* Things start to suck as we outgrow something
* We look into a more scalable solution
* We switch to it
* The new technology confuses us and we screw something up and everything really sucks a lot
* We fix it
* Two and a half months of peace and quiet
* Go back to Step 1
22
defrostMay 7, 2010
+3
If it's any consolation any job that involves cutting into new territory suffers a similar pattern; you've just summarised the past 30 years of my life on the bleeding edge.
3
[deleted]May 7, 2010
+2
Now you are talking brother programmer! That of course is if the pesky user doesn't ask for stupid features like logging in with biometrics through the computer screen.
2
[deleted]May 7, 2010
+4
> Many users lost their comments and or saved sites.
This happened to me last week, and I lost everything new since then *again* this morning.
4
jooesMay 6, 2010
+2
Speaking of the unread messages tab, what do we do if we have a message there that won't go away? I've had one there for months, and it's been bugging me.
2
raldiMay 6, 2010
+4
Click "mark as unread" then click it again to mark it as read.
4
jooesMay 6, 2010
+3
Tried it. No dice.
It's not a big deal or anything, I'm mostly just curious.
3
raldiMay 6, 2010
+3
How recently did you try? Can you give it one more shot?
3
jooesMay 6, 2010
+3
I went to try again, and now it's gone. Thanks :)
3
Psy-KoshMay 7, 2010
+2
Is he finally getting some sleep now or tonight at least?
2
raldiMay 7, 2010
+6
What am i, his sleep biographer?
6
[deleted]May 6, 2010
+2
You break logo again on OSX. Fix it *now*, underconsiderated admins. What am I paying Comcast for?
2
raldiMay 6, 2010
+3
I don't think we touched the logo. Can you post a screenshot?
3
KaninMay 6, 2010
+1
So I'm going to collect the downvotes, but I can't help but notice the mailbox is order of magnitude f****** faster, and it was fixed in less than 24 hours. All it took was a major outage, and not hundreds of posts for months about how slow the mailbox is. I'm going to hope the comment posting also got fixed and press 'save'. Huray for outages! And thanks.
1
raldiMay 6, 2010
+3
We keep stats on this sort of thing. Inboxes are actually slightly slower than they were a few days ago, but I think that's just due to everyone checking theirs out right now.
3
IcommentonthingsMay 7, 2010
+3
I'm glad everything is back but I would say if ketralnis understands it better than anyone he would have been to sleep in at least a day. There are a lot of us here who work on very high-availability and heavily used sites and most likely would have helped. The Open Source model can be used for more than just programming.
3
SteveAM1May 6, 2010
+2
Whatever. I liked the crashing inbox. This place just keeps getting worse and worse.
2
amatriainMay 7, 2010
+1
New listnook feature: "it doesn't crash. Much."
It sounds underwhelming, but I'd settle for this in most sites I visit.
1
raldiMay 7, 2010
+3
We are a humble people.
3
[deleted]May 6, 2010
+165
Can you make it a user-selectable option?
[ ] Only show new mail
[ ] Crash listnook
I know there are a number of long-time listnookors who will like to retain the other option in case we need to get some work done.
165
workroomMay 7, 2010
+40
Shame on you Gimli, you forgot
[ ] My axe
40
[deleted]May 7, 2010
+87
I already have that option.
87
snowydayMay 7, 2010
+25
And you have my bow.
25
[deleted]May 7, 2010
+17
[deleted]
17
carpetbowlMay 7, 2010
+12
And you have my bowl.
12
biasedvoteMay 7, 2010
+8
And my vote?
8
dopplexMay 7, 2010
+2
This is just another example of Listnook not caring about the needs of the Legacy userbase. I have code that depends on that crashing behavior. It is entirely unacceptable for Listnook to break backwards compatibility like this.
2
diamondjoMay 7, 2010
+17
What I love about Listnook is that as much as we take the piss out of things (search anyone?) we generally don't get all pissy when the site goes down - we feel we know the admins or they at least exist in our monkey-sphere. When the site goes down we don't call the devs retards (we know it's a scaling problem because our community is so big now), we're more interested in finding out what happened in detail - just for the nerdy pleasure of it.
17
[deleted]May 6, 2010
+171
[deleted]
171
jedbergMay 6, 2010
+120
At least your glasses didn't break.
120
[deleted]May 6, 2010
+22
Probably misses his old glasses.
22
[deleted]May 7, 2010
+7
http://www.imdb.com/title/tt0701065/quotes
7
[deleted]May 7, 2010
+5
That's where it's from, you betcha.
5
mao_nekoMay 7, 2010
+3
His eyesight isn't that bad, he can still read the large print books.
3
[deleted]May 7, 2010
+2
If there was a pending apocalypse, and I wore glasses, I'd get a pair of those [prescription goggles basketball players wear](http://www.nba.com/media/act_horace_grant.jpg).
2
GaelachMay 6, 2010
+7
Kinda like how Will Smith would procrastinate in that film with the zombies
7
[deleted]May 7, 2010
+1
OK thats great, now can we have them hyperlinked by thread they reply to? Thanks. But seriously after all the hard work take the weekend off and get onto it first thing monday morning.
1
karambahhMay 7, 2010
+2
It may have nothing to do with the current issue, but I can't seem to review my comments. I see one submission I made, but not the comments, although they are seen by others, since I receive answers...?
2
mrmojorisingiMay 6, 2010
+1061
Thanks for all the hard work. You'll be happy to know that I'm back to procrastinating in full form.
1061
neithernetMay 6, 2010
+488
I was gonna post that same sentiment, but I figured I'd get to it later.
488
krispykrackersMay 6, 2010
+270
[placeholder for future comment]
270
AzuredMay 6, 2010
+168
[placeholder for witty rebuttal to krispykrackers]
168
[deleted]May 6, 2010
+146
[deleted]
146
ExotriaMay 6, 2010
+172
[vicious karmawhoring retort about you not contributing anything useful to the thread, subtly increasing size of my e-pee]
172
CoolCucumberMay 6, 2010
+59
[offhand reference to narwhals and/or bacon]
59
PhilosoraptorMay 7, 2010
+63
[somehow spins it into a vitriolic rant about Fox News]
63
DEADB33FMay 7, 2010
+74
[hitler]
74
ExotriaMay 7, 2010
+55
[anecdote about how whenever I see the children's book about baseball "How to be a Better Hitter" I always read it as "How to be a Better Hitler"]
55
SarcasmAnonymousMay 7, 2010
+23
[Godwin's Law]
23
phobiacMay 6, 2010
+94
[request for a hamburger]
94
moskieMay 6, 2010
+66
[pun]
66
midd_ninjasMay 6, 2010
+86
[unp]
86
[deleted]May 6, 2010
+74
[Usual, slightly off comment that stops pun thread]
74
[deleted]May 6, 2010
+13
http://imgur.com/3JzTg.jpg
13
jcreadyMay 7, 2010
+7
[placeholder for asinine remark questioning how [pun] got less karma than [unp]]
7
[deleted]May 6, 2010
+11
[deleted]
11
JakestabMay 6, 2010
+21
[placeholder for rage against repeating comments]
21
AnathemMay 6, 2010
+17
[placeholder for future tl;dr]
17
VerySpecialKMay 6, 2010
+27
I like turtles
27
naturelover47May 7, 2010
+10
[placeholder for [placeholder]]
10
AzuredMay 6, 2010
+33
I had such a bad day at work yesterday. I actually did some.
33
monkeybreathMay 6, 2010
+8
I got in to work on time this morning. My boss looked at me like I had two heads.
8
RobbieGeeMay 6, 2010
+22
I used the term "procrastination" to a friend and he asked me what it meant. I told him I'd explain it to him later.
22
klobbermangMay 6, 2010
+353
I demand a "I survived the great listnook crash of 2010 and all I got was this stupid trophy" trophy!
353
jedbergMay 6, 2010
+285
Giving out that many trophies might cause problems.
285
[deleted]May 6, 2010
+220
At which point you would be required to issue even more trophies...
220
skydivingdutchMay 6, 2010
+198
It's trophies all the way down!
198
TenTonMantisMay 7, 2010
+155
I don't think listnook can handle that sort of entrophy...
155
almuricMay 7, 2010
+30
I await site melt-down with trophydation
30
[deleted]May 7, 2010
+9
Bit of a stretch of the imagitrophy here.
9
tsondie21May 7, 2010
+15
something something something atrophy!
15
almuricMay 7, 2010
+8
I see your lips move, but all I hear is, "Trophy, trophy, trophy."
8
jstddvwlsMay 7, 2010
+3
This one actually was lolable!
3
bdfortinMay 7, 2010
+7
*Finally,* infinite trophies!
Wait, maybe just issue the one, meta-infinite trophy?
7
gabe2011May 7, 2010
+11
I found the *loophole*....
**L O S T**
11
krispykrackersMay 6, 2010
+38
You could make it a t-shirt!
You could also make onesies that say "5/5/10- Never Forget" and start selling them in nine months.
38
jedbergMay 6, 2010
+76
I'm not sure I'd want either of those things on a piece of clothing.
But I'll say this -- if anyone who reads this has a child and can reasonably prove it was conceived on 5/5/10, i'll send you a free listnook onsie.
(up to 3 babbys)
76
krispykrackersMay 6, 2010
+122
Or the onesie could say "I survived the great listnook crash of 2010 and all I got was this stupid baby" but that might not be funny to some people...
122
neshcomMay 6, 2010
+69
Babies have no sense of humor.
69
dunmalgMay 6, 2010
+49
Babies are also provably stupid. As I have demonstrated to friends and relatives with babies, they repeatedly fall for the most transparent of ruses. They're all little dumbasses!
49
TenTonMantisMay 7, 2010
+31
They're also incredibly rude! I had one defecate itself DURING DINNER!
Seriously? Are these the kind of manners people are teaching their babies?
Totally unacceptable.
31
robotempireMay 7, 2010
+15
Fortunately they fit conveniently into many garbage disposals
15
TomTheGeekMay 7, 2010
+4
Why waste a good baby? They have lots of good recipes over at /r/atheism/.
4
davidreiss666May 7, 2010
+3
I haven't run into a baby that knew how to fight properly either. I always solidly defeat them in battle. At most they have ever taken me down is twice, but I fell on them the second time and got the pin.
3
grungefanMay 7, 2010
+6
Stupid babies need the most attention.
6
[deleted]May 7, 2010
+4
[If you don't find it funny then you are a socialist.](http://mostlymemes.spreadshirt.com/downtime-A6002159)
4
jedbergMay 6, 2010
+15
Ok, I don't normally do this, but
LOL
I actually laughed, out loud. Good one krispy.
15
grooviegurlMay 7, 2010
+8
F***. I have to go find someone willing to bone. I'm behind schedule.
8
[deleted]May 6, 2010
+8
...Where "reasonably prove" means "upload the video to gonewild"? I like the cut of your jib.
8
jedbergMay 7, 2010
+5
I was thinking more along the lines of some math backtracking the date of conception like the doctor give yous. But whatever.
5
airbubbleMay 7, 2010
+4
i dont have any trophies :( just dust
4
[deleted]May 7, 2010
+11
\*CoughVerifyYourEmailCough\*
11
AzuredMay 6, 2010
+68
> I know there are a lot of nerds in the audience
Saying there are a lot of nerds on Listnook is like saying there are a lot of junkies who do drugs.
68
throwaway123454321May 6, 2010
+116
I'm starting a new group,"1,000,000 Strong to Bring back the Old Unstable Listnook" if anyone would like to join me!
116
JakestabMay 6, 2010
+40
Pff, facebook groups don't accomplish anything. Everybody knows that real power comes in the form of a fox news poll.
40
draconneryMay 6, 2010
+20
[Joining a Facebook group about ... getting anything done, really ... is like buying a chair about jogging.](http://twitter.com/hotdogsladies/status/1371419261) (Warning: link is simply to twitter post with very similar text.)
20
ChokingVictimMay 7, 2010
+5
When just that face loaded on the left for a split second, I thought you somehow planned a super troll-face-that-looks-nothing-like-a-troll-face maneuver.
5
FausterMay 6, 2010
+11
Yeah, facebook groups don't accomplish anything, only voting up articles on listnook accomplishes anything!
11
Measure76May 7, 2010
+3
You've inspired me to wish someone would make a facebook group "1,000,000 strong against facebook groups" so I could join it if I ever remembered to.
3
[deleted]May 6, 2010
+8
Stability and usability is not what the kind of values the Founding Programmers intended. It was about Bacon and Narwhals not some big interweb handout of stability for those that aren't willing to work hard at making witty retorts. Down with these liberal commie programmers that are RUINING our site!
8
throwaway123454321May 7, 2010
+3
Exactly! Why is it that the values, configurations, and scripts that were good enough for our grandparents not good enough for us anymore? I think its high time we do something about it!
[Starts to smoke weed]
High time achieved. What were we fighting about?
3
[deleted]May 7, 2010
+1
I still think there should be better options for sublistnook promotions when you get around to it.
1
[deleted]May 6, 2010
+20
[deleted]
20
krispykrackersMay 6, 2010
+12
I think it's due to [this suggestion](http://www.listnook.com/r/ideasfortheadmins/comments/c0qp2/my_first_suggestion_to_listnook_i_think_this_would/c0piigc?context=2) in /r/IdeasForTheAdmins :)
12
[deleted]May 7, 2010
+7
I was actually trying to submit a comment blaming it on [this submission](http://www.listnook.com/r/ideasfortheadmins/comments/c030s/free_cold_beer_for_listnook_admins_on_hot_days/) when listnook was crashy, but couldn't get through.
7
jedbergMay 6, 2010
+5
No, not at all. Because the inboxes are precalculated, it takes just as long to show only the unread as it does to show the entire history.
5
pspbiniMay 6, 2010
+137
Thanks for remembering us post-mortem people. Can't wait for the writeup.
137
AzuredMay 6, 2010
+56
Ahhhh zombie nerds! High probability of uncleanliness!
56
[deleted]May 6, 2010
+10
I shower every single day with actual soap and water and real scrubbing with a clean wash cloth thank you very much!
10
[deleted]May 6, 2010
+19
[deleted]
19
nrfxMay 7, 2010
+6
*--reads user name--*
nah....
6
[deleted]May 7, 2010
+2
Lol, I weigh 130 lbs. That's not a lot left over after skeleton and organs for "rolls".
2
addakornMay 7, 2010
+12
I am twice the man you are. No really, I am.
12
[deleted]May 6, 2010
+12
I've been feeling the same way! I've been looking listnook's blog with anticipation for the full gory details of why the site crashed down in flames in the middle of a rural area.
12
philoniusMay 7, 2010
+2
Preliminary findings indicate that several heroic listnookors wrestled the site away from admins and forced the crash.
2
tlrobinsonMay 7, 2010
+3
Yeah, post-mortem writeups are like nerd p***.
3
wonkifierMay 7, 2010
+38
> The site should still be wonky for another day or two
Well, my job here is done
38
ExotriaMay 6, 2010
+22
Many women who do not dress modestly lead young men astray, corrupt their chastity and spread adultery in society, which consequently increases listnook failures.
22
shrodikanMay 6, 2010
+17
I support a listnook boobquake in response to this ridiculous statement!
17
[deleted]May 7, 2010
6/5 never forget.
0
raldiMay 7, 2010
+3
Why, what's gonna happen then?
3
soxpqnMay 6, 2010
+15
I like being able to check my messages. Upvoted for innovation.
15
outspokentouristMay 6, 2010
+15
Can you make it play a, "You've got mail!" sound when we have messages?
15
mtnkodiakMay 6, 2010
+7
google "listnook addict lite". :)
7
sirbruceMay 7, 2010
-2
Thank you. However, taking an hour or two out of fixing the problem to communicate more would have been acceptable.
-2
raldiMay 7, 2010
+5
We didn't have the answers at the time.
5
SailerMay 7, 2010
+4
Oh good. A guy who hasn't slept in 60 hours is fixing things. This should be good.
And please, no downmods just because I have a sense of humor that is dryer than the Sahara. In all seriousness, listnook is running better than ever, and that's a fact.
4
erodeMay 7, 2010
+1
Is it also a feature where clicking "reply" doesn't give you a way to send a reply? The only one that works for me is the default reply box on main posts, oh and the edit button.
1
jojokoMay 7, 2010
+1
listnook is broken again, i can't reply to comments. but i can make my own comment. (if that makes sense?)
hitting reply says javascript void
1
bvmMay 6, 2010
+7
I enjoyed the suspense. I used the waiting time to imagine the KERRAAAZZZYY things people would reply to me.
Not to be to fanboyish, but - thanks for the hard work, and for this great... eh... pre-post-mortem.
Edit: spelling
6
CaptainRecursionMay 7, 2010
+5
I'm sorry, but this new feature is the final straw that broke the camel's back. I'm going back to Digg.
5
malnourishMay 6, 2010
+5
If ketralnis would like some of my methylphenidate, I'll be willing.
(just kidding DEA)
5
trim17May 6, 2010
+22
Can we get an option in the preferences to bring back the old behavior?
22
jedbergMay 6, 2010
+42
There's always one of you, isn't there. :)
42
trim17May 6, 2010
+15
I created an account specifically for "compress the link display".
15
ketralnisMay 6, 2010
+17
Both of you that still use that interface are really holding back progress ;)
17
theram4May 7, 2010
+9
Well, I still use the compressed display too. I just think it looks better.
9
[deleted]May 7, 2010
+4
TIL compressed display is not the default.
4
donaldrobertsoniiiMay 7, 2010
+6
Trim17 and I are the only true listnookors left.
6
bsdboyMay 6, 2010
+5
But crashing the site gave me a sense of accomplishment.
5
headintheskyMay 6, 2010
+5
I'm still getting gateway 504's checking mail - is that still supposed to happen?
5
ghan-buri-ghanMay 6, 2010
+3
I can't wait to start saying things like: "I used listnook *before* it worked!"
3
thesnarkyoneMay 6, 2010
+7
Thanks for the hard work and keeping our little community together.
7
patruskMay 6, 2010
+6
I thought that was a feature.
6
[deleted]May 6, 2010
+6
It was just a tease to get you hooked, if you want that feature back you'll have to sign up for Listnook Gold.
Just send me some money and I'll get you started on it.
6
TartantycoMay 6, 2010
+5
I prefer the site-crashing feature.
5
wisamMay 6, 2010
+3
So when the website "crashed" when one clicked on the envelope, that was just an unintended feature and not a bug?
3
ParticleGirlMay 6, 2010
+3
who says it was unintended?!
3
[deleted]May 6, 2010
+2
How long will it be til someone posts a link to a Facebook group saying "Get 1million members and Listnook will revert it's new mailbox"
Then we'll get another topic about how said Facebook link is the work of the FBI/CIA/KGB/SAS/Madagascarian Government (whatever form it may take)
2
esotericguyMay 7, 2010
+2
So the servers just happened to go down on Cinco de Mayo? Don't lie to me raldi, you guys started partying early and someone spilled a bunch of beer on the servers didn't they?
I'm going to go ahead and say it was kn0thing that did it.
2
[deleted]May 7, 2010
+2
I'm still not quite sure it's working...I logged in today to find my inbox full of dozens of messages from 2 months ago. I'm pretty sure you're already aware of this, but figured I'd let you know just in case it's a unique issue.
2
onthesubMay 6, 2010
+3
Thanks for keeping my procrastination habits alive, now get some sleep! :D
3
13renMay 6, 2010
+3
Without listnook, I find that I don't procrastinate efficiently.
3
[deleted]May 7, 2010
+2
[deleted]
2
CuteSheepMay 6, 2010
+3
DUDE, WHERE'S MY OLD MESSAGES? ME WANT MAH MONEY BACK!
3
pdincMay 6, 2010
+2
And here I was, thinking I was special because I was breaking the site so often.
Guess im not as 1337 as I thought I was.
edit: facepalm. was originally 7331.
2
ParticleGirlMay 6, 2010
+7
isn't teal a color?
7
EtchiiMay 6, 2010
+2
[Teal is a medium blue-green color. It is named after the common teal, a member of the duck family, whose eyes are surrounded by the color. The complementary color of teal is coral pink.](http://en.wikipedia.org/wiki/Teal_%28color%29)
2
buba1243May 7, 2010
+3
Does this mean we will get our comments back too?
3
n3xg3nMay 6, 2010
+2
Change Bad! Rwar, bring back the old inbox feature! It's not fair, this "feature" wasn't told to us before hand. I'm turning AdBlock back on gwarrrrr!!!!!
2
kingsixxMay 7, 2010
+2
I got a question. Do all of these improvements get committed to the opensource repository for people that run their own listnook clones to checkout?
2
fireburtMay 7, 2010
+2
I'd just like to thank the listnook admins to wait until my finals were over to fix the site. With your help I think I may have aced all my finals.
2
[deleted]May 6, 2010
+2
You should really consider patenting this idea. I'm no lawyer but I'd be willing to be Google would buy the f*** out of something like that.
2
davodrumsMay 7, 2010
+3
Back to the usual Gateway Timeout! Perfect!
3
[deleted]May 7, 2010
+4
<3
That is all.
4
dxcotreMay 7, 2010
+2
Maybe you should let keltranis get some sleep. I think we can let an extra 8 hours go by with wonkiness.
2
MindStalkerMay 7, 2010
+2
To summerize:
b**** b**** moan moan
listnook is free, why are you complaining
b**** b**** moan moan
2
TenTonMantisMay 7, 2010
+2
Is there a way to set up our mail so that it can still crash the site if we liked the old way better?
2
Trent1373May 7, 2010
+2
I was wondering why I couldn't post any comments or a reply, they would simply just disappear.
2
Toe-BeeMay 6, 2010
+2
Just to clarify; old messages that disappeared WILL be returning? Not just new mail?
Thanks
2
ketralnisMay 6, 2010
+3
That's the idea, but we persistently cache those listings and after they broke we're now going to have to go and re-calculate them for *everyone* so it could be a while
3
defrostMay 7, 2010
+3
Go to sleep, despite what they say no nerds will die if the mail is late . . .
3
[deleted]May 7, 2010
+3
Was it the Flux Capacitor?
3
takfamMay 6, 2010
+2
You don't know what you've got 'til it's gone. Thanks for the hard work admins!
196 Comments