Sorry. Added:
> TLDR: open source is great, and embed.ly has helped us double the number of sites our media scraper knows about (so you can watch more videos in listnook from more sources by clicking the play button).
31
[deleted]Apr 30, 2010
+10
The problem is more that not very many know what your media scraper *is*.
I had to read the linked source to figure it out.
10
starkinterApr 30, 2010
+43
In case anyone else is wondering, and couldn't be bothered reading the linked source, a media scraper is a device which scrapes media.
43
SupYall_ImATrollApr 30, 2010
+4
Can you please rephrase this in Englihs...
4
starkinterApr 30, 2010
+14
It's like an ice scraper. It scrapes the ice (media) off the windshield (internet?)
14
creaothceannApr 30, 2010
+1
Webpage.
1
[deleted]Apr 30, 2010
+1
Webbage.
1
sayitloudMay 1, 2010
+5
cabbage
5
arjieMay 1, 2010
+1
Charles Babbage.
1
raldiMay 1, 2010
+1
on.
1
KeyserSosaApr 30, 2010
+8
Point taken. I'll amend the post to make it clearer.
8
Superdude22Apr 30, 2010
+5
Maybe add a video?
5
WhiteMouseApr 30, 2010
+7
Maybe we can scrape the video with Listnook's API!
7
Samus_May 2, 2010
+2
unrelated but why do I have to wait ten minutes to post a damn comment now? it's very annoying, can you at least lower it to a minute please?
2
raldiMay 2, 2010
+2
There was no change to that part of the code; whenever you post for the first time in a new listnook there's a once-every-ten-minutes limit that goes away as soon as you get even a tiny handful of upvotes.
Sorry for the annoyance, but it's been that way for years. We'll discuss in the office on Monday, though, to see if it might be time to rethink it.
2
Samus_May 2, 2010
+1
huh? what's the point of doing that? it certainly looks new to me because this sublistnook is also relatively new (and low traffic) but again what's the point of throttling discussion on newly created sublistnooks? doesn't that *hurt* them, since people won't be able to participate and get things rolling?
anyway, another question also unrelated since the last few weeks I've noticed that every time I try to read my messages I get a "gateway timeout" error, it sounds reasonable to give priority to other pages but maybe you need to calibrate that a bit (it works fine after a reload but even so isn't "normal" behaviour).
1
raldiMay 2, 2010
+2
Otherwise, a spammer could make their own listnook (or go to circlejerk), get some karma, and bypass all the throttles sitewide.
2
Samus_May 2, 2010
+1
I thought that was filtered based on the message contents, in fact I could sell my account and bypass all those filters you mention (it's a one-time deal, but filtering by content would work on both situations).
1
[deleted]May 1, 2010
+2
where is the source code for embed.ly?
2
Samus_May 2, 2010
+1
can you tell this guys their http://api.embed.ly/about and http://api.embed.ly/contact pages linked from http://api.embed.ly/ are 404s? and to also put them on the frontpage once they're fixed. thanks.
1
agibbyMay 2, 2010
+2
Thanks, we took those links down for now. Plan to do something on the main site soon. If you are interested in some info drop us your email or throw in a support ticket. Thanks for finding this.
2
tesseracterApr 30, 2010
+2
removing all doubt, as always.
2
drtyfrnkApr 30, 2010
+2
Yep, I'm in the same upboat as you.
2
peokukApr 30, 2010
+4
Which embeds did you have before? besides YouTube?
4
KeyserSosaApr 30, 2010
+13
This is our previous list of test urls:
http://code.listnook.com/browser/r2/r2/lib/scraper.py#L688
They've been a pain to maintain as a lot of those embed codes aren't really set in stone and require a certain amount of upkeep. We're glad that we can offload the work to some guys who specialize in it.
13
gpojdApr 30, 2010
+12
So you guys rickrolled yourselves every time you tested this feature?
12
KeyserSosaApr 30, 2010
+20
We set our test suites for maximum snark.
20
raldiApr 30, 2010
+12
It's a good song.
12
IlyanepApr 30, 2010
+5
I love how many of those test URLs are Rick Roll related.
5
The_HegemonApr 30, 2010
+2
Damnitt I just got meta rick-rolled!
2
tesseracterApr 30, 2010
+1
vimeo, escapist, ted, audio stuff... probably some more.
1
[deleted]Apr 30, 2010
-8
> contributions aren't yet reflected in the repository
Is this why my comment history disappeared?
-8
KeyserSosaApr 30, 2010
+6
No that's an unrelated data integrity problem we had surprise us yesterday morning at the crack of dawn. We're recomputing profile pages from the db now and, in fact, I just did yours.
6
[deleted]Apr 30, 2010
+3
[deleted]
3
KeyserSosaMay 1, 2010
+1
I rebuilt your page from scratch. Did that take care of it?
1
screeleyApr 30, 2010
+28
Let us know what video/image providers you want to on Listnook. We'll add them to Embedly.
28
[deleted]Apr 30, 2010
+32
[deleted]
32
jedbergApr 30, 2010
+30
Your friend forgot about p****** and x******.
30
skeritApr 30, 2010
+9
No love for xtube?
A friend of mine wants to know...
9
[deleted]May 1, 2010
+11
I just want to clarify that I'm the friend that echochamber, jedberg, and skerit are referring to
11
[deleted]May 1, 2010
+2
And the plethora of other p*** streamers.
2
screeleyApr 30, 2010
+3
We are getting into a deep dive there. Generally Brightcove is only embedded in pages. We are starting to work with some news organizations to expose those videos in a better manner.
I think there might be a market for a embedporn.ly or redembed.ly someone go register it.
3
nextofpumpkinMay 1, 2010
+2
Can you just use your existing infrastructure for it? It seems like a lot of work for someone to start all over on. P*** is big; you obviously don't want to ignore the market, but your sponsors will drop you if you get into the market. Cant you guys just start a side operation to leverage your expertise?
2
[deleted]Apr 30, 2010
+3
Ugh Brightcove.
3
[deleted]Apr 30, 2010
+4
[deleted]
4
screeleyApr 30, 2010
+5
I'll take a look at it. Thanks.
5
[deleted]May 1, 2010
+4
Edited:
Should mention that everyone recommending links should check here first: http://api.embed.ly/
4
f8andbethereMay 4, 2010
+1
Funny Or Die.
There is a video on the front page right now that isn't being picked up by Embed.ly / Listnook even though they have a prominent embed tag.
1
f8andbethereMay 4, 2010
+1
edit: it is on your list of supported content providers but it isn't being picked up right now as an embeddable video (see White Women Workout on front page).
1
Poop_is_FoodApr 30, 2010
+1
Just curious, are you getting paid for this?
1
bostonvaulterMay 1, 2010
+5
Well, it's a startup, so define "paid"
5
Poop_is_FoodMay 1, 2010
+1
receiving money in exchange for product or service. even startups charge their customers
1
[deleted]May 1, 2010
+3
>even startups charge their customers
Oh. So that's why my startups keep failing.
3
YserbiusApr 30, 2010
+111
Before you know it, some guy will fix the search!
111
jaggederestApr 30, 2010
+54
Doing that right now.
We'll see if they accept my patch...
54
raldiApr 30, 2010
+51
Just [make sure it scales](http://www.listnook.com/r/programming/comments/bcqhi/listnooks_now_running_on_cassandra/c0m3rxx?context=1).
Okay raldi, suppose *someone* with a background in information retrieval (cough), search engine tech deployment (cough), and distributed systems engineering (cough) wanted to *start* hacking away at a better search option. Obviously this is a very non-trivial problem, but are there any guidelines or high-level design principles you'd want such a person to follow? Any potential design docs or specs to start with?
There's little chance one person could get it all done, but if you had some sort of guiding document or spec maybe several experienced contributors could pile stuff on over time?
3
raldiMay 1, 2010
+3
The problem is really just one of money. Right now I think it would be better for the admins to focus not on coordinating a crowdsourced search redesign, but rather on getting our revenue up so we can simply purchase a better search solution.
I don't think with our current budget we can program our way out of the problem.
3
nextofpumpkinMay 2, 2010
+1
Makes sense; thanks for the transparency! :)
1
jedbergApr 30, 2010
+5
That's the idea.
5
[deleted]Apr 30, 2010
+2
Upvoted for optimism!
2
jweganApr 30, 2010
+7
Have you guys tried using [autoembed](http://autoembed.com/)? Its a open source package that supports embedding video from over 160 sites. If you guys have checked it out and decided not to use it, I'm curious why.
7
THE_PUN_STOPS_HEREApr 30, 2010
+2
Well, judging by the blog post, they wanted a service they wouldn't have to deal with themselves to update.
Also, I'm guessing embed.ly is more scalable than autoembed.
2
jweganApr 30, 2010
+5
AutoEmbed is open source so they don't need to do the updating themselves. Also it is pretty well maintained, the last update to it was a couple months ago which isn't bad considering new video sites with a large enough following to be relevant aren't popping up every day.
Also scalability isn't really an issue. For 95% of the websites sites you just need to parse the video id out of the URL. Embed.ly is actually probably less scalable for listnook since they need to make a request to the embed.ly servers each time rather than just parsing the URL locally.
5
[deleted]May 1, 2010
+1
The difference is that the listnook developers would have to take time to integrate autoembed with existing code, but the embed.ly guys did that work themselves. Convenience trumps open-source, especially if you are busy working on more urgent issues.
1
jweganMay 1, 2010
+1
Its not that hard, I integrated auto embed with my code in literally like 5 minutes including testing. It took all of 3 lines of code. It looks like this
$AE = new AutoEmbed();
$AE->parseUrl($url);
$code = $AE->getEmbedCode();
1
hobophobeApr 30, 2010
+7
Sounds like a very cool product.
Is this why submissions to Youtube videos that disable embedding no longer get a video button? Very nice, either way.
7
mrzubiApr 30, 2010
+2
But they did run the risk of wasting time/money on something that wasn't a sure thing. If you did this for every client in the graphic design/web design business, where would you be? and what is stopping you from just stealing the idea after the pitch?!
It's just me being paranoid, or hearing not to work to hard on a finished product until you have a contract.
Good work embed.ly, thanks for making listnook happy. :)
2
oldeggApr 30, 2010
+5
"tldr" annoys me. Why does it always appear *after* the text? By the time I finish reading, I don't need the summary! What's wrong with writing a good thesis statement?
5
polyGoneApr 30, 2010
+2
Obviously, you're not too lazy! :)
2
[deleted]May 1, 2010
+3
I've often wondered how some listnooks receive downvotes.
Like, how could you be AGAINST this announcement?
3
[deleted]Apr 30, 2010
+2
You still need to allow the submitter to select the thumbnail and the video (when there is more than one choice), or whether to not include a thumbnail or video (when none of the choices are relevant to the submission).
2
tell_me_moreMay 1, 2010
+2
Thanks for linking their logo to a picture of their logo. I was totally expecting to see a picture of their logo, and not, you know, their website.
2
agibbyApr 30, 2010
+2
Just want to make sure we give some credit to the creators of oEmbed (http://oembed.com), can be used anywhere you want content for links.
2
jckApr 30, 2010
+3
how about embedding images too, like videos?
3
jjmclaneApr 30, 2010
+2
Thank you very much! i was about to build my own media scrapper in PHP for a site i'm programming.
2
[deleted]Apr 30, 2010
+3
We developing alright!
3
[deleted]May 1, 2010
+3
[deleted]
3
[deleted]May 1, 2010
+3
I just wanted to add support to this comment, because it seems no one else cares about this.
Damn it, it's been well over a year now. Unfortunately, I can't go through my old comments to find a more accurate date.
3
[deleted]May 3, 2010
+1
[removed]
1
tvshopceoMay 3, 2010
+1
I don't like the noisy thumbnails either, but the embedded media only opens and plays if you actively let it. What's the problem with that?
It also shouldn't be hard to make a gray play-icon that is the same height as one line of text to make it fit the low-key design.
1
gustavoprApr 30, 2010
+2
The link for the comments on the blog entry is broken...
2
A-punkMay 1, 2010
+2
Really Listnook? 604 upvotes for witchcraft?
2
[deleted]Apr 30, 2010
+1
[deleted]
1
jedbergApr 30, 2010
+7
The updates are already live. We're just making them public.
7
[deleted]Apr 30, 2010
+1
Ah, all right then. Misinterpreted.
1
aftliApr 30, 2010
+1
> (so you can watch more videos from more sources in listnook by clicking the play button).
I rarely use that as it sometimes takes upwards of 10 seconds (even slower than the front page) to load the pop-up. It's faster to middle-click to a new tab and watch in YouTube.
1
polyGoneApr 30, 2010
+2
Really? I'd imagine loading just the swf, via js, would be quicker than loading the entire site. What are you working with?
2
aftliApr 30, 2010
+1
My browser always hangs waiting to load the embedding code from "listnookmedia.com". I might have been exaggerating about the 10 seconds, it's more like 5 usually. Still quicker to load the YouTube page.
1
polyGoneMay 1, 2010
+2
I do get an error in both the dev tools on Chrome/Safari and in Firebug, but it still seems to load quickly. Seems to be bitching about, what appears to be, an XSS request.
2
lalaland4711Apr 30, 2010
+3
So... have you found the comments you lost yet?
3
jedbergApr 30, 2010
+5
The splines are reticulating now.
5
lalaland4711May 1, 2010
+1
> The splines are reticulating now.
[Roger that, alert the agents](http://www.xkcd.com/733/)
(saw explanation below. Goody!)
1
[deleted]May 1, 2010
+1
[deleted]
1
jedbergMay 1, 2010
+3
It means yes. We are recalculating the lost cache data now. We hope to be done sometime this weekend.
3
kefsApr 30, 2010
+2
mines are still missing
2
barfolomewMay 1, 2010
+1
That's great!
Now can you make www.listnookmedia.com less laggy? It shouldn't take 20s to display an embedded youtube clip.
PS - it is sad that a three-paragraph article requires a TLDR.
1
sirbruceApr 30, 2010
-1
> Their contributions aren't yet reflected in the repository because, as you may have noticed, the repository is still a little bit behind our production branch. We're sorry about that, and we're going to merge up next week as we have a bunch of long term projects coming to a conclusion. In addition to the new media scraper, the updated version will include our move to Cassandra, the new spam control measures, and all of our new sponsored link code.
Bad idea. Never roll out multiple major changes at once. When something breaks, you won't know which part was the cause.
-1
jedbergApr 30, 2010
+15
No no. *We* roll out one change at a time. Then we publish a couple of them together for the public source, but they have all be deployed and tested independently by us.
15
sirbruceApr 30, 2010
+7
Ohhh. Yeah, I read that backwards.
7
DerelicteMyBallsMay 1, 2010
+1
So this is the official comment page for the blog post? If you've got experience with DataTypes, please reply here.
1
[deleted]Apr 30, 2010
+1
Man, can't you guys hold off on making this site even cooler until *after* my finals are over?
Maybe if I created an AskListnook thread about getting my work done...I wonder how many replies I'd get....
1
ToddPackerMay 1, 2010
+1
This companies product is actually relevant to my interests, thanks for bringing them to my attention!
1
rseymourApr 30, 2010
+1
Yay, the one thing I ever tried to commit to trac (bug 708) has been majorly squashed!!! nice!
1
[deleted]May 1, 2010
+1
Free software is stupid. Why would anyone make ones work available for free, is beyond my understanding.
*Sent from my Chrome Browser running on Ubuntu 10.04*
1
efriqueMay 1, 2010
+1
I have upvoted you , but only ironically
1
blackyodaMay 1, 2010
+1
Yay! Now we can all experience 4chan with better code! Congratz!
1
newbie82Apr 30, 2010
+1
This is very cool! Go the listnook community
1
[deleted]May 1, 2010
Just one suggestion and I'm not going to read every comment before saying this. The play button is popping up under text posts instead of the plus button. Maybe they can fix that too.
0
Poop_is_FoodApr 30, 2010
-1
Yeah Open Source is great!!! Please tell me that they'll be receiving regular checks from Conde Nast for this service. Otherwise, working on spec for a large corporation in return for a pat on the back and cute icons sounds kinda lame and exploitative.
-1
DurrokApr 30, 2010
+2
They did it because they wanted to. It's not like they kidnapped them, held guns to their heads, and forced them to code it in. Plus it's free advertising.
2
Poop_is_FoodMay 1, 2010
-1
Good for them . I just think this headline is kinda stupid. How do you pitch your product to an open source company? Give it to them for free. Woohoo, BFD.
-1
[deleted]Apr 30, 2010
-1
[deleted]
-1
agibbyApr 30, 2010
+3
We plan on providing oEmbed Discovery, right now a lot of sites are not implementing it correctly, that has been a common theme that we are trying to fix with our service
As well supporting we also enhance them when we can, providing re-sizing, and the required attributes that follow the oEmbed spec (http://oembed.com)
3
Samus_May 2, 2010
+1
are you from embed.ly? if so check this: http://www.listnook.com/r/announcements/comments/bygpz/bloglistnook_now_this_is_how_you_pitch_your_product/c0p96rk
1
jedbergApr 30, 2010
+1
> a YCombinator start-up called embed.ly who, as you might have guessed, specialize in providing embeddable media using the open oEmbed standard.
1
[deleted]Apr 30, 2010
+1
[deleted]
1
agibbyApr 30, 2010
+2
Thats what I was referring to above, a lot of problems we see come from bad implementations and even bad discovery tags. We want to change that.
2
kubutulurApr 30, 2010
-2
problem with many products is that they haven't been engineered for expansion. Design patterns FTW
150 Comments