Top Subject Matter Links

Shell City and/or Daily Rotation -- Got something to say?

Top Subject Matter Links

Postby bob » 01/24/10, 5:40 pm

I think I might dust off my old scripts to create most popular subject matter links on DR. So if Apple's big today, there'd be a link to all the Apple links. Maybe more refined than that, but you get the idea. The problem I had with it before was I was never able to fully automate it, and so I had to do a check of the final links before they went up. Got better ideas for complete automation now.... I'll post more after I find and look over my old scripts. They started, basically, with a word counter, and then various filters....
WYSIWTF
bob
BIG GIANT HEAD I Get Free Beer
BIG GIANT HEAD I Get Free Beer
 
Posts: 7565
Joined: 12/03/01, 12:00 am
Location: St. Louis

Postby bob » 01/24/10, 9:11 pm

Just tried the old script... This one was to find two keywords, which were both popular through the day's headlines. Here're my results:


LINK COMMENTSDESCRIPTION 37
APPLE TABLET 21
SIZE MBDESCRIPTION 13
SUPREME COURT 12
FREEWARE REQUIRES 11
REQUIRES WIN 11
WINDOWS DESCRIPTION 10
INTERNET EXPLORER 10
OPERATING SYSTEM 9
WEB BROWSER 9
COUPON CODESDESCRIPTION 9
START MONTH 8
IPHONE EXCLUSIVITY 8
DESCRIPTION 8
MONTH FEBRUARY 8
ROBERT HASTINGS 8
GOOGLE NEXUS 8
STEVE BALLMER 8
WAR START 8
OFFICE COPIER 8
COPIER TURNS 7
TURNS OFFICE 7
CHROME OS 7
MOTOROLA MOTOROI 7
LAWS SUBJECT 6
FLAGSDESCRIPTION MEMBERS 6
GOD MORAL 6
MEMBERS SUPREME 6
CALL ARREST 6
SUBJECT GOD 6
FIREFOX EXTENSION 6
CODE DESCRIPTION 6
NATURAL LAWS 6
CHEAP LASER 6
COURT DECLARED 6
ARREST SUPREME 6
COURT JUSTICES 6
DESCRIPTION WEEK 6
MORAL CODE 6
MARTIN REGTIENCONTRIBUTING 6


Go ahead and search the paired terms, and you'll see most of them are nonsense in terms of what I want to do. This is why I had to manually create the final "Hot Topics" links. Of those above APPLE TABLET is good, as is MOTOROLA MOTOROI, and maybe a couple others... I need my machine to come up with decent pairs by itself.

LINK COMMENTSDESCRIPTION comes from the way Fark structures its links, so that can be gotten rid of by filtering. OFFICE COPIER turns up so often because of the way Fark wrote a specific headline:

The office copier turns 50. The office copier turns 50. The office copier turns 50. The office copier turns 50. The office copier turns 50. The office copier turns 50. The office copier turns 50. The office copier tur *CALL KEY OPERATOR* [Interesting] (01-24-2010)

Heh! Fark seems like a problem in itself, eh? You can also attribute COPIER TURNS and TURNS OFFICE to them....

I'm going to continue playing around with it. I guess having 3 concorded keywords won't help much...????

Meanwhile maybe I'll turn Fark off in the search to see what happens...
WYSIWTF
bob
BIG GIANT HEAD I Get Free Beer
BIG GIANT HEAD I Get Free Beer
 
Posts: 7565
Joined: 12/03/01, 12:00 am
Location: St. Louis

Postby bob » 01/25/10, 4:06 pm

After some experimentation, I was able to get this... Looks a lot better, but still not perfect:


Apple Tablet | 10
Google Chrome | 6
Windows Mobile | 4
iPhone exclusivity | 4
Tablet Prototypes | 3
Unearth Apple | 3
Classic Controller | 3
Microsoft release | 3
iPhone Apple | 3
Apple tablet | 3
after WindowsWhat | 3
WindowsWhat happens | 3
happens Microsoft | 3
Worth | 3
Designers Unearth | 3
Brain Scans | 2
China counterattacksGoogle | 2
Those EFFing | 2
Google Nexus | 2
Monitor Stands | 2
Greatest Knife | 2
Colliding Particles | 2
Video Converter | 2
Gatesnew jobimages | 2
fears scientists | 2
Internet Explorer | 2
Plays Whatever | 2
Inside multitouch | 2
Computer securityfraud | 2
Brody Worst | 2
Advanced Light | 2
Kaspersky update | 2
Moving through | 2
Platinum Guard | 2
features AppleiSlate | 2
sites suffer | 2
Antitrust Defence | 2
crusade against | 2
Linux Using | 2
exclusivity affect | 2


The first 5 are definitely usable, and lots of others. Actually, I'm pretty happy with this list -- if I can just insure the first three or so pairs are usable, that'd get me pretty close to where I want to be.

Too bad Apple's dominating the news this week. A better test would be a day with somewhat more variety.
WYSIWTF
bob
BIG GIANT HEAD I Get Free Beer
BIG GIANT HEAD I Get Free Beer
 
Posts: 7565
Joined: 12/03/01, 12:00 am
Location: St. Louis

Postby bob » 01/25/10, 5:28 pm

You can run this to see the current clickable list of hot topics... Not quite ready for prime time yet, since SOME of the links will get you nonsense, but pretty good for a few hours efforts so far, I think.

http://www.dailyrotation.com/news/hottopics.php


Meanwhile, I'd appreciate any advice that might help filter trash out of the scripts.
WYSIWTF
bob
BIG GIANT HEAD I Get Free Beer
BIG GIANT HEAD I Get Free Beer
 
Posts: 7565
Joined: 12/03/01, 12:00 am
Location: St. Louis


Return to Site Stuff

Who is online

Users browsing this forum: No registered users and 1 guest

cron