Talkpolitics contributors

[mijopo.livejournal.com]

I ran a script this morning to grab the URLs for all my postings here.  While I was at it, I did a count of contributions. Here are the top 20 posters all time in talk_politics. These posters contributed 57% of all posts (2901 total). (ETA: I've listed 20-60 in comments below.)   246 different users have contributed posts, but over 80% of all posts have come from 52 users.

(if anyone can tell me how to get past the login page using wget (in perl), I'd be happy to try to grab the data for all commenters.  My initial attempts have been stymied by the login page.)

If anyone would like a list of the URLs and posting titles they've contributed, just let me know in the comments.


NOTE: Edited, seem to have missed some data on first go through, revised numbers, further errors possible, of course:

Total posts: 3126
Total posts by top 20: 1770
Total posts by top 50: 2475
Total Posters: 250

underlankers	240
gunslnger	120
sophia_sadek	109
telemann	107
enders_shadow	102
mahnmut	97
ddstory	96
malasadas	92
verytwistedmind	90
kinvore	87
abomvubuso	83
paft	79
futurebird	68
green_man_2010	67
htpcl	66
allhatnocattle	63
mijopo	59
meus_ovatio	52
airiefairie	47
sandwichwarrior	46

Comments

[abomvubuso.livejournal.com]

Aye, but can you count the comments? :p

[htpcl.livejournal.com]

Could be roughly proportional, but then, there are some who are too shy to post posts but who regularly comment (Geezer, I'm looking at ya buddy!) And there are those who like to post and never come back to participate in the discussions (eh...*cough*Steve*cough*).

[geezer-also.livejournal.com]

You called that, since I rank 9th in comments.
In my defense, the main reason I rarely post is because I feel I should be available to respond, and the majority of comments on any post are when I'm at work (least ways it seems that way....I guess if he could figure out way to figure out the time frame of posts and comments, I may be wrong....however until proven so, that's my story and I'm sticking to it!!!

[htpcl.livejournal.com]

Sure, but you don't necessarily have to be available for a large period after you've posted.

[mijopo.livejournal.com]

Yes, easy enough to count the comments, I think, except that I need a way to automate the downloading of pages. I always used wget for that but I'm being foiled my LJ's adult content notice.

[htpcl.livejournal.com]

Maybe we could remove it for a day so you could do the work?

[mijopo.livejournal.com]

ah, that's a good point, that's there because of a setting you've, i.e., the moderators, have put in place, right?

[telemann.livejournal.com]

Every journal has that, yes.

[tridus.livejournal.com]

If you can tell wget to send a cookie with its requests, you could have it act as if it's logged in as you and thus wouldn't get the notices.

[mijopo.livejournal.com]

Yes, I've been trying but must not have the syntax right or somethign because I'm not getting in successfully.

[tridus.livejournal.com]

Another option is to use a website copier that can do cookies, and will build an entire offline copy of the community: http://www.httrack.com/

[mijopo.livejournal.com]

Oh, cool, I've never seen that before, looks handy, thanks.

[htpcl.livejournal.com]

Yup. No problem to change the setting temporarily if you want. It's been put there as a precaution.

[mijopo.livejournal.com]

okay, cool, when I have a few minutes to work on this maybe I'll harangue one of you to turn it off for a couple of hours.

[htpcl.livejournal.com]

No pain. I'm turning it off for 24 hours. It won't hurt. :-)

[mijopo.livejournal.com]

Excellent, that seems to do the trick on the tests I've done. I'll try to slurp in all the pages tonight, will let you know when that's done. Thanks!

[htpcl.livejournal.com]

Turning it back on now.

[rasilio.livejournal.com]

More importantly, can you produce a word count of posts/comments


Then we'll know who the real top posters are ;-)

[mijopo.livejournal.com]

well, I'm going to download all the posts tonight. I'll run the comment counts first, that's fairly straightforward, but if I get really ambitious (or shall we say unambitious insofar as I'm screwing around with this during work) I'll look into doing a word count at some point.

but I think I'll just stick to the posts for the word counting. Posts with more than n comments appear to lose the comments even from the html source, so i'd have to do a lot more downloading if we were to try to get word counts on the comments.