Stupid web spider tricks

In the spirit of earlier entrants , but not as bad, here's some stupid webspider tricks.

The first stupid trick: crawling 'Add Comment' pages. Not only are the'Add Comment' links marked nofollow (so good little spiders shouldn'tbe going there), but it's also a great way to make me wonder if you'rea would-be comment spammer and pay close attention to every CSpace pageyou hit. CSpace gets sufficiently few pages views at the moment that


20060218網摘 – Things you don't want Google to find

New Services and Software

IT


你知道嗎?

我需要的不是舒適,而是一條出路。

Some regular expression performance surprises

Part of the fun of performance tuning is all of the unexpectedthings you find out. Since I spent some of yesterday doing work in the guts of DWiki 's DWikiText toHTML conversion, what I've been finding is some regular expressionperformance surprises.

My big surprise was the relative performance of ' [A-Z] ',' [A-Z][A-Z]* ', and ' [A-Z]+ ' for scanning text where they didn'tmatch (the


An interesting IDE to SATA migration problem

A coworker here ran into a novel problem migrating a system from an IDEdisk to a SATA disk: he ran out of partitions. He had 16 partitions onthe IDE disk, and on Linux you can only have 15 partitions on a SATAdrive. (Fortunately he found a partition he didn't really need.)

On the surface, this limitation is because SATA drives on Linux areconsidered to be SCSI disks , and all SCSI diskscan only have 15 partitions. Of course, that just


20060216網摘 – 賀香港動漫研究所成立

New


錯配

冷雨敲窗不可聽。挑燈夜讀牡丹亭。人間亦有癡於我。傷心豈獨是小青。——馮小青

現在這個時刻,該是看《華蓋集》的,但手上只有重刻舊版的《朝花夕拾》。看過自然頹喪不堪,冷雨、挑燈這些意象都來了。若屋裡有一扇窗

博客地圖的定位問題

最近有一個博客地圖推出,以 Million Dollar Homepage 的意念,推出專為 Blogger 而設的收費廣告服務,標榜收費便宜,目的是增加博客間的交流。對此,有人 支持 也有人 反對 ,掀起了一番爭論風波。我在想如果同類事件,是由 Oui 或者 Blog-you ,以「留紀


人生苦悶,奇文共賞

網上輾轉傳來一篇浸會大學學生會外務副會長的講辭,查將於學聯周年大會上宣讀。人生苦悶,難得好文,不禁要與眾同樂。 浸大的朋友尤其應要格外留意,因為有人如此令你們的學校蒙羞。 此文充斥一種 當明星的虛榮心 態,對

Fun with control characters and the web

Yesterday, I broke WanderingThoughts ' syndication feeds (and madethe main page not validate). I did this by accidentally putting a ^Dcharacter into an entry ; oneof the editors I use makes this unfortunately easy to do by accident,and hard to spot.

Neither HTML 4.01 Transitional nor XML (which the Atom syndicationformat is a dialect of) allow control characters (apart from tabs(and linefeeds)). A lot of things are forgiving of crappy HTML, butthings that eat Atom