Update: MIIT Requires Search Engines to Respect Robot.txt Protocol
Sohu IT, 11/02/12
China's Ministry of Industry and Information Technology (MIIT) has brought together representatives from Chinese internet search companies Baidu (Nasdaq: BIDU), Jike.com, Panguso.com, Qihoo 360 (NYSE: QIHU), Shanda Interactive, Sohu's (Nasdaq: SOHU) Sogou, Tencent (0700.HK), Netease (Nasdaq: NTES), Sina (Nasdaq: SINA), Easou, Yicha, and Zhongsou to sign a "Search Engine Self-Discipline Agreement" yesterday in Beijing. The agreement requires that companies abide by the robot.txt protocol, which instructs search engine web crawlers as to whether or not they can index a page for use in online searches. According to the provisions of the agreement, companies must delete previously indexed content that is in violation of robot.txt protocols and refrain from using robot.txt protocol violating web crawlers.
Editor's Note: For more information on the robot.txt protocol and the history behind the MIIT's 'Self-regulation' agreement, please see "Rumor: MIIT Requires Search Engines to Sign "Self-Discipline" Agreement," MD 11/01/12 issue.
Keywords: Panguso Shanda Netease Internet regulation Baidu Sogou Zhongsou Tencent MIIT Easou Sina Sohu Yicha 0700.HK BIDU NTES Qihoo 360 Jike QIHU online search