主动给百度爬虫提交链接的个人小经验

[tigger]

打开百度资源: https://ziyuan.baidu.com/

首先要认证自己的域名

然后可以如上图获得 token , 这样可以通过此 token 用脚本提交 链接

baidu_ziyuan_post_test.sh

#!/usr/bin/php

<?php

echo " ------------- \n";

while (1)
{
        $i = rand(1, 7000);
        $url = "https://bbs.aw-ol.com/topic/${i}";
        echo $url;

        $api = 'http://data.zz.baidu.com/urls?site=bbs.aw-ol.com&token=PCsGS75NhQJZWVAr';

        $ch = curl_init();
        $options =  array(
                CURLOPT_URL => $api,
                CURLOPT_POST => true,
                CURLOPT_RETURNTRANSFER => true,
                CURLOPT_POSTFIELDS => $url,
                CURLOPT_HTTPHEADER => array('Content-Type: text/plain'),
        );

        curl_setopt_array($ch, $options);
        $result = curl_exec($ch);
        echo $result;
        $sleep_second = rand(60, 300);
        sleep($sleep_second);
        echo " ${sleep_second}";
        echo "\n";
}
?>

有时候一天收录量可以增加 1000多