Comments on: How to Create a Web Spy with a PHP Web Crawler https://1stwebdesigner.com/php-web-crawler/ Helping You Build a Better Web Tue, 22 May 2018 22:18:09 +0000 hourly 1 By: Johnny https://1stwebdesigner.com/php-web-crawler/#comment-204728 Thu, 03 May 2012 15:31:05 +0000 http://www.1stwebdesigner.local/?p=47187#comment-204728 Thank you for a great article.
I have created the db as ‘spy’, imported the sql string and it has created the table ‘zappos’ in the db.
Any idea why i get this error : Notice: Undefined variable: date in C:\wamp\www\WebSpy\index.php on line 154?

]]> By: Sadaruwan https://1stwebdesigner.com/php-web-crawler/#comment-199530 Mon, 02 Apr 2012 12:21:06 +0000 http://www.1stwebdesigner.local/?p=47187#comment-199530 I ran this and works like a charm but what I want is to do is to create bot that’ll search for a specific word in the whole site can you help with this I’ll be a very grateful.

]]> By: amir https://1stwebdesigner.com/php-web-crawler/#comment-198813 Sun, 01 Apr 2012 01:12:55 +0000 http://www.1stwebdesigner.local/?p=47187#comment-198813 Hi!
very nice tutorial, but I still get this error

( ! ) Notice: Undefined variable: date in C:\wamp\www\Mywebsearch\webspy\index.php on line 154
Call Stack
# Time Memory Function Location
1 0.0009 379664 {main}( ) ..\index.php:0

( ! ) Notice: Undefined variable: date in C:\wamp\www\Mywebsearch\webspy\index.php on line 154
Call Stack
# Time Memory Function Location
1 0.0009 379664 {main}( ) ..\index.php:0
–
best regard

]]> By: Rochester Oliveira https://1stwebdesigner.com/php-web-crawler/#comment-173864 Mon, 23 Jan 2012 08:06:35 +0000 http://www.1stwebdesigner.local/?p=47187#comment-173864 In reply to Ned.

Nice point NokiaThemes,

CURL is pretty useful if you need to send POST data also (e.g. working to get data from search forms or any kind of post forms)

]]> By: Ned https://1stwebdesigner.com/php-web-crawler/#comment-173545 Sun, 22 Jan 2012 07:06:37 +0000 http://www.1stwebdesigner.local/?p=47187#comment-173545 Great tutorial .I think that using CURL instead of fopen is better , because you can set (REFERER) field which is required by many websites .

]]> By: Rochester Oliveira https://1stwebdesigner.com/php-web-crawler/#comment-162150 Tue, 03 Jan 2012 00:21:32 +0000 http://www.1stwebdesigner.local/?p=47187#comment-162150 hahaha

]]> By: Rochester Oliveira https://1stwebdesigner.com/php-web-crawler/#comment-162148 Tue, 03 Jan 2012 00:21:16 +0000 http://www.1stwebdesigner.local/?p=47187#comment-162148 In reply to Dhruv.

Hi Dhruv, I wasn’t talking about cURL, actually. As I said “I’ve seen even JS techniques”, there is a lot of other ways for doing this ;)

[]’s

]]> By: Dhruv https://1stwebdesigner.com/php-web-crawler/#comment-137947 Sun, 20 Nov 2011 18:30:24 +0000 http://www.1stwebdesigner.local/?p=47187#comment-137947 In reply to Rochester Oliveira.

I know i this is an old comment, but cURL is a PHP function/class not JavaScript.

]]> By: Rochester Oliveira https://1stwebdesigner.com/php-web-crawler/#comment-126426 Tue, 25 Oct 2011 17:45:48 +0000 http://www.1stwebdesigner.local/?p=47187#comment-126426 In reply to Kent.

It’s really good, you should give it a try :)

[]’s

]]> By: Rochester Oliveira https://1stwebdesigner.com/php-web-crawler/#comment-126424 Tue, 25 Oct 2011 17:42:59 +0000 http://www.1stwebdesigner.local/?p=47187#comment-126424 In reply to Rohan.

Hey Rohan, reach me via e-mail, I think I could help ya.

[]’s

]]>