Automated reciprocal link checker

he said he would make a free tool. He did that. It is not his fault if you can not use a script.

 

ok, here are 2 recip checkers I wrote in perl. both come with basic instructions for usage. Either could be made into a web app easily enough, but if you do this, please give credit where credit is due.


First one:
This is a commandline unix application, so it wont work in windows, but you can use it from SSH on your webserver.

What it does:
reads a text file of websites to check for your link.
spiders the entire website looking for your link.
if it finds your link it tells you.

http://4retards.com/linkcheck.zip


Second one:
Gordon asked me to write a recip link checker that spiders your site looking for all outbound links, then follows them to see if your domains link is on their site somewhere. Thats what this second recip checker we have written does. And yes, it is free to use, but not free to modify, sell, make derivations of, etc.

http://www.link-finders.com/recip-spider2.zip

One thing to note about the second one, if the site you spider has a link to google, yahoo, or other large site, this sucker could take a good long time to run fully.
Enjoy!

 

Great script! It works right out of the gate.

In case I haven't said it before, thanks for everything Shawn!

 

" I didn't want digitalpoint.com to be somehow branded as a site that condones and helps reciprocal linkers"

what's so wrong about checking up on who's linking back to you. It only seems fair that you should know...

 

do you think luke ever got home?

 

Shawn's little link checker has served me well, but I've found some "weird" issue... can anybody help a bit? It's just not finding the link even though I know it is there?

1) here is the script from Shawn:
<?php
$mydomain = "www.verticaldirectories.com"; // Set this to your domain
$list = file_get_contents("sites.txt");
$urls = explode ("\n", $list);
ini_set (default_socket_timeout, "15");
echo "<B>Checking back links to $mydomain....</B><P><FONT SIZE=-1>";
foreach ($urls as $url) {
if (strlen ($url)) {
echo $url . "<B><FONT COLOR=";
if (strpos (file_get_contents($url), $mydomain) != FALSE) {
echo "GREEN> Found";
} else {
echo "RED> Missing";
}
echo "</FONT></B><BR>";
}
}
echo "</FONT>";
?>

2) here is the sites.txt file:
http://www.frequentlyasked.info/Point_Of_Presence/Internet/
http://www.frequentlyasked.info/Point_Of_Presence/Internet/

3) AND here is what it keeps saying????

Checking back links to www.verticaldirectories.com....
http://www.frequentlyasked.info/Point_Of_Presence/Internet/ Missing
http://www.frequentlyasked.info/Point_Of_Presence/Internet/ Missing

 

Hey Shawn, great code. I hope this question isn't too lame, but can I have the sites.txt located somewhere remote on the net? If so, how would I do that? thanks.

 

ok, i figured it out on my own, and the easiest solution actually worked, and now i feel dumb for having asked to begin with. i replaced "sites.txt" with the complete URL to the remote site list, and everything was peachy. thanks

 

Much like JBGilbert above, I'm getting some false negatives from this script, with no discernable reason why. JBGilbert, have you figured it out?

 

just digging up an old thread

I put togather a recip links checker tied to a directory

but it seems to properly check some of the time, which sort of sucks

The directory is pretty simple but works pretty well except for the recip checker

it will run link directories for mulitple sites in multiple locations, in php

its pretty ghetto it just uses the snoopy class , not an xml feed or something more creative

if any of you know how to fix it or want to give it a whirl I will share the code with you

mine just uses the snoopy class to grab the links from an url

and works great, most of the time, but that other part of the time is screwing with me

 

Hi everyone,

I just start in PhP writting and I try the script of Shawn's everything goes ok with 2 links but when I put more than 2 it found the first and last link but all the middle link does find it! What's wrong? All the links below as been check and link back but the script does'nt find it all!!! Could someone help me? Thanks

<B>Checking back links to www.tekclick.com/search/index.php....</B><P><FONT SIZE=-1>http://www.play-free-slots-games-online.com/links/links13.html<B><FONT COLOR=GREEN> Found</FONT></B><BR>http://www.dvdbasics.co.uk/links2.html
<B><FONT COLOR=RED> Missing</FONT></B><BR>http://www.millionsaver.com/links/links10_2.htm
<B><FONT COLOR=RED> Missing</FONT></B><BR>http://www.play-free-slots-games-online.com/links/links13.html
<B><FONT COLOR=RED> Missing</FONT></B><BR>http://www.herbalicious.com/partners10_2.htm
<B><FONT COLOR=RED> Missing</FONT></B><BR>http://links.sarasotagroup.com/links9.html<B><FONT COLOR=GREEN> Found</FONT></B><BR></FONT>

++++++++++++++++++++++++++++

here is my code script:

++++++++++++++++++++++

<?php

$mydomain = "www.tekclick.com/search/index.php"; // Set this to your domain

$list = file_get_contents("sites.txt");
$urls = explode ("\n", $list);

ini_set (default_socket_timeout, "12");

echo "<B>Checking back links to $mydomain....</B><P><FONT SIZE=-1>";

foreach ($urls as $url) {
if (strlen ($url)) {
echo $url . "<B><FONT COLOR=";
if (strpos (file_get_contents($url), $mydomain) != FALSE) {
echo "GREEN> Found";
} else {
echo "RED> Missing";
}
echo "</FONT></B><BR>";
}
}
echo "</FONT>";

?>

 

What a great thread this is...

Tested and works....now going to work on implementing it on my links page, so when someone ask's to link to me it checks the site they are putting my link onto and also add's the site to the text file so for future checking.

If I have any luck I'll post code here.

Ian

 

hi, I'm newbie and trying to implement a new fuction in the Shawn's script!

Is there a way to implement a function that we could add a link direct into the .txt file without passing true the ftf program to update the txt file. So we could add link direct from my admin panel? Does someone have a clue?

I try this but still not work it add the new data but doesn't read it:

<?php

$EmailAd = $_POST["email"];
$Subs = $_POST["sub_"];

if ($Subs=="Sub"){

$fp = fopen("sites.txt", "a") or die("Error creating/writing to new file."); 
fwrite($fp, "\r\n" . $EmailAd); 
fclose($fp);

} 

echo "Thank you for subscribing! <a href=\"pagename.php\">Click here to return."; 
echo "More text..."; 

?> 

PHP:

 

Is this a consistent result? Does it happen each time you run the script?

Have you tried increasing the default time out value?

 

I would suggest using a mySQL database rather than a text file. I've adapted the script in a similar way (subscribers to my www.training-directory.org.uk site input the location of their link back and the script pulls that from the database to check) and I reckon it's far more user friendly than reading and writing text files

 

Ok, so I did you do that? Could you help me to adapt the script so I could use a mySQL database rather than a text file? I'm suggest starting in PHP so any help will be welcome!

 

I got mine working

feel free to test it out www.travelpromote.us/addsite.php

checks links
trade on mulitple sites
trade multiple sites wiht multiple sites
have your sites be hosted on another servers and run all the links pages of one central db

just goes and get the html of the link page and parses thru it

the problem I had was not looking for varations of urls wiht "/" on the end

also I need to fix the regex to not only look for "a href" but like a * href

or something becasue people put the css classs definition between the a href sometimes, that and some people don't enclose the url in quotes

I don't that other version works becasue the

echo file_get_contents('http://www.cnn.com');

doesn't seem to work on all urls

 

OK how familiar are you with mySQL... I'll happily send across any scripts I'vewritten, but its useful to knopw where I need to begin (and hey... I'm making this shit up from the online manuals)

 

Thanks Trance-formation, you ask me

I'm just at the beginning, I understsand how it work and how to install a PHP script but dont ask me to find a mistake are to write a PHP script. By the way, Thanks ferret77I I add try your script and It look great. how does it work? I understand that it read a excel (CSS) fill but for the rest how did you adapt the Shawn's script... could you send me the PHP script that you adapt. It could help me! I have try so many thing on the net! You could go on my directory at http://www.tekclick.com/search/index.php and tell me if it is possible to adapt your script to my directory. Many Thanks!

Regard