1. Advertising
    y u no do it?

    Advertising (learn more)

    Advertise virtually anything here, with CPM banner ads, CPM email ads and CPC contextual links. You can target relevant areas of the site and show ads based on geographical location of the user if you wish.

    Starts at just $1 per CPM or $0.10 per CPC.

Any free sitemap generator that can create unlimited number of pages

Discussion in 'Google Sitemaps' started by almir, Oct 11, 2006.

0
Page 1 of 4
  1. #1
    Hi !

    Is there any free sitemap generator that can create sitemap for site that has few houndred thousands pages.

    It would not be a problem to pay for this , but I just dont have that damn Paypal thing
     
    almir, Oct 11, 2006 IP
  2. Nick_Mayhem

    Nick_Mayhem Notable Member

    Messages:
    3,486
    Likes Received:
    338
    Best Answers:
    0
    Trophy Points:
    290
    #2
    Nick_Mayhem, Oct 11, 2006 IP
  3. almir

    almir Peon

    Messages:
    1,104
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #3
    thanks nick, know this one, but it makes only 5k pages, and I have a site with probably million +
     
    almir, Oct 11, 2006 IP
  4. Nick_Mayhem

    Nick_Mayhem Notable Member

    Messages:
    3,486
    Likes Received:
    338
    Best Answers:
    0
    Trophy Points:
    290
    #4
    Humm...

    If the site is a custom made script and you know PHP well then I think you can generate the sitemap without cralwing the site. :)
     
    Nick_Mayhem, Oct 12, 2006 IP
  5. almir

    almir Peon

    Messages:
    1,104
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #5
    have to learn much more untill come to that level :)
     
    almir, Oct 12, 2006 IP
  6. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #6
    Most websites selling software also offers VISA etc.

    Still, a million+ pages... That would take a lot of
    time to crawl... (and with so many pages, other
    issues may arise as well... Like powerouts *G*)

    I kinda agree with Nick_Mayhem ...
    You should consider a custom solution...
     
    websitetools, Oct 12, 2006 IP
  7. almir

    almir Peon

    Messages:
    1,104
    Likes Received:
    18
    Best Answers:
    0
    Trophy Points:
    0
    #7
    5000 doesnt mean me anything cause I already have 10500 pages indexed
     
    almir, Oct 12, 2006 IP
  8. hhheng

    hhheng Banned

    Messages:
    2,633
    Likes Received:
    37
    Best Answers:
    0
    Trophy Points:
    0
    #8
    hhheng, Oct 12, 2006 IP
  9. ainmohd

    ainmohd Peon

    Messages:
    1,515
    Likes Received:
    21
    Best Answers:
    0
    Trophy Points:
    0
    #9
    I'm using Xenu's Link Sleuth (TM) to check my 1,500-webpage site for broken links. In the process, several reports are prepared including sitemap.
     
    ainmohd, Oct 12, 2006 IP
  10. WinterWind

    WinterWind Peon

    Messages:
    122
    Likes Received:
    3
    Best Answers:
    0
    Trophy Points:
    0
    #10
    And this service allows you to submit up to 5 website, monitoring your sitemaps and pinging Google in every update.

    Really cool service.
     
    WinterWind, Oct 12, 2006 IP
  11. websitetools

    websitetools Well-Known Member

    Messages:
    1,513
    Likes Received:
    25
    Best Answers:
    4
    Trophy Points:
    170
    #11
    There is a huge difference in supporting
    1,000
    10,000
    100,000
    1,000,000 pages

    With the latter (a million pages), even issues such as memory address space (!) can begin to give problems. (Depending on how much extra information you store, e.g. data used for reports etc.)
     
    websitetools, Oct 13, 2006 IP
  12. procy

    procy Peon

    Messages:
    1
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #12
    Here you'll find help http://www.procy.de
     
    procy, Oct 16, 2006 IP
  13. LadyHoldem

    LadyHoldem Well-Known Member

    Messages:
    911
    Likes Received:
    46
    Best Answers:
    0
    Trophy Points:
    140
    #13
    have you tried GsiteCrawler?

    http://gsitecrawler.com/

    I use it, and the bigger the site, the slower it works, but it doesn't have a limit, which is why i chose it, and it uploads and pings google.. I'm pretty fond of it :)
     
    LadyHoldem, Oct 20, 2006 IP
  14. dito199

    dito199 Peon

    Messages:
    60
    Likes Received:
    1
    Best Answers:
    0
    Trophy Points:
    0
    #14
    I am using gsitecrawler as well. But be careful if you have large site. My article directory has close to 10K articles, I let it ran overnite and the crawler busted my bandwidth when I worked up in the morning.

    It indexed every possible links from each page (that includes sorting, comments, top 10 etc). The 10k ended up in 60k page download and still on going. I had to stop and put in filters to ignore many unecessary links.

    But otherwise, its a great tool. I am a little skeptical that the download has an expiration date. I have a hunch this is going to turn into a paid program once the author managed to build up the rep.
     
    dito199, Oct 25, 2006 IP
  15. xaser

    xaser Peon

    Messages:
    1
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #15
    After I subscribed to Google sitemap beta crawler left 2 indexed links. :mad: No problems with Yahoo! Site Explorer or MSN. Sitemap helps I don’t believe. After opening we have about 40 links now just 2. Web site index about 1000 pages…
     
    xaser, Oct 26, 2006 IP
  16. ultimatehandyman

    ultimatehandyman Peon

    Messages:
    246
    Likes Received:
    8
    Best Answers:
    0
    Trophy Points:
    0
    #16
    gsitecrawler works well for me.

    It is not the fastest but it seems to work very well on my site!
     
    ultimatehandyman, Oct 26, 2006 IP
  17. j4s0n

    j4s0n Guest

    Messages:
    295
    Likes Received:
    7
    Best Answers:
    0
    Trophy Points:
    0
    #17
    I've been unto searching one before, I ended up creating my own sitemap generator in PHP, honestly, there's a lot to consider like your server load :(
     
    j4s0n, Oct 26, 2006 IP
  18. pctec

    pctec Well-Known Member

    Messages:
    1,623
    Likes Received:
    210
    Best Answers:
    0
    Trophy Points:
    160
    #18
    pctec, Oct 27, 2006 IP
  19. LadyHoldem

    LadyHoldem Well-Known Member

    Messages:
    911
    Likes Received:
    46
    Best Answers:
    0
    Trophy Points:
    140
    #19
    This is actually what I use as well, but i use the version that lives in my pc, and I have to member to crawl .. is there another version?

    ~LadyH
     
    LadyHoldem, Oct 28, 2006 IP
  20. eagleswings

    eagleswings Peon

    Messages:
    13
    Likes Received:
    0
    Best Answers:
    0
    Trophy Points:
    0
    #20
    so... it does not add hidden links.... like other programs?

    Paul
     
    eagleswings, Oct 30, 2006 IP
Page 1 of 4