7 Support questions or comments

• 
  10 months ago
  asac1995

  The crawler have a cron job?

• 
  Nov 20, 2022
  ethanmask

  Is it possible to get the results only from the database we created?

• 
  Oct 20, 2020
  Eugen2

  Any way to open up URL submissions to public so anyone can add their URL?

• 
  Feb 12, 2020
  dosome

  Can I crawler even shortened URLs?
  Is it possible to use long web page URLs?
• View 7 more replies
• 
  Feb 12, 2020
  Nelliwinne Author

  Better to use long actual URL.
• 
  Feb 12, 2020
  dosome

  1. Can I use a shortened URL?
  For example goo.gl, bt.ly, ow.ly and so on
  
  2.Are there any restrictions on the length of long URLs?
• 
  Feb 12, 2020
  Nelliwinne Author

  1. No
  2. 2000 characters.
  
• 
  Feb 12, 2020
  dosome

  More questions
  Is the website Crawler supported in all languages?
  Is there an ad management feature?
• 
  Feb 12, 2020
  Nelliwinne Author

  It's HTML with PHP so you can transalate the code. But there is not language feature.
  Also there is not ad management still you can put your ads within the HTML.
• 
  Feb 13, 2020
  dosome

  Thank you for answer
  Can I add a short URL crawl feature?
  How Much Does It Cost?
• 
  Feb 13, 2020
  Nelliwinne Author

  Short URLs are not possible because this is CURL URL based crawler.
• 
  Feb 13, 2020
  dosome

  I'm not a programmer.
  I ask questions because I don't know
  How can I crawl short URLs?
  Can you do it?
• 
  Feb 13, 2020
  Nelliwinne Author

  Ok. Let have a chat on my Fiverr account for your customization.
  https://www.fiverr.com/nelliwinne
• 
  Feb 26, 2020
  dosome

  Why? Don't answer my question?
  
  Please finish your work so that the script works.

• 
  Aug 13, 2018
  Mikael1 Purchased

  No site url is crawled at all when I try to setup this script. :-/
• 
  Aug 14, 2018
  Nelliwinne Author

  Send me support message to [email protected] with URL to check your installation.

• 
  Mar 9, 2017
  franklyn Purchased

  This is what I was looking for, but there are some things I don't quite understand and couldn't find in the documentation:
  
  * How can I update the crawled data list when the contents of the pages have changed?
  * Some pages were not found by the crawler. How can I add these pages to the crawled data list?
  
  In both cases, there is only the option to add the contents manually in a textarea.
  How can I trigger the crawler to automatically index these pages instead?
  
  * And is there a possibility to restrict the the indexing to the main content area of the pages? In my case, the index contains the text of the navigation menu and even JavaScript code.
  
  Thanks in advance.
• 
  Mar 9, 2017
  Nelliwinne Author

  Can you please send me your question with some sample URLs you cannot crawl to my email [email protected]. It's late night here. I will answer you 1st thing in the morning. BTW thank you for your purchase.

• 
  Dec 13, 2016
  diegorosa

  Hello,
  Congratulations on your work.
  I think you could improve the layout of the site, based on the google search engine.
  You should have the option of searching for images.
  Put the option of the user to send their own url as happens in google and from there pull all the links and images belong to the domain.
  
  Thank you
• 
  Dec 14, 2016
  Nelliwinne Author

  Thank you for your suggestions. I will consider them in future updates.
• 
  Dec 15, 2016
  diegorosa

  When will it be next update?
• 
  Dec 16, 2016
  Nelliwinne Author

  Well. No yet exact time frame. But will be with 2 months.