Wrox Programmer Forums
Go Back   Wrox Programmer Forums > ASP.NET and ASP > ASP.NET 1.0 and 1.1 > ASP.NET 1.0 and 1.1 Basics
|
ASP.NET 1.0 and 1.1 Basics ASP.NET discussion for users new to coding in ASP.NET 1.0 or 1.1. NOT for the older "classic" ASP 3 or the newer ASP.NET 2.0.
Welcome to the p2p.wrox.com Forums.

You are currently viewing the ASP.NET 1.0 and 1.1 Basics section of the Wrox Programmer to Programmer discussions. This is a community of software programmers and website developers including Wrox book authors and readers. New member registration was closed in 2019. New posts were shut off and the site was archived into this static format as of October 1, 2020. If you require technical support for a Wrox book please contact http://hub.wiley.com
 
Old December 28th, 2006, 06:50 AM
Registered User
 
Join Date: Dec 2006
Posts: 1
Thanks: 0
Thanked 0 Times in 0 Posts
Default How to save all search engine results urls in a te

On this search engine:

https://siteexplorer.search.yahoo.com/mysites

go enter the domain url in the search box (the one where you would enter keywords normaly before the invention of this search engine) .Enter

  blogspot.com

you will get on the top left corner of the search page notification that there were

28 million websites found.Each web search page can list 50 of that number.
I want to copy as much as I want #1086;f these urls (that are under the title of each found webpage on a search page)to have them copied till the end if I don't interrupt them and can acces them even unfinished and continue their saving from the place they have stopped -save them into a text file.Note that yahoo site explorer lists only the subdomains of the domain we enter and lists nothing else.

so for example we got only two websites of one search engine quest:

1. title A
(www.1domain.com/1subdomain.html)

2.title B
(www.1domain.com/2subdomain.html)

all I would like is to have them copied in a text file:

www.1domain.com/1subdomain.html
www.1domain.com/2subdomain.html

and if there were 28 million of such than 28 millions such lines were be written.Name it

1a.txt

and again to copy but only the urls of the websites that contain flash -flv,swf movies
inside them.Save them as 1b.txt.

and again,if possible some seo data of each webpage.E.g number of views,rank.As
1c.txt.

Can asp net software be download for free at least for this usage?







Similar Threads
Thread Thread Starter Forum Replies Last Post
ASP.NET 2.0 Instant Results Book -Survey Engine autolib BOOK: ASP.NET 2.0 Instant Results ISBN: 978-0-471-74951-6 9 August 29th, 2006 01:05 AM
Search Engine for Full-text Search Kala ASP.NET 1.0 and 1.1 Professional 2 August 29th, 2004 02:16 AM
Search Engine dfalconer General .NET 3 August 17th, 2004 05:46 AM
Search engine that search through local drive! wenzation Classic ASP Basics 0 August 26th, 2003 09:15 PM





Powered by vBulletin®
Copyright ©2000 - 2020, Jelsoft Enterprises Ltd.
Copyright (c) 2020 John Wiley & Sons, Inc.