Read HTML

[SeanStick]

Hello,

I have been searching the web for a while now and can not find a solution.

I want to go to a website and grab all the links on the site and place them in a list.

Can someone direct me.

Thanks!

 

[cjard]

I'd use a regular expression to search for hyperlinks. You can get these off the web e.g. hyperlink regex - Google Search

Regular-Expressions.info - Regex Tutorial, Examples and Reference - Regexp Patterns has more info on regex in general

 

[Robert_Zenz]

Hello.

Use the HTTPRequest class to get the site (as String), after that you can use Regular Expressions (RegEx Class) (found in System.Text.RegularExpressions) to extract all links...

You can get a Match onto a Link with something like

<a[\w\d\s=":._\-\\/]*>[\w\d\s]*</a>

Bobby

 

[cjard]

You can get a Match onto a Link with something like

<a[\w\d\s=":._\-\\/]*>[\w\d\s]*</a>

Bobby

I'd use capturing groups, something like:

<a.*?href[^=]*?(?<linkquote>["'])(?<link>.*?)\k<linkquote>.*?>

(Debugging may be needed; I wrote it blind)

then, get the matches, and all the link hrefs should be in the collection: m.Groups("link").Value


Dr. Dobb's | Regular Expressions in .NET | December 1, 2002