Getting Links from an internal web page

Question

I have an internal company's web page and I need to extract a link from that page what I tried is

using (var client = new System.Net.WebClient())
            {                    
                string pattern = @"(<a.*?>.*?</a>)";

                MatchCollection hreflist;

                string Url = client.DownloadString("https://collaborate.citi.net/docs/DOC-908807");                

                hreflist = Regex.Matches(Url, pattern);

                Console.WriteLine("Total number of links in Url: " + hreflist.Count + "\n\n");

But this code doesn't seems to work here.

Answer 1

You need to download HtmlAgilityPack

WebClient wc = new WebClient();
            var sourceCode = wc.DownloadString("http://dota-trade.com/equipment?order=name");
            HtmlDocument doc = new HtmlDocument();
            doc.LoadHtml(sourceCode);
            var node = doc.DocumentNode;
            var nodes = node.SelectNodes("//a");
            List<string> links = new List<string>();
            foreach (var item in nodes)
            {
                var link = item.Attributes["href"].Value;
                links.Add(link.Contains("http") ? link : "http://dota-trade.com" +link);
            }
      
  
        System.IO.File.WriteAllLines(@"C:\Users\Public\WriteLines.txt", links);