Using VBA Excel for extracting data from Web Pages without using Selenium

[surendr.kumar]

Hi There,
I am not new to VBA Excel, nor to Web Scraping using VBA Excel when it comes to simple HTML pages. However, now I have stumbled upon a series of issues as listed below:
1. The Web Page now I want to extract data from is a Secure Web Page (https://) whose security certificate has expired. The Web Page, when opened, shows the usual warning where one has to go through two different clicks, one on "More Information" and then on "Proceed with this site (not recommended)". When going through their code dump, it is observed that these are controlled through js/css scraping data from which is a herculean task for me.

2. Secondly, as all are aware, the good old Internet Explorer is saying goodbye (on my system it has already been dumped) and will soon be buried deep pawing way for MS Edge. But the VBA Excel has reference to only Internet Explorer (added through Tools->References) and to the best of my knowledge, other browsers are not getting support. On the contrary, I wish my VBA Code could run on any given browser, whether activated as default browser using Application.OpenBrowser method or a selected browser using some appropriate method.

On second thought : For certain reasons, I cannot use Selenium as the file can be distributed to friends not having the Selenium installed.
Can someone help me out?

Regards,
Surendra Kumar

 

[Marc L]

the good old Internet Explorer is saying goodbye (on my system it has already been dumped)

Hi ! Should may be your best option for a while, too bad !​

​

If the data to scrap is included within the initial webpage code then you could directly use a web request under VBA,​

samples within this forum, whatever all over the web …​

​

You can also try with Excel Power Query feature - Get & Transform on recent Excel versions - like you can see​

in the specific forum section on Chandoo.​

​

If both fail then you will have to move to another coding language like Python, JScript, …​

​

 

[surendr.kumar]

Dear Mark,
Although I am still struggling, still Thanks a lot for your reply!

Regards!!!

 

[AlanSidman]

As Marc indicated, PQ may be an option. Look at this link

 

[surendr.kumar]

As Marc indicated, PQ may be an option. Look at this link

Thanks for recommending Power query but I have never used. Yeah! definitely I'll give a try. Regards!!!