WebSite single URL multiple table pages, how to download all pages?

[Lars Ole Sørensen]

Hi,

I am trying to download Fifa Mens ranking from the website "https://www.fifa.com/fifa-world-ranking/ranking-table/men/#all". The ranking table contains 5 pages where the first page shows the first 50 rankings. All the pages have the same URL stated above.

I am trying to import these pages into excel via power query but get only the first page because all the pages has the same URL. I am wondering if there is possible to import all the rankings to power query or some method to figure out the URL to the other 4 pages?

Regards
Lars Ole

 

[Chihiro]

Since site has control/script that slices data within page (i.e. all data is present in underlying html, but not in Page content). You will need to remove that portion or extract out table element from responsetext.

So... don't rely on using Web.Page() from Web.Content. But Text.FromBinary() to return text. Then use text manipulation to extract out the portion that's needed. Then use Web.Page() to parse specific element.

Ex:

let
    Source = Text.FromBinary(Web.Contents("https://www.fifa.com/fifa-world-ranking/ranking-table/men/")),
    tableTxt = "<table" & Text.Split(Text.Split(Source, "<table"){1}, "</table>"){0} & "</table>",
    tableObj = Web.Page(tableTxt),
    Data = tableObj{0}[Data],
    #"Changed Type" = Table.TransformColumnTypes(Data,{{"Rnk", Int64.Type}, {"Team Team", type text}, {"Total Points PTS", Int64.Type}, {"Previous Points Prev.Pts", Int64.Type}, {"+/-", Int64.Type}, {"Positions Pos", type text}, {"Confederations fifa_TBT", type text}})
in
    #"Changed Type"

 

[Lars Ole Sørensen]

This is exactly what I wanted, thank you very much, always good help to get

 

[nxy]

Hi, I am facing a similar problem. I want to scrap the data from https://www.tradingview.com/markets/stocks-usa/sectorandindustry-sector/.
There are two tabs, Overview and Performance. Both have the same URL. I need the Performance table. The default table given in my excel query is the Overview tab. Appreciate any inputs. See attached screenshot for better clarity. Thank you.

 

[vletm]

nxy
As You've read from Forum Rules

Site Rules - New Users - Please Read

Hi all, Welcome to the Chandoo.org Forums. Posting Rules & Etiquette The Chandoo.org Forums is a collaborative and happy place to learn and expand your Excel knowledge. The Chandoo.org Forums consist of several Sub-Forums based on the type of question/area of Excel you are interested in...

chandoo.org

You should open a new thread.