Post by abraxas86 in Big Improvements to Library-To-CSV Scraper comments

Big Improvements to Library-To-CSV Scraper » Comments

Viewing post in Big Improvements to Library-To-CSV Scraper comments

Hey, sorry for the late reply. You didn't miss anything - in fact, it was *me* that missed the thing haha.

This line near the top tells the script what URLs to activate on:

// @match        https://itch.io/c/*

Great for collections, but apparently the "my purchases" section doesn't use a URL that follows the pattern.

I've added an additional @match line to the code, if you hop over to the gist and click the "raw" button, it should give you the option to update. I tested on my "my-purchases" and it worked okay. I think if you scroll the list too quickly, it might not load all the data in properly. When you get to the bottom, I think if you scroll all the way up, and then scroll all the way down again before exporting, it should fix things up.

If you find any other errors, let me know so I can patch it up more. Thanks for letting me know about this short-coming :)

untipo1 year ago(+1)

This now works! the only thing is that the "genre" and "synopsis" columns are left blank. I guess there's no way to retrieve them from the "my purchases" page?

I don't get how itch manages the library: I have a have bought a 900+ items bundle some time ago and I could not claim them all at once. I had to use a third party script to automate the process. Now, the strange thing is that some of the items appear in a so called "collection" in my profile, while others don't.

If only there was a way to add all of the items in a single collection i could use your script to parse the entire library, including the synopsis.

abraxas861 year ago (5 edits)

The data we get back on the purchases page kinda sucks.

In the other collections you get a lot of stuff: title, price, synopsis, publisher, genre, platform.
In the "my-purchases" we get: How long ago you bought it, title, and publisher.

If I can find a way to get that section to open like a normal collection, I'll let you know. I suppose the info could still be scraped, but it would have to fetch every single game and pull the data from its game page... not sure how much work that would involve lol

I think I had to do something weird with the huge bundle I bought a couple years ago as well. It was such a pain to get through, I remember that much. I basically went through and created a "Games to check out" collection of the ones I thought looked interesting.

It might actually be possible to create a button to add games from your purchases to a proper collection... 🤔 Looks like the site uses URLs like this:

https://itch.io/[game-url]/add-to-collection

to add a game to a collection, so I just need to inject a button for each game to do the same thing. I could probably expand on that logic to bulk-add games to collections.