Skip to main content

Indie game storeFree gamesFun gamesHorror games
Game developmentAssetsComics
SalesBundles
Jobs
TagsGame Engines

Jav-It

The most comprehensive JAV video cataloging tool. · By jav-it

Filesize check / catalog sections

A topic by dommuneski945 created May 27, 2021 Views: 289 Replies: 5
Viewing posts 1 to 3

Hey,

First off, thanks for your work on the tool. The download feature is fantastic! Been using it to pull down everything I had in my account and then properly catalog everything and so far, all seems to be working pretty good. Now I just got two small questions, or maybe potential feature requests:


1: I convert the .ts files the download feature spits out into .mp4's to save some space and because of this, the filesize goes down pretty heavily and now I got one video the catalog feature won't pick up because it seems to think that the video is too small. The log says:

2021/05/27 19:46:02 [WARN] The video file 'xxxxXXX.mp4' appears to be invalid since it is too small. Skipping!

So it seems that you have a builtin check to see if the file is actually large enough to be a movie, which is fine I think, but there doesn't seem to be a way to tell the tool to not do this. Would it be possible to implement a parameter to tell the tool to skip the filesize check? Or does that already exist? Couldn't find anything in the readme or by running the tool itself.


2: A few videos don't get picked up by the catalog feature no matter what ID I use for the movie filename. All of these videos have one thing in common however and that is the fact they are coming from the "amateur" (www.<you-know-where>.com/videos/vod/amateur/) and NOT the regular movies (www.<you-know-where>.com/videos/vod/movies/) part of the site.</you-know-where></you-know-where>

Because of this, I highly suspect that the tool right now only seem to search anything that's actually in the vod/movies part of the site and ignores all the others.

Is this assumption correct? If that's the case then I can stop trying to find the right ID to use ^^'

Thanks for your time!

Developer

Hi there,

Thanks for the kind feedback! In regards to your first question, yes that is done by design. It prevents people from accidently scraping partial downloads, poor quality files, or other files that might be mixed in your download folder (for example video ads, or other strange things websites put in download packages). If I may ask, what is the file size of your movie your trying to catalog? Isn't the quality of your video seriously harmed at such low levels? Anyways as a temporary work around, what I think you can do is catalog your *.ts files first, and then compress the videos after the fact. 

In regards to your second question, you are correct! Video information comes from the movies side and not from the amature side. To be honest, I never thought to include it because I didn't realize it worked on a seperate system. Does downloading videos still work for the amature side, or is it just scraping that's the problem? This is something that could totally be added in a future release. I just need to find time to get to it, since I prioritize my backlog according to Patreon, user needs, and which effect the greatest number of people. (^_^);

(1 edit)

Hi again,
The video I was trying to catalog was 401MB. The quality isn't the problem. Stuff from the amateur side just simply tends to be shorter than your regular movie, plus some older stuff is just barely in 1080p HD which can also factor into a smaller overall filesize. Yes, I worked around that issue myself by just taking a random Windows 10 ISO, renaming that to <movieID>.ts, let the catalog do it's thing and then plopping the converted smaller .mp4 into the folder. That also works just fine. This filesize thing isn't a huge issue or anything, I was just confused because I couldn't find anything in the documentation, hence my original question ^^' But now that I know it exists and works as intended, I can work around that.

Downloading stuff on the amateur side works flawlessly, just like it does on the regular movie side, absolutely no problems there. It's just the catalog feature that doesn't seem to do anything. As an example, this one:

<the-place>.com/videos/vod/amateur/detail/-/id=mssdx060/

Downloading this one is no problem:


But cataloging does nothing apart from moving the video into a new directory:


The ID as highlighted above should be fine, it perfectly matches both the URL to the movie, plus it's also listed as the Content ID, so it should be fine I think.

...but yeah, if you say that the catalog feature doesn't work with stuff from the amateur side then I know that I can stop trying. That already answers my question.

Sure, it would be fantastic if adding support for this section would be possible, but of course your patreon wishlist takes precedence, I understand, no problem ^^

Again, thanks for looking at this!

Developer (1 edit)

Ah, that makes sense. Since I never downloaded anything from that side, I never considered that videos would be significantly shorter than the adverage movie. Are they charging full price for less content? (-‸ლ)

And thanks for your understanding! Since I'm essentially just giving away my time for this project, I made a promise to myself that it would let it live and die based on donations. That way, its easy to tell when your sinking too much of your own time and money into something people no longer care about (^_^);

Nah, from what I can see they tend to be cheaper than full regular releases. Honestly, I didnt notice at first that they are coming from an entirely different category/side, which is why I now have a small number of movies that don't catalog properly ^^'

Developer

I see. I'm glad they're cheaper then. At least your getting  what you paid for. Though, it's funny that VR videos are still under the same system as regular movies. It seems like Amature videos are just the odd one out in this case.