Don't fetch additional data when importing subscriptions

[ChunkyProgrammer]

Don't fetch additional data when importing subscriptions

Pull Request Type

• Bugfix
• Feature Implementation

Related issue

• Avoids rate limit when importing subscriptions
• closes [Bug]: App stuck importing subscriptions #3943

Description

This PR will load the subscriptions as is and will load data only when needed (thumbnails will be slowly loaded in the side bar if channels are set to be displayed there). If someone disables the sidebar and doesn't use the Subscribed Channels page then thumbnails will be added when a user navigates to a channel.

Testing

See: #3735 (comment)

• profiles.txt
• subscriptions.csv
• SubscriptionsError.csv
• SubscriptionsNoError.csv
• Test.Subscriptions.txt
• freetube-subscriptions.json

Change file extension .txt to .db

(Notice how much faster importing subscriptions is)

Desktop

• OS: Windows
• OS Version: 10
• FreeTube version: 0.19.1

[PikachuEXE]

Also I wonder if the prompt should be auto closed after import is done

[kommunarr]

issue (non-blocking): Minor z-index issue on the tooltip.

[kommunarr]

issue (blocking): The tooltip text could use a bit more clarity on the implications of the choice & what exactly is at stake (pros and/or cons). As a user, the tooltip opens up more questions for me than it answers.

question: I'm also missing some context on the intention of this change. Is this more of a temporary workaround to that issue, a longer-term workaround because that issue has no clear fix, a way to reduce requests that is worthy as a feature on its own merits, or some mix of the three? A clearer tooltip as mentioned above would clear up my confusion.

[ChunkyProgrammer]

issue (blocking): The tooltip text could use a bit more clarity on the implications of the choice & what exactly is at stake (pros and/or cons). As a user, the tooltip opens up more questions for me than it answers.

question: I'm also missing some context on the intention of this change. Is this more of a temporary workaround to that issue, a longer-term workaround because that issue has no clear fix, a way to reduce requests that is worthy as a feature on its own merits, or some mix of the three? A clearer tooltip as mentioned above would clear up my confusion.

The main purpose is to avoid rate limiting when importing subscriptions from other sources (invidious, newpipe, youtube) but disabling the toggle also fixes other issues for channels that are age restricted, deleted, etc. as we handle that logic on the subscription page already. It also greatly improves the speed of importing subscriptions.

Now that I think about it, I wonder if I should just remove the prompt and not make any extra requests during the import at all.

[absidue]

One worry I have with adding the thumbnail fetching to the side bar, is that we might just be moving the ratelimiting problem to the side bar. #4231 will make the problem worse though as it allows you to display up to 5 columns of channels in the sidebar at the same time.

Another option instead of doign nothing is doing a much smaller number of requests e.g. maximum 50 requests, that way it won't get ratelimited but it'll still be able to show thumbnails for a bunch of channels straight away.

Also it should probably be made more robust so it can actually skip deleted/removed channels without aborting the whole import process.

[absidue]

If we can avoid fetching data that would probably be best.

[ChunkyProgrammer]

If we can avoid fetching data that would probably be best.

Sounds good, I'll most likely update it this weekend to avoid fetching the data

[efb4f5ff-1298-471a-8973-3d47447115dc]

Could this fix #3211 (comment)?

[absidue]

Sounds like it would introduce the same issue to the side bar, that said comment mentions on the subscribed channels page, the the logic to fetch the thumbnails from the API when it's missing was copied/inspired from there.

[ChunkyProgrammer]

Could this fix #3211 (comment)?

I can't seem to reproduce that error, so it might be fixed or it might be a bit more complex

[kommunarr]

issue (very minor, non-blocking): When the channel thumbnail fails to load, it still shows something ugly for a few seconds until it corrects itself.

[ChunkyProgrammer]

issue (very minor, non-blocking): When the channel thumbnail fails to load, it still shows something ugly for a few seconds until it corrects itself.

The thumbnail failing to load is what's used for FreeTube to correct itself, I'm not sure if there's a better way to handle it than by failing to load an image and then making a request to get an image when it fails

[PikachuEXE]

Right now it seems that the new version relies on invalid url and error handler to update thumbnail URLs
To properly fix this a default image (URL) needs to be displayed and a handler (on show?) to conditionally update the thumbnail
Not sure if it's quick to implement

[github-actions]

Conflicts have been resolved. A maintainer will review the pull request shortly.

[github-actions]

This pull request has conflicts, please resolve those before we can evaluate the pull request.

[github-actions]

Conflicts have been resolved. A maintainer will review the pull request shortly.

[github-actions]

This pull request has conflicts, please resolve those before we can evaluate the pull request.

[github-actions]

Conflicts have been resolved. A maintainer will review the pull request shortly.

[github-actions]

This pull request has conflicts, please resolve those before we can evaluate the pull request.

[github-actions]

Conflicts have been resolved. A maintainer will review the pull request shortly.

[github-actions]

This pull request has conflicts, please resolve those before we can evaluate the pull request.

[ChunkyProgrammer]

I feel like this PR is more complicated than it needs to be. I might take a look at redoing this PR again but for now I will close it.