Is there a way to boost the speed and lower the weight on access devices? about nextcloud-snap HOT 34 CLOSED

Is there maybe any way to remove the load from the client device I unsure if it is maybe my Mac! I maybe need to try tomorrow some other devices but with the mail loading I am sure that is a nextcloud problem that it loads them very slow I had used it today on several device to access the mails fast and on every device it loaded very slow and like in the video I had to wait until it loaded the next ones!

The slow mail loading is annoying me is there really no way to improve the mail loading?

from nextcloud-snap.

Looking at your videos...

• The upload seems to be fine. Each photo has a few megabyte and Nextcloud usually uploads every single file doesn't that in parallel (yet, bulk upload was introduced already but not sure where and when it should work currently).
• Looking on a photo is very slow for you. Well, it normally takes a few seconds if you recently uploaded the video. The "previews" of the photo are not generated yet and needs a lot of resources on the server. Q: Does it load faster if you load a photo once, then close it and open it again?
• The performance of the mail app seems to be fine while scrolling. There is nothing I would worry about. The mails do load on demand when you scroll down. But it very slow on switching the mailboxes. The first time I would understand that but not if this happens again and again.

Why does the NC uses the client cpu should it not use the servers one so that it performs the best!?

The client needs to calculate a checksum for each single file and even for each single chunk it does upload. The client just has todo some calculation. Shouldn't be too havy but yea, it's more then nothing.
The server then needs to do the same reverse and also access the storage drive. It also add some entries to the database and update some others. Again, checksum calculation is done here too.

However, there is another few things I have in mind that you could check at least.

1. Do you have a reverse proxy between your nextcloud and the internet / the clients?
2. What is the content of your /etc/hosts file?
3. Do you have http compression enabled?
4. What is your debug level? Set the set to production mode via sudo snap set nextcloud mode=debug and set Nextclouds log level to warning via sudo nextcloud.occ config:system:set log_level 2

from nextcloud-snap.

DELL power edge r730xd
Ram: 256gb
HDD Total: 12tb
24 core

whistle. Can you confirm you have the snap installed on bare metal? Or is it within a VM or LXC container, or something similar? Also, the storage (both where the snap is installed as well as the data directory, if different): are they SSDs? Or spinning disks?

from nextcloud-snap.

• Please show active users? (administrative settings -> system -> Active users)
• Please show active users during performance issues? (administrative settings -> system -> Active users)

• Which clients are being used?
  • Browser
  • Nextcloud app
  • Android
  • IOS
• Are you talking about files synchronising or only files uploading?
• Please show your PHP memory limit setting (administrative settings -> system -> PHP)

from nextcloud-snap.

I want that the Content loads faster when I access it from the browser Media and Mails because it is sometimes very slow and sometimes nextcloud dashboard crashes in some kind the screen is then nearly white when I upload a bunch of files!:

https://youtu.be/N6HCmIYDYww

https://youtu.be/jUZLJeerT4s

https://youtu.be/SI38H3qpjyY

https://youtu.be/h_Swq2nAN1Y

you not need to watch the hole videos but try to understand what I mean when you ee the screen recordings and when I recorded the videos it were better then usually the performance!! Often the videos need long to load and on one android devices like an Alexa the loading took over 1min 30sec the nextcloud dashboard loading!

Just that you are not wondering why there are several name I help some friends to manage their websites and those email addresses are the one where security mails and such stuff comes to!

from nextcloud-snap.

I user Browser to Access Just to tell it clearly!

from nextcloud-snap.

@alfi4000, there is nothing wrong with your system settings as far as I can tell from the screenshots.

in your video clips it seems like the mail app is on the slow side. but that isn't something you can change by tuning the system. as mentioned before, try a different mail app like Snappymail and see if that works better for you.

as for the photo uploads, this may depend on your internet connection, photo file size etc. ... but judging by your system specs, you'll have superb bandwidth too?

I'm not a sysadmin nor a developer, but honestly there is nothing I can think of to speed up your system. It would be great to compare what you're seeing to a different install, just so we could see if it has anything to do with the snap?

from nextcloud-snap.

@alfi4000 ...come to think of it, could you list your apps please? judging by your server name and the 3rd party issue you've had recently, I have the suspicion that you may be running some sort of AI app that is trying to scan your data locally.

Please list your apps by issuing command on the host:

sudo nextcloud.occ app:list

from nextcloud-snap.

from nextcloud-snap.

@alfi4000 so there are some apps installed... but nothing really troublesome that meets the eye. the only app that could be scanning files locally is the files_antivirus app as far as I can tell. Try disabling that and see if it speeds up things:

sudo nextcloud.occ app:disable files_antivirus

the reason being, that usually antivirus on linux depends on ClamAV which needs to be installed on the host. Now due to confinement there is no way for the snap to access ClamAV on the host and vice versa leading to failure for every file that needs to be scanned... which would be every file that's uploaded. hence your issues upon uploading files.

maybe @Pilzinsel64 could have a look if he sees anything else that may be suspicious?

-- side note --

if you don't have CODE & Nextcloud Office configured at all then you may as well remove richdocuments too:

sudo nextcloud.occ app:disable richdocuments

from nextcloud-snap.

I use files_antivirus but it only scans files before they get uploaded but disabling doesn't improve the performance! But suddenly toady it stoped working or maybe since the recent! idk
And sudo nextcloud.occ app:disable richdocuments code & Nextcloud office either not improve the performance when I disable them any suggests?

from nextcloud-snap.

any other way to improve loading speed and so o with more ram or so?

from nextcloud-snap.

I already set something higher that speeded something up I just can't remember what I changed I think ram (memory limit) but not sure what it improved its a few months ago! I think it were file loading speed it improved, but I am not sure too long ago!

from nextcloud-snap.

This had let me think:

#1822 (comment)

Why does the NC uses the client cpu should it not use the servers one so that it performs the best!? I know when I transfer files that cpu on the client will be used for transfer process but for mail loading and so on should it not use the server cpus? Or have I got something wrong?!

from nextcloud-snap.

any other way to improve loading speed and so o with more ram or so?

nope, your ram is more than sufficient, I'd say its totally overkill 👌

I already set something higher that speeded something up I just can't remember what I changed I think ram (memory limit) but not sure what it improved its a few months ago! I think it were file loading speed it improved, but I am not sure too long ago!

that may have been your PHP memory limit which can make a difference when you have many users and clients connected. I'm not sure if 10GB is overkill on your system with 1 user? My corporate instance with similar system specs has +120 users maxing out at 30 - 40 users during office hours... and is set to 2GB. I've never had complaints.

from nextcloud-snap.

@kyrofa
I am running it locally on my own server!
Spinning disks but very fast ones it writes 40mb sec.
It runs directly on ubuntu server 22.4.3 not VM or container between the host system and the instance!

from nextcloud-snap.

Spinning disks but very fast ones it writes 40mb sec.

They still have a reaction time, like when they leave its standby mode. And if you access many minor files (and yes, that happens on each access to the website as some js and ohter files are located in the appdata folder of Nextcloud's data directory) HDDs need some time to move it's reader to the right position.

I have a 4 TB SSD (normal one, not a special one for NAS or Gaming) as primary data storage and a 4 TB HDD as backup storage. Since I have that SSD the general performance of my cloud instance has increased a lot.

@alfi4000 Do you have a reverse proxy between the Nextcloud server and the clients?

from nextcloud-snap.

@Pilzinsel64

1. do you mean in nextcloud the function reverse proxy or the router between client and server?
2. Some Ai stuff but those things are not active just some files!
3. No I haven't!
4. sudo nextcloud.occ config:system:set log_level 2
   System config value log_level => 2 set to empty string

from nextcloud-snap.

@Pilzinsel64
Oh I didn't know that there is a difference between those storage just that ssd is faster then HDD and NVMe faster then SSD and HDD!

from nextcloud-snap.

@Pilzinsel64
Shloud I use reverse proxy I have done I web search it says a reverse proxy is for more security and better performance for the client!?

from nextcloud-snap.

Shloud I use reverse proxy I have done I web search it says a reverse proxy is for more security and better performance for the client!?

No, @Pilzinsel64 is just trying to get a handle on your setup is all. You don't need one, it could (negatively) impact performance is all, so it's something we need to know.

from nextcloud-snap.

i am getting crazy now nextcloud just load and load audio and video files but it cant play them I get crazy!
Yesterday I also had some trouble with uploading but then it worked after 15min waiting I don't get what I am doing wrong! It looks like nextcloud is unable to play the files image files and docs work prefect!:

https://youtu.be/Sa_tsYaCD3c

from nextcloud-snap.

oh ok @kyrofa

from nextcloud-snap.

@alfi4000 try dropping your video file here compare upload speed... take note. Then view the file.

from nextcloud-snap.

@scubamuc
I uploaded a test video so all the same speed is slower then mine but its different server and also over the internet its might be a bit slower so all the same just I can't play the video when I uploaded it ! It just Loads and loads but nothing happens! is it might a problem on my computer (client device) can you play the video its named video 5.mov and the playback problem is the same with the files you uploaded there!

from nextcloud-snap.

@alfi4000 yeah, I can view video 5.mov without issues... in that case it may well be a client issue:

I've removed the share and stopped the server.

from nextcloud-snap.

Yeah I found the issue when I tried to do a internet speed test because I tried to upload a short video then it started to load the video look at this insane :/ :

Something is wrong with my client device!

from nextcloud-snap.

simple html5 speedtest

from nextcloud-snap.

Thanks the connection is very unstable I have seen and the computer has some problems I need to fix that wasn't normal that he has started to operate when I tried to do a speed test maybe something does things what it shouldn't!

from nextcloud-snap.

I have to check what is running in the background!

from nextcloud-snap.

Hhm all looks good I'll have a look on it the next few days! But now everything works ok!

from nextcloud-snap.

But is there not a way to boost the mail loading in my opinion it could be a way faster! or is that normal with cron jobs (I am unfamiliar with cron jobs I just know them from wordpress!)?

from nextcloud-snap.

@alfi4000 you should definitely enable HTTPS encryption. That will speed up things considerably, especially with http compression

see your follow up issue #2683

so I'll go ahead and close this then...

from nextcloud-snap.

Ok thanks to you all guys how helped me!!!

from nextcloud-snap.