Redis / AOF - Magento 2.4.6-p3 about magento2 HOT 16 OPEN

Hi @Nuranto. Thank you for your report.
To speed up processing of this issue, make sure that the issue is reproducible on the vanilla Magento instance following Steps to reproduce. To deploy vanilla Magento instance on our environment, Add a comment to the issue:

• @magento give me 2.4-develop instance - upcoming 2.4.x release
• For more details, review the Magento Contributor Assistant documentation.
• Add a comment to assign the issue: @magento I am working on this
• To learn more about issue processing workflow, refer to the Code Contributions.

Join Magento Community Engineering Slack and ask your questions in #github channel.
⚠️ According to the Magento Contribution requirements, all issues must go through the Community Contributions Triage process. Community Contributions Triage is a public meeting.
🕙 You can find the schedule on the Magento Community Calendar page.
📞 The triage of issues happens in the queue order. If you want to speed up the delivery of your contribution, join the Community Contributions Triage session to discuss the appropriate ticket.

from magento2.

Update : We still have issues with RDB. So the issue could be the number of sessions that increased, or the size of them. We'll continue investigate.

from magento2.

@Nuranto it could be related to Magento CSP:
Please check: #29964

from magento2.

I'm not sure, this ticket seems related to cache. We only have issues with sessions.

from magento2.

Not many session related changes at first sight: https://github.com/magento/magento2/compare/2.4.6-p2..2.4.6-p3

Maybe one of the recent changes in these 3 repositories causes it?

• https://github.com/colinmollenhour/php-redis-session-abstract
• https://github.com/colinmollenhour/Cm_Cache_Backend_Redis
• https://github.com/colinmollenhour/credis

from magento2.

Yes, that was my thought too.
But you're right, redis dependencies have been updated at the same time, I'll look into it, thanks.

from magento2.

I have a similar issue. After upgrade Magento from 2.3.5 to 2.4.6-p2, Redis memory start to grow very very fast and arrived to 11 GB.
In my case memory saturation seems not to be related to session, because I use 2 different Redis instances: one for sessions and one for caches. Instance that manage sessions does not have any problems, while instance that manage backend cache saturate his memory.
I observer that the isseu seems to be related to 2 type of magento cache:

• layout
• block_html

if i flush theese caches, memory size of redis return to (around) 300MB.

from magento2.

Hi @engcom-November. Thank you for working on this issue.
In order to make sure that issue has enough information and ready for development, please read and check the following instruction: 👇

• 1. Verify that issue has all the required information. (Preconditions, Steps to reproduce, Expected result, Actual result).
• 2. Verify that issue has a meaningful description and provides enough information to reproduce the issue.
• 3. Add Area: XXXXX label to the ticket, indicating the functional areas it may be related to.
• 4. Verify that the issue is reproducible on 2.4-develop branch
  Details

  - Add the comment @magento give me 2.4-develop instance to deploy test instance on Magento infrastructure.
  - If the issue is reproducible on 2.4-develop branch, please, add the label Reproduced on 2.4.x.
  - If the issue is not reproducible, add your comment that issue is not reproducible and close the issue and stop verification process here!
• 5. Add label Issue: Confirmed once verification is complete.
• 6. Make sure that automatic system confirms that report has been added to the backlog.

from magento2.

Hello @Nuranto,

Thank you for the report and collaboration!

We configured redis for session with readonly, and upgraded from 2.4.6-p2 to the latest 2.4.7-beta2.
But we didn't see any significant increase in redis size.
Please take a look at the screenshot:
This is the reddis size with 2.4.6-p2

And this is when upgraded to 2.4.7-beta2

Please let us know if we are missing anything.

Thank you.

from magento2.

Same problem over here will multiple shops and Redis page cache.

from magento2.

@Nuranto Were you able to fix it? What version of redis are you running, was it upgraded along with Magento?

from magento2.

We're currently updating to 2.4.6-p3 in hopes to solve our Redis issues, this does not sound promising. Has anyone determined the issue yet?

from magento2.

Hi @goivvy, no we did not upgrade redis along with magento. We're running on redis 7.0.14. And we stabilized this by disabling AOF

from magento2.

I just noticed this commit made in core magento that limits 2 of the redis packages to a certain version (according to the commit message - in broken English - it sounds like newer versions of these packages have performance issues): 9369884

from magento2.

@Nuranto, @hostep we were not able to reproduce this issue on vanilla 2.4-develop instance with redis AOF turned on.
Are there any additional things required in order to reproduce this issue, for example should we have a large number of data in magento instance or large number of traffic is required?
could you please provide more information on this.

Thank you.

from magento2.

@Nuranto, @hostep we were not able to reproduce this issue on vanilla 2.4-develop instance with redis AOF turned on. Are there any additional things required in order to reproduce this issue, for example should we have a large number of data in magento instance or large number of traffic is required? could you please provide more information on this.

Thank you.

We're all experiencing the issue. It's not new to the most recent version, it's been a problem through all past versions. I am guessing you installed vanilla magento, with no data, and no traffic? You'll need a large catalog and simulated traffic to reproduce this issue.

from magento2.