Some solutions I have encountered:
> Take it every 1 minute; if there is no change, get 2, then 4, then 8, etc. .
>Find the average update interval/variance of the RSS feed and put them in the bucket (updated every 3 minutes, so check every 1 minute; update once a week, so check once a day, etc.)
You can use different percentages, such as reducing faster Respond to the time of the update frequency change.
Include the minimum and maximum time span to keep waiting within a predefined range.
It is not perfect but it is enough for me.
I have a system that can get hundreds of RSS feeds. At the moment they are in a 10-minute refresh cycle, but I better hope that it will be faster. Near real-time/push What is the strategy for obtaining RSS feeds at intervals?
Some solutions I have encountered:
> Take it every 1 minute; if there is no change, get 2, then 4, then 8, etc. .
>Find the average update interval/variance of the RSS feed and put them in the bucket (updated every 3 minutes, so check every 1 minute; update once a week, so check once a day, etc.)
I have used something like you. Start with the default time before retrieving the feed. If a new item is found, the waiting period is reduced by 10%, otherwise it is increased 10%. This adjustment must be performed for each update, and the system will adjust itself.
You can use different percentages, such as reducing the time to respond to changes in update frequency more quickly.
Include the minimum and maximum time span to keep waiting within a predefined range.
It’s not perfect but it’s enough for me.
< /p>