Hi Atlassian,
I saw that you announced a new points-based rate limit system in CHANGE-2958, which is going live in 48 days.
This announcement leaves a number of things ambiguous and I am hoping that you can provide some clarifications:
-
Previously, rate limits were documented as applying only to back-end calls. With the new points-based system, will rate limits also be applied to front-end calls?
-
Forge is not currently capable of providing rate-limit headers to front-end code (ECO-899, FRGE-1923). If the rate limits will be applied to front-end code too, can the implementation date of this change please be bumped to give the Forge team time to fix the issue, as well as to give at least a 60-day buffer on top of that so that vendors have time to implement and deploy changes on their end?
-
The timing of a refreshed-once-per-hour token bucket is far too harsh. With one bucket shared across tenants, whenever any tenant causes the app to exceed its token limit (for whatever reason), this effectively causes a DoS for all other customers for up to one one hour. Given that most customers are paying for Marketplace apps, this length of outage is not acceptable. Can Atlassian propose an enforcement system that is less destructive to the vendor/customer relationship? Ways to work around this might include: use a smaller token window (instead of 65k/hour, what about 1083/minute, with some burst ability)? Or providing degraded response times rather than completely stopping service? Even switching all apps to tier 2 is not a cure, because although that limits the blast radius to just one customer, you are still putting the entire app’s functionality out of service for an extended period of time.
-
How are migrations (DC to Cloud, Cloud to Cloud) treated in this new scheme? DC->Cloud migrations typically require a specific header for API calls. Are migration requests included in the new token bucket or not?
-
You wrote: “Planned updates to the developer console to show which tier your app belongs to ahead of the enforcement”. Can Atlassian be more precise about when this is going to be made available? We already do not have a lot of time (48 days) and vendors need time to pivot and react.
-
The Confluence page states: “Each request must stay within the maximum allowed cost per request”. What does this mean? What is the “maximum allowed cost per request”?
-
Do requests that return multiple objects of a type incur a point-based cost for every single object? For example, if I request a group object that contains 15 users, am I billed 15*2=30 points for this request? (If an app inadvertently requests an enterprise group that contains 30,000 users, does that exhaust the app’s token bucket with one request?)
-
The changelog says “If your app requires additional capacity in the future, rest assured we will provide clear pathways to request for this”. These clear pathways seem to be missing. What is the escalation path for getting an app moved into tier 2? Can there please be a specific contact point, an ECOHELP ticket type, or something else public that gives vendors a visible path to request this? And, pretty please, establish and publish a SLA for resolving these type of requests that is proportional to how critical this is (hours or less)? When an app hits the limit for tier 1, this creates a critical issue where users cannot use the app, so vendors need a quick way to resolve this. Again, this is going live in less than two months and this would ideally not be a “we’ll post the details eventually” item.
-
Is Atlassian planning to proactively reach out to all existing vendors who are already above (say) 50% of the tier 1 limits to let them know about these changes and where the vendors’ apps currently stand?
-
Do the current rate limit headers exposed in production allow vendors to already see their current points-based consumption? (I admit that I have not checked.) If not, when will this be shipped?
-
The Confluence page says: “We plan to expand our catalog in the future to provide more detail on object costs. Most requests are dominated by object costs”. When will this detail be delivered? Again, this is going live in less than two months and vendors need to better understand object cost for planning purposes.
Thanks!
Scott