白丝美女被狂躁免费视频网站,500av导航大全精品,yw.193.cnc爆乳尤物未满,97se亚洲综合色区,аⅴ天堂中文在线网官网

Hierarchical token buckets

專利號
US11616725B1
公開日期
2023-03-28
申請人
Amazon Technologies, Inc.(US WA Seattle)
發(fā)明人
Salman Ahmad Syed; Sandeep Kumar
IPC分類
H04L47/125; H04L47/78; H04L47/215
技術(shù)領(lǐng)域
token,bucket,tokens,service,host,throttle,request,requests,global,key
地域: WA WA Seattle

摘要

Systems and methods are provided for efficient handling of user requests to access shared resources in a distributed system, which handling may include throttling access to resources on a per-resource basis. A distributed load-balancing system can be logically represented as a hierarchical token bucket cache, where a global cache contains token buckets corresponding to individual resources whose tokens can be dispensed to service hosts each maintaining a local cache with token buckets that limit the servicing of requests to access those resources. Local and global caches can be implemented with a variant of a lazy token bucket algorithm to enable limiting the amount of communication required to manage cache state. High granularity of resource management can thus enable increased throttle limits on user accounts without risking overutilization of individual resources.

說明書

Embodiments of the present disclosure enable this level of granularity in throttling requests. More specifically, a load-balancing system as described herein can include a configurable granularity of request throttling to control access to specific resources according to the needs of each resource. Illustratively, requests to access a given resource, such as a storage snapshot, may be throttled according various parameters of each request, such as to the snapshot to be accessed, the API used to access it, the client account requesting access, etc. Any individual parameter, or combination of these parameters may make up a resource access key used to throttle the requests. Under this configuration, a client may send requests up to the throttle limit for a given key, and the service host may throttle any future requests for that key, but may continue to service requests for a different key. Thus, the client's account-level throttle limit may be increased over the throttle limit for a given resource without creating a risk that the client will starve access to that resource.

權(quán)利要求

1
微信群二維碼
意見反饋