白丝美女被狂躁免费视频网站,500av导航大全精品,yw.193.cnc爆乳尤物未满,97se亚洲综合色区,аⅴ天堂中文在线网官网

Hierarchical token buckets

專(zhuān)利號(hào)
US11616725B1
公開(kāi)日期
2023-03-28
申請(qǐng)人
Amazon Technologies, Inc.(US WA Seattle)
發(fā)明人
Salman Ahmad Syed; Sandeep Kumar
IPC分類(lèi)
H04L47/125; H04L47/78; H04L47/215
技術(shù)領(lǐng)域
token,bucket,tokens,service,host,throttle,request,requests,global,key
地域: WA WA Seattle

摘要

Systems and methods are provided for efficient handling of user requests to access shared resources in a distributed system, which handling may include throttling access to resources on a per-resource basis. A distributed load-balancing system can be logically represented as a hierarchical token bucket cache, where a global cache contains token buckets corresponding to individual resources whose tokens can be dispensed to service hosts each maintaining a local cache with token buckets that limit the servicing of requests to access those resources. Local and global caches can be implemented with a variant of a lazy token bucket algorithm to enable limiting the amount of communication required to manage cache state. High granularity of resource management can thus enable increased throttle limits on user accounts without risking overutilization of individual resources.

說(shuō)明書(shū)

The workloads supported in data centers, such as execution of processes on virtual machine resources, vary in their utilization of computing resource. It is typically desirable to ensure that a given computing resource is not overutilized by a single user. Accordingly, many data centers limit the number of workload requests a user can make to access the data center's resources.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram depicting an illustrative environment in which a distributed load-balancing system can operate to prevent overutilization of shared computing resources.

FIG. 2 is an illustrative visualization of various components of a distributed load-balancing system implemented in accordance with aspects of the present disclosure.

FIG. 3 depicts illustrative interactions on the distributed load-balancing system of FIG. 2 to handle a user request for access to a shared resource.

FIG. 4 depicts illustrative interactions on the distributed load-balancing system of FIG. 2 to throttle a user request for access to a shared resource.

FIG. 5 depicts an illustrative routine implemented on the distributed load-balancing system of FIG. 2 to facilitate the interactions of FIG. 3 and FIG. 4.

權(quán)利要求

1
微信群二維碼
意見(jiàn)反饋