Random-sampling mechanism

From HandWiki

A random-sampling mechanism (RSM) is a truthful mechanism that uses sampling in order to achieve approximately-optimal gain in prior-free mechanisms and prior-independent mechanisms. Suppose we want to sell some items in an auction and achieve maximum profit. The crucial difficulty is that we do not know how much each buyer is willing to pay for an item. If we know, at least, that the valuations of the buyers are random variables with some known probability distribution, then we can use a Bayesian-optimal mechanism. But often we do not know the distribution. In this case, random-sampling mechanisms provide an alternative solution.

RSM in large markets

Market-halving scheme

When the market is large, the following general scheme can be used:[1]:341–344

  1. The buyers are asked to reveal their valuations.
  2. The buyers are split to two sub-markets, [math]\displaystyle{ M_L }[/math] ("left") and [math]\displaystyle{ M_R }[/math] ("right"), using simple random sampling: each buyer goes to one of the sides by tossing a fair coin.
  3. In each sub-market [math]\displaystyle{ M_s }[/math], an empirical distribution function [math]\displaystyle{ F_s }[/math] is calculated.
  4. The Bayesian-optimal mechanism (Myerson's mechanism) is applied in sub-market [math]\displaystyle{ M_R }[/math] with distribution [math]\displaystyle{ F_L }[/math], and in [math]\displaystyle{ M_L }[/math] with [math]\displaystyle{ F_R }[/math].

This scheme is called "Random-Sampling Empirical Myerson" (RSEM).

The declaration of each buyer has no effect on the price he has to pay; the price is determined by the buyers in the other sub-market. Hence, it is a dominant strategy for the buyers to reveal their true valuation. In other words, this is a truthful mechanism.

Intuitively, by the law of large numbers, if the market is sufficiently large then the empirical distributions are sufficiently similar to the real distributions, so we expect the RSEM to attain near-optimal profit. However, this is not necessarily true in all cases. It has been proved to be true in some special cases.

The simplest case is digital goods auction. There, step 4 is simple and consists only of calculating the optimal price in each sub-market. The optimal price in [math]\displaystyle{ M_L }[/math] is applied to [math]\displaystyle{ M_R }[/math] and vice versa. Hence, the mechanism is called "Random-Sampling Optimal Price" (RSOP). This case is simple because it always calculates feasible allocations. I.e, it is always possible to apply the price calculated in one side to the other side. This is not necessarily the case with physical goods.

Even in a digital goods auction, RSOP does not necessarily converge to the optimal profit. It converges only under the bounded valuations assumption: for each buyer, the valuation of the item is between 1 and [math]\displaystyle{ h }[/math], where [math]\displaystyle{ h }[/math] is some constant. The convergence rate of RSOP to optimality depends on [math]\displaystyle{ h }[/math]. The convergence rate also depends on the number of possible "offers" considered by the mechanism.[2]

To understand what an "offer" is, consider a digital goods auction in which the valuations of the buyers, in dollars, are known to be bounded in [math]\displaystyle{ [1,h] }[/math]. If the mechanism uses only whole dollar prices, then there are only [math]\displaystyle{ h }[/math] possible offers.

In general, the optimization problem may involve much more than just a single price. For example, we may want to sell several different digital goods, each of which may have a different price. So instead of a "price", we talk on an "offer". We assume that there is a global set [math]\displaystyle{ G }[/math] of possible offers. For every offer [math]\displaystyle{ g\in G }[/math] and agent [math]\displaystyle{ i }[/math], [math]\displaystyle{ g(i) }[/math] is the amount that agent [math]\displaystyle{ i }[/math] pays when presented with the offer [math]\displaystyle{ g }[/math]. In the digital-goods example, [math]\displaystyle{ G }[/math] is the set of possible prices. For every possible price [math]\displaystyle{ p }[/math], there is a function [math]\displaystyle{ g_p }[/math] such that [math]\displaystyle{ g_p(i) }[/math] is either 0 (if [math]\displaystyle{ v_i\lt p }[/math]) or [math]\displaystyle{ p }[/math] (if [math]\displaystyle{ v_i\geq p }[/math]).

For every set [math]\displaystyle{ S }[/math] of agents, the profit of the mechanism from presenting the offer [math]\displaystyle{ g }[/math] to the agents in [math]\displaystyle{ S }[/math] is:

[math]\displaystyle{ g(S) := \sum_{i\in S} g(i) }[/math]

and the optimal profit of the mechanism is:

[math]\displaystyle{ OPT_G(S) := \max_{g\in G} g(S) }[/math]

The RSM calculates, for each sub-market [math]\displaystyle{ M_s }[/math], an optimal offer [math]\displaystyle{ g_s }[/math], calculated as follows:

[math]\displaystyle{ g_s := \arg\max_{g\in G} g(M_s) }[/math]

The offer [math]\displaystyle{ g_L }[/math] is applied to the buyers in [math]\displaystyle{ M_R }[/math], i.e.: each buyer [math]\displaystyle{ i\in M_R }[/math] who said that [math]\displaystyle{ g_L(i)\gt 0 }[/math] receives the offered allocation and pays [math]\displaystyle{ g_L(i) }[/math]; each buyer in [math]\displaystyle{ M_R }[/math] who said that [math]\displaystyle{ g_L(i)=0 }[/math] do not receive and do not pay anything. The offer [math]\displaystyle{ g_R }[/math] is applied to the buyers in [math]\displaystyle{ M_L }[/math] in a similar way.

Profit-oracle scheme

Profit oracle is another RSM scheme that can be used in large markets.[3] It is useful when we do not have direct access to agents' valuations (e.g. due to privacy reasons). All we can do is run an auction and watch its expected profit. In a single-item auction, where there are [math]\displaystyle{ n }[/math] bidders, and for each bidder there are at most [math]\displaystyle{ K }[/math] possible values (selected at random with unknown probabilities), the maximum-revenue auction can be learned using:

[math]\displaystyle{ O(n^2 K^2) }[/math]

calls to the oracle-profit.

RSM in small markets

RSMs were also studied in a worst-case scenario in which the market is small. In such cases, we want to get an absolute, multiplicative approximation factor, that does not depend on the size of the market.

Market-halving, digital goods

The first research in this setting was for a digital goods auction with Single-parameter utility.[4]

For the Random-Sampling Optimal-Price mechanism, several increasingly better approximations have been calculated:

  • By,[5] the mechanism profit is at least 1/7600 of the optimal.
  • By,[6] the mechanism profit is at least 1/15 of the optimal.
  • By,[7] the mechanism profit is at least 1/4.68 of the optimal, and in most cases 1/4 of the optimal, which is tight.

Single-sample, physical goods

When the agents' valuations satisfy some technical regularity condition (called monotone hazard rate), it is possible to attain a constant-factor approximation to the maximum-profit auction using the following mechanism:[8]

  • Sample a single random agent and query his value (the agents are assumed to have single-parameter utility).
  • On the other agents, run a VCG auction with reserve-price determined by the sampled agent.

The profit of this mechanism is at least [math]\displaystyle{ {n-1 \over 4n} }[/math], where [math]\displaystyle{ n }[/math] is the number of agents. This is 1/8 when there are two agents, and grows towards 1/4 as the number of agents grows. This scheme can be generalized to handle constraints on the subsets of agents that can win simultaneously (e.g., there is only a finite number of items). It can also handle agents with different attributes (e.g. young vs. old bidders).

Sample complexity

The sample complexity of a random-sampling mechanism is the number of agents it needs to sample in order to attain a reasonable approximation of the optimal welfare.

The results in [8] imply several bounds on the sample-complexity of revenue-maximization of single-item auctions:[9]

  • For a [math]\displaystyle{ 1/4 }[/math]-approximation of the optimal expected revenue, the sample-complexity is [math]\displaystyle{ 1 }[/math] - a single sample suffices. This is true even when the bidders are not i.i.d.[10]
  • For a [math]\displaystyle{ 1-\epsilon }[/math]-approximation of the optimal expected revenue, when the bidders are i.i.d OR when there is an unlimited supply of items (digital goods), the sample-complexity is [math]\displaystyle{ O(1/\epsilon^2) }[/math] when the agents' distributions have monotone hazard rate, and [math]\displaystyle{ O(1/\epsilon^3) }[/math] when the agents' distributions are regular but do not have monotone-hazard-rate.

The situation becomes more complicated when the agents are not i.i.d (each agent's value is drawn from a different regular distribution) and the goods have limited supply. When the agents come from [math]\displaystyle{ k }[/math] different distributions, the sample complexity of [math]\displaystyle{ 1-\epsilon }[/math]-approximation of the optimal expected revenue in single-item auctions is:[9]

  • at most [math]\displaystyle{ O({k^{10}\over \epsilon^7}\ln^3{k\over\epsilon}) }[/math] - using a variant of the empirical Myerson auction.
  • at least [math]\displaystyle{ \Omega({k\over \sqrt{\epsilon\ln k}}) }[/math] (for monotone-hazard-rate regular valuations) and at least [math]\displaystyle{ \Omega({k\over \epsilon}) }[/math] (for arbitrary regular valuations).

[11] discuss arbitrary auctions with single-parameter utility agents (not only single-item auctions), and arbitrary auction-mechanisms (not only specific auctions). Based on known results about sample complexity, they show that the number of samples required to approximate the maximum-revenue auction from a given class of auctions is:

[math]\displaystyle{ O\bigg(({H\over \epsilon})^2(D \ln ({H\over \epsilon})+\ln({1\over\delta}))\bigg) }[/math]

where:

  • the agents' valuations are bounded in [math]\displaystyle{ [1,H] }[/math],
  • the pseudo-VC dimension of the class of auctions is at most [math]\displaystyle{ D }[/math],
  • the required approximation factor is [math]\displaystyle{ 1-\epsilon }[/math],
  • the required success probability is [math]\displaystyle{ 1-\delta }[/math].

In particular, they consider a class of simple auctions called [math]\displaystyle{ t }[/math]-level auctions: auctions with [math]\displaystyle{ t }[/math] reserve prices (a Vickrey auction with a single reserve price is a 1-level auction). They prove that the pseudo-VC-dimension of this class is [math]\displaystyle{ O(nt \ln (nt)) }[/math], which immediately translates to a bound on their generalization error and sample-complexity. They also prove bounds on the representation error of this class of auctions.

Envy

A disadvantage of the random-sampling mechanism is that it is not envy-free. E.g., if the optimal prices in the two sub-markets [math]\displaystyle{ M_L }[/math] and [math]\displaystyle{ M_R }[/math] are different, then buyers in each sub-market are offered a different price. In other words, there is price discrimination. This is inevitable in the following sense: there is no single-price strategyproof auction that approximates the optimal profit.[12]

See also

References

  1. Vazirani, Vijay V.; Nisan, Noam; Roughgarden, Tim; Tardos, Éva (2007). Algorithmic Game Theory. Cambridge, UK: Cambridge University Press. ISBN 0-521-87282-0. http://www.cs.cmu.edu/~sandholm/cs15-892F13/algorithmic-game-theory.pdf. 
  2. Balcan, Maria-Florina; Blum, Avrim; Hartline, Jason D.; Mansour, Yishay (2008). "Reducing mechanism design to algorithm design via machine learning". Journal of Computer and System Sciences 74 (8): 1245. doi:10.1016/j.jcss.2007.08.002. 
  3. Edith Elkind (2007). "Designing And Learning Optimal Finite Support Auctions". SODA. 
  4. Goldberg, Andrew V.; Hartline, Jason D. (2001). "Competitive Auctions for Multiple Digital Goods". Algorithms — ESA 2001. Lecture Notes in Computer Science. 2161. pp. 416. doi:10.1007/3-540-44676-1_35. ISBN 978-3-540-42493-2. 
  5. Goldberg, Andrew V.; Hartline, Jason D.; Karlin, Anna R.; Saks, Michael; Wright, Andrew (2006). "Competitive auctions". Games and Economic Behavior 55 (2): 242. doi:10.1016/j.geb.2006.02.003. 
  6. Feige, Uriel; Flaxman, Abraham; Hartline, Jason D.; Kleinberg, Robert (2005). "On the Competitive Ratio of the Random Sampling Auction". Internet and Network Economics. Lecture Notes in Computer Science. 3828. pp. 878. doi:10.1007/11600930_89. ISBN 978-3-540-30900-0. 
  7. Alaei, Saeed; Malekian, Azarakhsh; Srinivasan, Aravind (2009). "On random sampling auctions for digital goods". Proceedings of the tenth ACM conference on Electronic commerce - EC '09. pp. 187. doi:10.1145/1566374.1566402. ISBN 9781605584584. 
  8. 8.0 8.1 Dhangwatnotai, Peerapong; Roughgarden, Tim; Yan, Qiqi (2015). "Revenue maximization with a single sample". Games and Economic Behavior 91: 318–333. doi:10.1016/j.geb.2014.03.011. 
  9. 9.0 9.1 Cole, Richard; Roughgarden, Tim (2014). "Proceedings of the 46th Annual ACM Symposium on Theory of Computing - STOC '14". pp. 243. doi:10.1145/2591796.2591867. ISBN 9781450327107. 
  10. Hartline, Jason D.; Roughgarden, Tim (2009). "Proceedings of the tenth ACM conference on Electronic commerce - EC '09". pp. 225. doi:10.1145/1566374.1566407. ISBN 9781605584584. 
  11. "On the Pseudo-Dimension of Nearly Optimal Auctions". NIPS. 2015. Bibcode2015arXiv150603684M. http://papers.nips.cc/paper/5766-on-the-pseudo-dimension-of-nearly-optimal-auctions. 
  12. Andrew V. Goldberg and Jason D. Hartline (2003). "Competitiveness via consensus". SODA '03. http://dl.acm.org/citation.cfm?id=644145. Retrieved 7 January 2016.