Social:Domain fronting

From HandWiki
Revision as of 16:59, 5 February 2024 by JTerm (talk | contribs) (over-write)
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Short description: Technique for Internet censorship circumvention
After TLS encryption is established, the HTTP header reroutes to another domain hosted on the same CDN.

Domain fronting is a technique for Internet censorship circumvention that uses different domain names in different communication layers of an HTTPS connection to discreetly connect to a different target domain than is discernable to third parties monitoring the requests and connections.

Due to quirks in security certificates, the redirect systems of the content delivery networks (CDNs) used as 'domain fronts', and the protection provided by HTTPS, censors are typically unable to differentiate circumvention ("domain-fronted") traffic from overt non-fronted traffic for any given domain name. As such they are forced to either allow all traffic to the domain front—including circumvention traffic—or block the domain front entirely, which may result in expensive collateral damage and has been likened to "blocking the rest of the Internet".[note 1]

Domain fronting does not conform to HTTP standards that require the SNI extension and HTTP Host header to contain the same domain.[citation needed] Many large cloud service providers, including Amazon, Microsoft, and Google, actively prohibit domain fronting, which has limited it as a censorship bypass technique. Pressure from censors in Russia and China is thought to have contributed to these prohibitions,[2][3][4] but domain fronting can also be used maliciously.

A newer variant of domain fronting, domain hiding, passes an encrypted request for one resource (say, a website), concealed behind an unencrypted (plaintext) request for another resource whose DNS records are stored in the same cloud. It has much the same effect.[2] Refraction networking is an application of the broader principle.

Technical details

Basis

The basis for domain fronting is using different domain names at different layers of communication with the servers (that supports multiple target domains; i.e. Subject Alternative Names) of a large hosting provider or a content delivery network (CDN). CDNs are used due to idiosyncrasies in how they route traffic and requests, which is what allows fronting to work.[5][6]

Obfuscating requests

In an HTTPS request, the destination domain name appears in three relevant places: the DNS query, the TLS Server Name Indication (SNI) extension, and the HTTPS Host header. Ordinarily the same domain name is listed in all three places.[7]:1

In a domain-fronted HTTPS request, one domain appears on the “outside” of an HTTPS request in plain text—in the DNS request and SNI extension—which will be what the client wants to pretend they are targeting in the connection establishment and is the one that is visible to censors, while a covert domain appears on the “inside”—in the HTTPS Host header, invisible to the censor under HTTPS encryption—which would be the actual target of the connection.[5][7]:2

# wget sends a DNS query and connects to www.google.com but the HTTP Host header requests
# the www.youtube.com webpage, which it is able to fetch and display. Here www.youtube.com
# is essentially domain-fronted by www.google.com; that is, by blocking www.youtube.com
# but allowing www.google.com, a censor may be trivially bypassed using a domain-fronted request
wget -q -O - https://www.google.com/ --header 'Host: www.youtube.com' | grep -o '<title>.*</title>'
<title>YouTube</title>

Due to encryption of the HTTPS hosts header by the HTTPS protocol, circumvention traffic is indistinguishable from 'legitimate' (non-fronted) traffic. Implementations of domain fronting supplement HTTPS with using large content delivery networks (such as various large CDNs) as their front domains,[7] which are relied on by large parts of the web for functionality.[8] To block the circumvention traffic, a censor will have to outright block the front domain.[7] Blocking popular content delivery networks is economically, politically, and diplomatically infeasible for most censors.[8][5]

When Telegram was blocked in April 2018 following a court ruling in Russia through ISP-blocking of the CDNs Telegram used as a front to evade blocks on its own IP addresses, 15.8 million IP addresses associated with Google and Amazon's CDN were blocked collaterally. This resulted in a large scale network outages for major banks, retail chains, and numerous websites; the manner of blocking was criticised for incompetence.[9]

Leveraging request forwarding

Domain fronting works with CDNs as—when served with two different domains in one request—they are (or historically speaking—they were; see §Disabling) configured to automatically fulfill a request to view/access the domain specified in the Hosts header even after finding the SNI extension to have a different domain. This behaviour was and is not universal across hosting providers; there are services that validate if the same domain is used in the different layers of an HTTP request. A variation of the usual domain fronting technique, known as domainless fronting may work in this case, which leaves the SNI field blank.[10]

If the request to access the Hosts header domain succeeds, to the censor or third parties monitoring connections, it appears that the CDN has internally forwarded the request to an uninteresting page within its network; this is the final connection they typically monitor. In circumvention scenarios, the domain in the Hosts header will be a proxy. The Hosts header domain, being a proxy, would be blocked by the censor if accessed directly; fronting hides its address from the censor and allows parties to evade blocks and access it. No traffic ever reaches the front domain specified in the DNS request and SNI extension; the CDN's frontend server is the only third-party in this interaction that can decrypt the Hosts header and know the true destination of the covert request. It is possible to emulate this same behaviour with host services that don't automatically forward requests, through a "reflector" web application.[7]:2

As a general rule, web services only forward requests to their own customers' domains, not arbitrary ones. It is necessary then for the blocked domains, that use domain fronting, to also be hosted by the same large provider as the innocuous sites they will be using as a front in their HTTPS requests (for DNS and STI).[7]:2

Domain hiding

Common secure internet connections (using TLS) have an unencrypted initial message, where the requesting client contacts the server. Server and client then negotiate an encrypted connection, and the actual content sent between them is encrypted. This conceals the content of the communication, but not the metadata: who is connecting to whom and when and how much they are communicating.[11][12] A variant of domain fronting, domain hiding, passes an encrypted request for one resource (say, a website), concealed behind an unencrypted (plaintext) request for another resource. If both resources have their DNS records hosted in the same cloud, internet servers reading the plaintext address will forward the request to the correct recipient, the cloud. The cloud server will then negotiate an encrypted connection, ignore the unencrypted address, and deliver the message to the (different) address sent over the encrypted channel. A third party spying on the connection can only read the plaintext, and is thus misled as to what resource the requester is connecting to.[2]

Usage

Internet censorship circumvention

Lantern

Lantern was affected.[13]

Signal

Signal, a secure messaging service, deployed domain fronting in builds of their apps from 2016 to 2018 to bypass blocks of direct connections to their servers from Egypt, Oman, Qatar and the United Arab Emirates.[14][8]

Tor Browser

The Tor anonymity network uses an implementation of domain fronting called 'meek' in its official web browser to bypass blocks to the Tor network.[6][8][5]

Telegram

Telegram used Amazon Web Services as a domain front to resist attempts to block the service in Russia.[15]

Telex

Telex was affected.[13]

Tor

Tor was affected, including pluggable transports obsf4, ScrambleSuite, meek, and meek_lite.[13]

GreatFire

GreatFire, a non-profit that assists users in circumventing the Great Firewall, used domain fronting at one point.[8]

Cyberattacks

Domain fronting has been used by private, and state-sponsored individuals and groups to cover their tracks and discreetly launch cyberattacks and disseminate malware.[8][5]

Cozy Bear

The Russian hacker group Cozy Bear, classed as APT29, has been observed to have used domain fronting to discreetly gain unauthorised access to systems by pretending to be legitimate traffic from CDNs. Their technique used the meek plugin—developed by the Tor Project for its anonymity network—to avoid detection.[16][17][18]

Disabling

The endurance of domain fronting as a method for censorship circumvention has been attributed to the expensive collateral damage of blocking. To block domain fronting, one must block all traffic to and from the fronts (CDNs and large providers), which by design are often relied on by countless other web services.[8] The Signal Foundation drew the analogy that to block one domain fronted site you "have to block the rest of the Internet as well."[19]

Russia faced such a problem when they attempted to block Telegram (a messaging app using domain fronting), by blocking all Google and Amazon servers. This blocked many unrelated web services (such as banking websites and mobile apps) that used content from the Google and Amazon clouds.[20][21] It did not succeed in blocking Telegram.[22] The ban and blocks began on April 13, 2018.[23]

On April 14, 2018, Google silently blocked domain fronting in their cloud, and on April 27, Amazon announced they were blocking it.[24] Cloudflare, another major cloud, also blocked it.[3][4] Akamai was also affected.[25][24] Initially Microsoft (whose cloud is needed for Microsoft cloud services and live updates, among other things) did not follow,[24] but in March 2021, Microsoft announced an intention of banning domain fronting in the Microsoft Azure cloud.[26]

Cloudflare had disabled domain fronting in 2015.[27]

In April 2018, Google and Amazon both disabled domain fronting from their content delivery services by removing the idiosyncrasies in redirect schemes that allowed fronting to happen.[28] Google broke domain fronting by removing the ability to use 'google.com' as a front domain by changing how their CDN was structured.[29] When requested to comment they said domain fronting had "never been a supported feature" and that the changes made were long-planned upgrades.[30][29][31] Amazon claimed fronting was "already handled as a breach of AWS Terms of Service" and implemented a set of changes that prohibited the obfuscation that allowed sites to masquerade as and use CloudFront domains of other websites as fronts.[32][19][33]

Reactions

Various publications speculated that the effort by both Google and Amazon was in part due to pressure from the Russian government and its communications authority Roskomnadzor blocking millions of Google and Amazon domains, in April 2018 as well, due to Telegram using them as fronts.[34][29][35][36][3][4]

Digital rights advocates have commented that the move undermines people's ability to access and transmit information freely and securely in repressive states.[37]

According to Signal's founder, Moxie Marlinspike, Google management came to question whether they wanted to act as a front for sites and services entire nation states wanted to block as domain fronting gained popular attention with apps like Signal implementing it. He called using fronting in a circumvention tool "now largely non-viable" in the countries it was needed.[19] It is, however, still used by some services, such as Tor and Lantern.

See also

Notes

  1. Quotes by Moxie Marlinspike, creator of Signal.[1]

References

  1. Marlinspike, Moxie (1 May 2018). "A letter from Amazon". https://signal.org/blog/looking-back-on-the-front/. 
  2. 2.0 2.1 2.2 Cimpanu, Catalin (August 8, 2020). "DEF CON: New tool brings back 'domain fronting' as 'domain hiding'" (in en). ZDNET. https://www.zdnet.com/article/def-con-new-tool-brings-back-domain-fronting-as-domain-hiding/. 
  3. 3.0 3.1 3.2 "Why You Don't Need Google's Domain Fronting" (in en). Psiphon Project. April 24, 2018. https://blog-en.psiphon.ca/2018/04/why-you-dont-need-googles-domain.html. 
  4. 4.0 4.1 4.2 Dou, Eva; Barr, Alistair. "U.S. Cloud Providers Face Backlash From China’s Censors". The Wall Street Journal. https://www.wsj.com/articles/u-s-cloud-providers-face-backlash-from-chinas-censors-1426541126. 
  5. 5.0 5.1 5.2 5.3 5.4 "Privacy 2019: Tor, Meek & The Rise And Fall Of Domain Fronting". 2019-04-15. https://www.sentinelone.com/blog/privacy-2019-tor-meek-rise-fall-domain-fronting/. 
  6. 6.0 6.1 "doc/meek – Tor Bug Tracker & Wiki". https://trac.torproject.org/projects/tor/wiki/doc/meek. 
  7. 7.0 7.1 7.2 7.3 7.4 7.5 Fifield, David; Lan, Chang; Hynes, Rod; Wegmann, Percy; Paxson, Vern (15 February 2015). "Blocking-resistant communication through domain fronting". Proceedings on Privacy Enhancing Technologies 2015 (2): 46–64. doi:10.1515/popets-2015-0009. ISSN 2299-0984. http://www.icir.org/vern/papers/meek-PETS-2015.pdf. Retrieved 2017-01-03. 
  8. 8.0 8.1 8.2 8.3 8.4 8.5 8.6 "The Death of Domain Fronting | What Lies Ahead?" (in en-US). 2018-06-11. https://blog.finjan.com/what-is-domain-fronting/. 
  9. Savov, Vlad (2018-04-17). "Russia's Telegram ban is a big, convoluted mess" (in en). https://www.theverge.com/2018/4/17/17246150/telegram-russia-ban. 
  10. "Proxy: Domain Fronting, Sub-technique T1090.004 - Enterprise | MITRE ATT&CK®". https://attack.mitre.org/techniques/T1090/004/. 
  11. Ghedini, Alessandro (24 September 2018). "Encrypt it or lose it: how encrypted SNI works" (in en). https://blog.cloudflare.com/encrypted-sni/. 
  12. Patton, Christopher (8 December 2020). "Good-bye ESNI, hello ECH!" (in en). https://blog.cloudflare.com/encrypted-client-hello/. 
  13. 13.0 13.1 13.2 White, Nathan (18 April 2018). "Google ends "domain fronting," a crucial way for tools to evade censors" (in en). https://www.accessnow.org/google-ends-domain-fronting-a-crucial-way-for-tools-to-evade-censors/. 
  14. "Open Whisper Systems >> Blog >> Doodles, stickers, and censorship circumvention for Signal Android". https://whispersystems.org/blog/doodles-stickers-censorship/. 
  15. Brandom, Russell (2018-04-30). "Amazon Web Services starts blocking domain-fronting, following Google's lead" (in en). https://www.theverge.com/2018/4/30/17304782/amazon-domain-fronting-google-discontinued. 
  16. "APT29 Domain Fronting With TOR" (in en). https://www.fireeye.com/blog/threat-research/2017/03/apt29_domain_frontin.html. 
  17. "Domain Fronting, Phishing Attacks, and What CISOs Need to Know" (in en-US). 2018-12-13. https://cofense.com/domain-fronting-phishing-attacks-cisos-need-know/. 
  18. Brandom, Russell (18 April 2018). "A Google update just created a big problem for anti-censorship tools". The Verge. https://www.theverge.com/2018/4/18/17253784/google-domain-fronting-discontinued-signal-tor-vpn. 
  19. 19.0 19.1 19.2 Marlinspike, Moxie (2018-05-01). "A letter from Amazon". https://signal.org/blog/looking-back-on-the-front/. 
  20. Cimpanu, Catalin. "Russia Bans 1.8 Million Amazon and Google IPs in Attempt to Block Telegram" (in en-us). BleepingComputer. https://www.bleepingcomputer.com/news/government/russia-bans-18-million-amazon-and-google-ips-in-attempt-to-block-telegram/. 
  21. Cimpanu, Catalin (June 18, 2020). "Russia unbans Telegram" (in en). ZDNET. https://www.zdnet.com/article/russia-unbans-telegram/. 
  22. Burgess, Matt (28 April 2018). "This is why Russia's attempts to block Telegram have failed". Wired UK. https://www.wired.co.uk/article/telegram-in-russia-blocked-web-app-ban-facebook-twitter-google. 
  23. MacFarquhar, Neil (13 April 2018). "Russian Court Bans Telegram App After 18-Minute Hearing". The New York Times. https://www.nytimes.com/2018/04/13/world/europe/russia-telegram-encryption.html. 
  24. 24.0 24.1 24.2 Mates, Matan (15 April 2019). "Tor, Meek & The Rise And Fall Of Domain Fronting". https://www.sentinelone.com/blog/privacy-2019-tor-meek-rise-fall-domain-fronting/. 
  25. "Implementing Malware Command and Control Using Major CDNs and High-Traffic Domains" (in en). https://www.cyberark.com/resources/threat-research-blog/implementing-malware-command-and-control-using-major-cdns-and-high-traffic-domains. 
  26. Jones, Emma (26 March 2021). "Securing our approach to domain fronting within Azure". https://www.microsoft.com/en-us/security/blog/2021/03/26/securing-our-approach-to-domain-fronting-within-azure/. 
  27. "#14256 (Clarify whether Cloudflare's Universal SSL thing works with meek) – Tor Bug Tracker & Wiki". https://trac.torproject.org/projects/tor/ticket/14256#comment:2. 
  28. "Domain fronting: pros and cons | NordVPN" (in en). 2019-07-12. https://nordvpn.com/blog/domain-fronting/. 
  29. 29.0 29.1 29.2 Gallagher, Sean (2018-05-02). "Amazon blocks domain fronting, threatens to shut down Signal's account" (in en-us). https://arstechnica.com/information-technology/2018/05/amazon-blocks-domain-fronting-threatens-to-shut-down-signals-account/. 
  30. Brandom, Russell. "A Google update just created a big problem for anti-censorship tools" (in en-US). https://www.theverge.com/2018/4/18/17253784/google-domain-fronting-discontinued-signal-tor-vpn. 
  31. "Google ends "domain fronting," a crucial way for tools to evade censors - Access Now". 18 April 2018. https://www.accessnow.org/google-ends-domain-fronting-a-crucial-way-for-tools-to-evade-censors/. 
  32. "Enhanced Domain Protections for Amazon CloudFront Requests". 2018-04-27. https://aws.amazon.com/blogs/security/enhanced-domain-protections-for-amazon-cloudfront-requests/. 
  33. "Amazon Web Services starts blocking domain-fronting, following Google's lead". 2018-04-30. https://www.theverge.com/2018/4/30/17304782/amazon-domain-fronting-google-discontinued. 
  34. "Amazon and Google bow to Russian censors in Telegram battle" (in en-US). Fast Company. 2018-05-04. https://www.fastcompany.com/40568177/amazon-and-google-bow-to-russian-censors-in-telegram-battle. 
  35. Bershidsky, Leonid (May 3, 2018). "Russian Censor Gets Help From Amazon and Google". https://www.bloomberg.com/view/articles/2018-05-03/telegram-block-gets-help-from-google-and-amazon. 
  36. "Info". Tass.ru. http://tass.ru/pmef-2018/articles/5231399. 
  37. Dahir, Abdi Latif (3 May 2018). "Google and Amazon's move to block domain fronting will hurt activists under repressive regimes" (in en). https://qz.com/africa/1268974/google-and-amazon-end-domain-fronting-to-bypass-internet-censorship-in-africa/. 

External links