<?xml version="1.0" encoding="UTF-8"?>
<?xml-stylesheet type="text/xsl" media="screen" href="/~d/styles/rss2full.xsl"?><?xml-stylesheet type="text/css" media="screen" href="http://feeds.feedburner.com/~d/styles/itemcontent.css"?><rss xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:wfw="http://wellformedweb.org/CommentAPI/" xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:atom="http://www.w3.org/2005/Atom" xmlns:sy="http://purl.org/rss/1.0/modules/syndication/" xmlns:slash="http://purl.org/rss/1.0/modules/slash/" xmlns:itunes="http://www.itunes.com/dtds/podcast-1.0.dtd" xmlns:media="http://search.yahoo.com/mrss/" version="2.0">

<channel>
	<title>Security to the Core | Arbor Networks Security » 2009</title>
	
	<link>http://asert.arbornetworks.com</link>
	<description>A weblog dedicated to educating the community on security threats that matter</description>
	<lastBuildDate>Mon, 09 Nov 2009 18:19:34 +0000</lastBuildDate>
	<generator>http://wordpress.org/?v=abc</generator>
	<language>en</language>
	<sy:updatePeriod>hourly</sy:updatePeriod>
	<sy:updateFrequency>1</sy:updateFrequency>
		<!-- podcast_generator="podPress/8.8" -->
		<copyright>©info@arbornetworks.com </copyright>
		<managingEditor>info@arbor.net (info@arbornetworks.com)</managingEditor>
		<webMaster>info@arbor.net(info@arbornetworks.com)</webMaster>
		<category>Podcasts</category>
		<ttl>1440</ttl>
		<itunes:keywords>network, security, arbor, monitoring, internet, botnets, ddos, attacks, threats</itunes:keywords>
		<itunes:subtitle />
		<itunes:summary>A podcast series dedicated to educating the community on security threats that matter</itunes:summary>
		<itunes:author>info@arbornetworks.com</itunes:author>
		<itunes:category text="Technology" />
<itunes:category text="Technology">
  <itunes:category text="Tech News" />
</itunes:category>
		<itunes:owner>
			<itunes:name>info@arbornetworks.com</itunes:name>
			<itunes:email>info@arbor.net</itunes:email>
		</itunes:owner>
		<itunes:block>No</itunes:block>
		<itunes:explicit>no</itunes:explicit>
		<itunes:image href="http://www.arbornetworks.com/rss/podcasts/podcast_xml.jpg" />
		<image>
			<url>http://asert.arbornetworks.com/gen-images/sidebar_leftbarlogo.gif</url>
			<title>Security to the Core | Arbor Networks Security</title>
			<link>http://asert.arbornetworks.com</link>
			<width>144</width>
			<height>144</height>
		</image>
		<atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="self" href="http://feeds.feedburner.com/asert" type="application/rss+xml" /><atom10:link xmlns:atom10="http://www.w3.org/2005/Atom" rel="hub" href="http://pubsubhubbub.appspot.com" /><item>
		<title>Malicious Google AppEngine Used as a CnC</title>
		<link>http://asert.arbornetworks.com/2009/11/malicious-google-appengine-used-as-a-cnc/</link>
		<comments>http://asert.arbornetworks.com/2009/11/malicious-google-appengine-used-as-a-cnc/#comments</comments>
		<pubDate>Mon, 09 Nov 2009 16:39:07 +0000</pubDate>
		<dc:creator>Jose Nazario</dc:creator>
				<category><![CDATA[Backdoors]]></category>
		<category><![CDATA[Botnets]]></category>
		<category><![CDATA[Malware]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/?p=1458</guid>
		<description><![CDATA[Over the weekend our zoo found a malware sample that revealed a malicious Google AppEngine application. The app in question is being used to feed URLs to the zombies for them to download. We got the malware via sample sharing, and its original location and infection information is absent. The malware details are below:

MD5: 2143a7b9a9de6ea26987ed8ece29d2c6
SHA1: [...]]]></description>
			<content:encoded><![CDATA[<p>Over the weekend our zoo found a malware sample that revealed a malicious <a href="http://appspot.com/">Google AppEngine</a> application. The app in question is being used to feed URLs to the zombies for them to download. We got the malware via sample sharing, and its original location and infection information is absent. The <a href="http://www.virustotal.com/analisis/adfd39052a7a5c2f0094641bf19e8f0387cc2e46ca72575beca2f50de415d31e-1257648322">malware</a> details are below:<br />
<code><br />
MD5: 2143a7b9a9de6ea26987ed8ece29d2c6<br />
SHA1: 30f6befc76e4e269e5aa9c01c735d55d7ca4099a<br />
File type: application/x-ms-dos-executable<br />
File size: 65024 bytes<br />
</code><br />
It&#8217;s a simple HTTP engine and downloader, packed with UPX. The C&amp;C is visible in the unpacked sample:<br />
<code><br />
http://xiaoiboxip.appspot.com/[OMITTED]?hostname=<br />
&amp;&amp;systemcpoy=<br />
&amp;&amp;userName=<br />
</code><br />
Where [Omitted] refers to a four letter explicative (this is a family friendly blog, folks!).</p>
<p>This was bound to happen, after all, in an open environment like this where people&#8217;s abilities are limited by their intentions. The C&amp;C appears to manage infections on the basis of the computer hostname sent in the request; a unique hostname yields the malcode URL to update:<br />
<code><br />
&lt;br&gt;http://XX.XX.76.85/aa.exe&lt;/br&gt;<br />
</code><br />
In this case aa.exe is a PCClient backdoor to the infected PCs. When you come back, at this time you just get the word &#8220;cmd&#8221;. It&#8217;s unclear to be what additional commands the C&amp;C can issue to clients.</p>
<p><del datetime="2009-11-09T16:50:30+00:00">A quick analysis of the original malware doesn&#8217;t reveal any additional functionality, just the downloader bits.</del> (See below) Google&#8217;s been contacted for the AppEngine to be taken down, and the site hosting the second stage malware has been contacted for takedown, as well.</p>
<p><b>UPDATE</b> Google has confirmed the malicious AppEngine is now down. </p>
<p><b>UPDATE 2</b> Actually, looking at the sample reveals that it talks to a host in China using what at first blush appears to be a Grey Pigeon protocol. </p>
<p><b> UPDATE 3</b> Found another URL the app used, but i&#8217;m not sure what it was used for:<br />
<code><br />
http://xiaoiboxip.appspot.com/getip?speed=100<br />
</code><br />
The google cache of the results suggest it reads something like &#8220;Today visited 42 times this month, visited 587 times.&#8221; It&#8217;s unclear if that&#8217;s the size of the botnet or what. </p>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F11%2Fmalicious-google-appengine-used-as-a-cnc%2F&amp;title=Malicious+Google+AppEngine+Used+as+a+CnC', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/11/malicious-google-appengine-used-as-a-cnc/feed/</wfw:commentRss>
		<slash:comments>0</slash:comments>
		</item>
		<item>
		<title>Q3 2009 Fast Flux by the Numbers</title>
		<link>http://asert.arbornetworks.com/2009/11/q3-2009-fast-flux-by-the-numbers/</link>
		<comments>http://asert.arbornetworks.com/2009/11/q3-2009-fast-flux-by-the-numbers/#comments</comments>
		<pubDate>Mon, 02 Nov 2009 19:24:44 +0000</pubDate>
		<dc:creator>Jose Nazario</dc:creator>
				<category><![CDATA[ATLAS]]></category>
		<category><![CDATA[Botnets]]></category>
		<category><![CDATA[Interesting Research]]></category>
		<category><![CDATA[Spam]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/?p=1454</guid>
		<description><![CDATA[Spent some time lately reading various companies&#8217; Q3 reports on their data to get a lay of the land. I&#8217;ve also spent some time thinking about responses to fast flux. The data below is the result of our tracking in ATLAS of fast flux activity. Our monitoring uses spam traps and other means to identify [...]]]></description>
			<content:encoded><![CDATA[<p>Spent some time lately reading various companies&#8217; Q3 reports on their data to get a lay of the land. I&#8217;ve also spent some time thinking about responses to fast flux. The data below is the result of our tracking in ATLAS of <a href="http://atlas.arbor.net/summary/fastflux">fast flux activity</a>. Our monitoring uses spam traps and other means to identify domains which we actively qualify as fast flux, then use passive means to discover possibly related domains (based on IP address overlap) before feeding it back into the system via active qualification. Our system continuously monitors the active domains for membership in the botnet and expires &#8220;dead&#8221; domains.</p>
<p>The analysis here looks at the three month quarter just ended a few weeks ago for trends in fast flux. This year&#8217;s seen a huge uptick in Avalanche domains, and the release of notes from ICANN on the Fast Flux Working Group as well as a specific note around Avalanche. Arbor, like a few others, has been actively working with registries to address fast flux. So, the question is then: how are those efforts doing?</p>
<p>Comparing to Q2 (see below), the biggest gainers are .tk and .eu, with .uk coming in as a new top 10 player. We&#8217;ve been trying to work with .eu as they are being targeted, along with .uk, by the Avalanche guys. However, our efforts in .eu are largely fruitless while Nominet in the UK has defended .uk quite handily. The .tk stuff we&#8217;re looking at, as it could be a false positive due to the way that .tk hosts stuff.</p>
<p><img src="http://chart.apis.google.com/chart?cht=p&amp;chd=s:9NJDDCBAAAB&amp;chs=475x300&amp;chl=tk%20(5475)|cn%20(1203)|com%20(895)|eu%20(358)|ru%20(349)|net%20(265)|uk%20(113)|hn%20(77)|in%20(71)|mx%20(38)|other%20(129)" alt="2009 Q3 Fast Flux by TLD" /></p>
<p>Across all domain names, in Q3 we saw <strong>more</strong> TLDs hit, some 34 (against Q2&#8217;s 26 distinct TLDs). The attackers are striking at more TLDs in hopes of finding the soft spots, ones that just don&#8217;t respond. The average lifetime of a fast flux domain name: 418063 seconds, or about 9.7 days. CN domains are taken down within 7.8 days, EU domain names within 1.6 days, COM domains within 7.23 days, and TK domains within 1.44 days.</p>
<h3>For comparison: Q2 2009</h3>
<p>Here&#8217;s some numbers from the second quarter of this year to serve as a comparison to the Q3 numbers above. The TLD piechart shows a dramatic uptick in .tk domains in Q3 (which we continue to investigate, may be false positives that crept into our system).</p>
<p><img src="http://chart.apis.google.com/chart?cht=p&amp;chd=s:9fFCAAAAAAB&amp;chs=475x300&amp;chl=cn%20(3294)|com%20(1679)|net%20(273)|eu%20(108)|tk%20(46)|ru%20(15)|be%20(15)|org%20(12)|mx%20(12)|nu%20(11)|other%20(59)" alt="2009 Q2 Fast Flux by TLD" /></p>
<p>Average lifetime of all domains in Q2: 21 days. Three weeks! That&#8217;s success now that we&#8217;re down to under 10 days.</p>
<p>A cursory examination of this data suggests that while numbers are up, response times are getting better. This may be something worth cheering.</p>
<p>Also, it appears that fast flux is still being used for the same old stuff: phishing, malware, malvertising, child porn, and the like.</p>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F11%2Fq3-2009-fast-flux-by-the-numbers%2F&amp;title=Q3+2009+Fast+Flux+by+the+Numbers', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/11/q3-2009-fast-flux-by-the-numbers/feed/</wfw:commentRss>
		<slash:comments>1</slash:comments>
		</item>
		<item>
		<title>Who Put the IPv6 in my Internet?</title>
		<link>http://asert.arbornetworks.com/2009/09/who-put-the-ipv6-in-my-internet/</link>
		<comments>http://asert.arbornetworks.com/2009/09/who-put-the-ipv6-in-my-internet/#comments</comments>
		<pubDate>Wed, 09 Sep 2009 02:50:05 +0000</pubDate>
		<dc:creator>Craig Labovitz</dc:creator>
				<category><![CDATA[Arbor Networks]]></category>
		<category><![CDATA[Internet service provider]]></category>
		<category><![CDATA[Internet traffic]]></category>
		<category><![CDATA[IPv6]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/?p=1396</guid>
		<description><![CDATA[About this time last year, we released a study on  the state of IPv6  deployment in the Internet. Our August 2008 paper found diminishingly small traces of IPv6 &#8212;  less than one hundredth of 1% of Internet traffic.
This year?
In a dramatic reversal of long-term IPv6 stagnation, global IPv6 traffic globally grew more [...]]]></description>
			<content:encoded><![CDATA[<p>About this time last year, we released a study on  the state of IPv6  deployment in the Internet. Our <a href="http://asert.arbornetworks.com/2008/08/the-end-is-near-but-is-ipv6/">August 2008 paper</a> found diminishingly small traces of IPv6 &#8212;  less than one hundredth of 1% of Internet traffic.</p>
<p>This year?</p>
<p>In a dramatic reversal of long-term IPv6 stagnation, global IPv6 traffic globally grew more than 1,400% in the last 12 months. Even more remarkable, this growth is due primarily to one application and one ISP.</p>
<p>We&#8217;ll explain in a moment, but first some background: Both our 2008 work and this IPv6 study used traffic statistics from 110 ISPs participating in the <a href="http://www.nanog.org/meetings/nanog43/abstracts.php?pt=NjgmbmFub2c0Mw==&amp;nm=nanog43">Internet Observatory</a>. Though the Observatory is capable of collecting native (i.e. not tunneled) IPv6 traffic statistics, only six ISPs out of the 110 in the study currently have routers and collection infrastructure with native IPv6 enabled. As a result,  our data generally includes only IPv6 traffic through Teredo and 6to4 tunnels. Further, since only a handful of Observatory participants use monitoring infrastructure with payload visibility, our study  sees only the UDP Teredo control traffic (i.e. not the data portion).</p>
<p>The above technical limitations and our somewhat dismal 2008 assessment of  IPv6 deployment  engendered a bit of criticism. The main critique (such as <a href="http://www.personal.psu.edu/dvm105/blogs/ipv6/2008/08/ipv6-is-bad-off-but-not-as-bad.html">this posting</a>) seems to be that we significantly under counted IPv6. In particular, many pointed to the Amsterdam Internet Exchange (AMS-IX) <a href="http://www.ams-ix.net/technical/stats/sflow/?type=ipv6">switch statistics</a> which show a Gigabit or more of IPv6 traffic (far more than we found in our study). Others pointed to the high rate of IPv6 address allocations as evidence of broader IPv6 deployment.</p>
<p>From the perspective of a year later, we stand by our 2008 IPv6 findings. A <a href="http://www.gossamer-threads.com/lists/nanog/users/116393">July 2009 news server outage</a> confirmed suspicions that  AMS-IX IPv6 traffic mainly consisted of file sharing through the free AMS-IX based IPv6 news servers. And <a href="http://www.cs.princeton.edu/~jrex/papers/ipv6-pam09.pdf">a PAM paper</a> earlier this year found both minuscule levels of  IPv6 traffic in a tier1 network and confirmed that registry allocations provide a poor indicator of IPv6 usage. As a side note, the PAM paper also found that the small amount of tier1 IPv6 traffic consisted mainly of DNS and ICMP (i.e. test traffic and not real IPv6 usage).</p>
<p>So in August of 2008 real IPv6 Internet traffic was mostly non-existent.</p>
<p>And then things changed&#8230;<br />
<a title="ipv6 by labovit, on Flickr" href="http://www.flickr.com/photos/39604891@N02/3902354052/"><img src="http://farm3.static.flickr.com/2485/3902354052_4091561d2b_o.jpg" alt="ipv6" width="382" height="238" /></a><br />
The above graph shows  IPv6 traffic (Teredo and 6to4) as a normalized weighted average percentage of all Internet traffic between July 2007 and July 2009. In July of 2007, IPv6 represented less than 0.002% of Internet traffic. Beginning in August of 2008, tunneled IPv6 traffic begin to grow dramatically followed by an abrupt and even larger jump in April of 2009 (the E. Karpilovsky et al. <a href="http://www.cs.princeton.edu/~jrex/papers/ipv6-pam09.pdf">PAM paper</a> also observed this first 2008 jump in traffic but did not speculate as to the causality).</p>
<p>What happened?</p>
<p>This stark August 19, 2008 <a href="http://www.merit.edu/mail.archives/nanog/msg10597.html">warning to the NANOG mailing list</a> by Nathan Ward provides a strong clue:</p>
<p><code>Sit up and pay attention, even if you don't now run IPv6, or even if you don't ever intend to run IPv6.<br />
Your off-net bandwidth is going to increase, unless you put some relays in.<br />
As a friend of mine just said to me: "Welcome to your v6-enabled transit network, whether you like it or not ;-)".<br />
uTorrent 1.8 is out, as of Aug 9.<br />
</code></p>
<p>Nathan was mostly right. While uTorrent never generated the expected flood of new traffic (at least by IPv4 standards), the introduction of IPv6 P2P succeeded where most previous IPv6 inducement efforts had failed (i.e. liberal peering, high quality IPv6 porn, IPv6 ASCII animation of Star Wars, etc.). In the space of ten months uTorrent helped drive IPv6 traffic from .002% to .03% of all Internet traffic (a dramatic 15x jump).</p>
<p>But the more interesting (and from an infrastructure perspective, far more important) IPv6 traffic increase came on April 21, 2009 with  Hurricane Electric&#8217;s turn up of a global anycast&#8217;ed Teredo relay service. Hurricane Electric enabled 14 Teredo relays in Seattle, Fremont, Los Angeles, Chicago, Dallas, Toronto, New York, Ashburn, Miami, London, Paris, Amsterdam, Frankfurt and Hong Kong.</p>
<p>More details of Hurricane Electric&#8217;s infrastructure is available in this <a href="http://www.lacnic.net/documentos/lacnicxii/presentaciones/flip6/08_Martin_Levy.pdf">May 2009 LACNIC presentation</a>.</p>
<p>Historically, IPv6 connectivity across the Internet has been, well, abysmal. Inefficient routing, multiple IPv6 tunnel encapsulations and overall lack of coordination between Teredo and 6to4 relay providers added latency, loss and played havoc with jitter (i.e. mangling VoIP). Frequently, a traceroute between two providers at the same exchange could traverse multiple countries or continents en route. For added background, see this  <a href="https://sites.google.com/site/ipv6implementors/conference2009/agenda/07_Levy_Hurricane_Electric_IPv6_Flow_Data.pdf">2009 Google IPv6 Conference presentation</a>, this <a href="http://www.nas.ewi.tudelft.nl/people/Piet/papers/IJCS_2008_ipv6_delft_ripe.pdf ">2008 RIPE study</a> and <a href="http://mobitec.ie.cuhk.edu.hk/projects/IPv6/tunnel.html">related 2007 study</a>.</p>
<p>By all accounts, Hurricane Electric&#8217;s  Teredo service significantly improved the IPv6 goodput for the average Internet end user over night.  In particular, Microsoft Windows users got a big boost. Though Windows has shipped with a Teredo client (on by default) since XP, Microsoft never provided <a href="%20http://en.wikipedia.org/wiki/Teredo_tunneling%3Cbr%20%3E%3C/a%3E">a public relay service</a>. teredo.ipv6.microsoft.com now uses Hurricane&#8217;s  6to4 relays. And the dramatic improvement in Teredo and 6to4 relays seems to have lead to a corresponding jump in IPv6 traffic.</p>
<p>This is good news.</p>
<p>Finally, in the below graph, you can see the impact of both uTorrent and Hurricane&#8217;s relay deployment  by region. We again show IPv6 tunneled traffic as a weighted normalized percentage of all Internet traffic. The most important take away is that the IPv6 growth after August 2008 is a global phenomena (with Asia at the forefront follow by Europe).<br />
<a title="regional_ipv6 by labovit, on Flickr" href="http://www.flickr.com/photos/39604891@N02/3901564035/"><img src="http://farm4.static.flickr.com/3503/3901564035_2799ab4629_o.jpg" alt="regional_ipv6" width="382" height="238" /></a><br />
We look forward to revisiting IPv6 traffic in another year as relays improve, <a href="http://www.nanog.org/meetings/nanog46/presentations/Monday/DTemkin_lightning_N46.pdf">meaningful IPv6 content</a> becomes available and more providers offer native IPv6 service.</p>
<p><em><br />
Editor&#8217;s Note: This blog is the fourth in a series of weekly posts leading up to the publication of the joint University of Michigan, Merit Network and Arbor Networks &#8220;2009 Internet Observatory Report&#8221;. The full technical report goes into  detail on the evolving Internet topology, commercial ecosystem and traffic patterns &#8212; available this October.  Next week: &#8220;How Big is Google?&#8221;</em></p>
<p><em> </em></p>
<div class="zemanta-pixie" style="margin-top: 10px; height: 15px;"><a class="zemanta-pixie-a" title="Reblog this post [with Zemanta]" href="http://reblog.zemanta.com/zemified/ff28b9cb-b899-48f2-ae1d-21981d2bf6f1/"><img class="zemanta-pixie-img" style="border: medium none; float: right;" src="http://img.zemanta.com/reblog_a.png?x-id=ff28b9cb-b899-48f2-ae1d-21981d2bf6f1" alt="Reblog this post [with Zemanta]" /></a><span class="zem-script more-related pretty-attribution"><script src="http://static.zemanta.com/readside/loader.js" type="text/javascript"></script></span></div>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F09%2Fwho-put-the-ipv6-in-my-internet%2F&amp;title=Who+Put+the+IPv6+in+my+Internet%3F', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/09/who-put-the-ipv6-in-my-internet/feed/</wfw:commentRss>
		<slash:comments>10</slash:comments>
		</item>
		<item>
		<title>The Internet After Dark (Part 2)</title>
		<link>http://asert.arbornetworks.com/2009/08/the-internet-after-dark-part-ii/</link>
		<comments>http://asert.arbornetworks.com/2009/08/the-internet-after-dark-part-ii/#comments</comments>
		<pubDate>Mon, 31 Aug 2009 00:55:01 +0000</pubDate>
		<dc:creator>Craig Labovitz</dc:creator>
				<category><![CDATA[Arbor Networks]]></category>
		<category><![CDATA[Internet service provider]]></category>
		<category><![CDATA[Internet traffic]]></category>
		<category><![CDATA[Streaming media]]></category>
		<category><![CDATA[World of Warcraft]]></category>
		<category><![CDATA[YouTube]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/?p=1363</guid>
		<description><![CDATA[This blog  completes our informal three week study of  Internet daily traffic patterns. Using data from the Internet Observatory, we analyzed weekday application traffic across 110 geographically diverse ISPs, including some of the largest carriers in North American and Europe.  We believe this report (and upcoming paper) represent the largest study of [...]]]></description>
			<content:encoded><![CDATA[<p>This blog  completes our informal three week study of  Internet daily traffic patterns. Using data from the <a href="http://www.nanog.org/meetings/nanog43/abstracts.php?pt=NjgmbmFub2c0Mw==&amp;nm=nanog43">Internet Observatory</a>, we analyzed weekday application traffic across 110 geographically diverse ISPs, including some of the largest carriers in North American and Europe.  We believe this report (and upcoming paper) represent the largest study of Internet traffic temporal characteristics to date.</p>
<p>In <a href="http://asert.arbornetworks.com/2009/08/the-internet-after-dark/">the first half of this  post</a>, we showed unlike European Internet traffic which peaks in the early evening and then drops off until the next day&#8217;s business hours, US Internet traffic reaches its peak at 11pm EDT and then stays relatively high until 3am in the morning.</p>
<p>The question is what are Internet users doing after dark?</p>
<p><strong>The answer:</strong> long after Exchange and Oracle business traffic slows to a crawl, Internet users turn to the web to surf, watch videos, send IM&#8217;s and happily try to kill each other.</p>
<p>We illustrate these trends with graphs of four application categories below.</p>
<p><a title="nightapps by labovit, on Flickr" href="http://www.flickr.com/photos/39604891@N02/3868220921/"><img src="http://farm4.static.flickr.com/3423/3868220921_31cf3ddbc5_o.jpg" alt="nightapps" width="739" height="451" /></a></p>
<p>The top two graphs show the daily average traffic fluctuations of TCP / UDP ports related two popular online game multi-player platforms: <a href="http://en.wikipedia.org/wiki/Battlenet">World of Warcraft</a> and <a href="http://en.wikipedia.org/wiki/Steam_%28content_delivery%29">Steam</a> (which includes many popular first person shooter games like Half Life). The bottom two graphs show common video and instant messaging protocols. As in earlier analysis, we take the average of North American consumer / regional providers traffic over 10 weekdays in July. To make the graph more readable, we show traffic as a percentage of peak traffic levels. All times are EDT.</p>
<p>Some observations:</p>
<ul>
<li><strong>Gamers Come Out at  Night</strong>: Unlike most Internet applications which peak midday or late afternoon, online game traffic grows by more than 60% after 2pm. Gaming prime time appears to be between 8pm and 11pm EDT weekday nights (corresponding to the traditional and now declining television prime time hours). By comparison, web traffic levels remain relatively constant through the late afternoon and  peaks much earlier at 5pm.</li>
<li><strong>A Guild that Plays Together Stays Together</strong>: Unlike other online game traffic, World of Warcraft&#8217;s Battlenet shows a distinct 30% jump <em>exactly</em> at 8pm EDT every evening. In-house WoW level 80 colleagues  suggest 8pm is a common time for guilds to set out on quests. Also unlike  other game traffic, WoW declines rapidly after 11pm every night. Again, we suspect WoW traffic patterns are related to the more large group, social nature of World of Warcraft.</li>
<li><strong>Midnight Video</strong>: Of all Internet applications, streaming video protocols reach their traffic peak the latest around midnight EDT every evening. We do not have very good visibility into what Internet users are watching this late, but correlation with large content site traffic patterns (below) provides some clues.</li>
<li><strong>Always in Touch</strong>: Beginning at 9am EDT at lasting though midnight, Internet users IM  <em>constantly</em>. The IM graph above shows traffic reaches 80% of peak by 10am and stays above 80% until midnight (with a 5pm EDT peak &#8212; perhaps related to millions of users making dinner plans). Interestingly, email exhibits a very different pattern and plummets by more than 30% immediately after 5pm EDT.</li>
</ul>
<p>As mentioned earlier, we do not have detailed visibility into what Internet users are watching at midnight but ASN level traffic analysis provides some hints. Predictably, traffic grows dramatically to consumer sites like Google&#8217;s YouTube and large CDN / video providers. Also not surprisingly, we see a large jump in traffic to  colo / hosting companies with adult content such as a 40% jump to <a href="http://www.isprime.com/">ISPrime</a> (AS23393) between 10pm and 1am EDT. We will explore one of the fastest growing and largest nighttime sites, <a href="http://www.carpathiahosting.com/">Carpathia Hosting</a> (AS29748), in an upcoming blog.</p>
<p><em><br />
Editor&#8217;s Note: This blog is the third in a series of weekly posts leading up to the publication of the joint University of Michigan, Merit Network and Arbor Networks &#8220;2009 Internet Observatory Report&#8221;. The full technical reports goes into  detail on the evolving Internet topology, commercial ecosystem and traffic patterns &#8212; available this October.  Next week: &#8220;Who Put the IPv6 in My Internet?&#8221;</em></p>
<p><em> </em></p>
<div class="zemanta-pixie" style="margin-top: 10px; height: 15px;"><a class="zemanta-pixie-a" title="Reblog this post [with Zemanta]" href="http://reblog.zemanta.com/zemified/c7c4908a-c98a-4b5d-b3ff-c8fa01d2b34b/"><img class="zemanta-pixie-img" style="border: medium none; float: right;" src="http://img.zemanta.com/reblog_a.png?x-id=c7c4908a-c98a-4b5d-b3ff-c8fa01d2b34b" alt="Reblog this post [with Zemanta]" /></a><span class="zem-script more-related pretty-attribution"><script src="http://static.zemanta.com/readside/loader.js" type="text/javascript"></script></span></div>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F08%2Fthe-internet-after-dark-part-ii%2F&amp;title=The+Internet+After+Dark+%28Part+2%29', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/08/the-internet-after-dark-part-ii/feed/</wfw:commentRss>
		<slash:comments>20</slash:comments>
		</item>
		<item>
		<title>The Internet After Dark (Part 1)</title>
		<link>http://asert.arbornetworks.com/2009/08/the-internet-after-dark/</link>
		<comments>http://asert.arbornetworks.com/2009/08/the-internet-after-dark/#comments</comments>
		<pubDate>Mon, 24 Aug 2009 14:53:53 +0000</pubDate>
		<dc:creator>Craig Labovitz</dc:creator>
				<category><![CDATA[Arbor Networks]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/?p=1263</guid>
		<description><![CDATA[After dark when the dinner dishes are put away and the kids are safely tucked into bed, the Internet subtly changes. Starting in the twilight of early evening, business traffic slows to a crawl, previously dormant applications flicker on home computer screens, and like clockwork,  Internet activity begins its nightly climb towards a regular [...]]]></description>
			<content:encoded><![CDATA[<p>After dark when the dinner dishes are put away and the kids are safely tucked into bed, the Internet subtly changes. Starting in the twilight of early evening, business traffic slows to a crawl, previously dormant applications flicker on home computer screens, and like clockwork,  Internet activity begins its nightly climb towards a regular after hours bandwidth peak.</p>
<p>But before we get too carried away with  metaphor and innuendo, some background.</p>
<p>In our <a href="http://asert.arbornetworks.com/2009/08/what-europeans-do-at-night/">last post blog post</a>, we found (somewhat unexpectedly) that the pattern of North American daily Internet traffic differs from Europe and Asia. Unlike European Internet traffic which peaks around 7pm GMT and then quickly drops off until morning business hours, US Internet traffic reaches its peak at 11pm EDT and then stays relatively high until 3am in the morning (i.e. stays above  60% of peak or more).</p>
<p>This uniquely American traffic pattern holds true across dozens of individual ISPs, tens of millions of subscribers, and petabytes of daily Internet traffic.</p>
<p>The question is what are Americans <em>doing</em> at night?</p>
<p>To begin answering this question, we first recap <a href="http://www.nanog.org/meetings/nanog43/abstracts.php?pt=NjgmbmFub2c0Mw==&#038;nm=nanog43">Internet Observatory</a> data from our earlier post. The below graph shows the daily average traffic fluctuations of 40 North American  consumer / regional providers (taking the average of 10 weekdays in July). To make the graph more readable, we show  traffic as a percentage of  peak traffic levels. All times are EDT. </p>
<p><center><br />
<img src="http://farm3.static.flickr.com/2520/3847085170_abf58f57d9.jpg"><br />
</center></p>
<p>The way to interpret the graph above is that at 6am EDT North American traffic volumes are at 50% of their daily peaks. Traffic then climbs to a local maxima at 4pm and then a daily peak around 11pm EDT before again dropping during the early morning hours.</p>
<p>To understand the two North American traffic peaks at 4pm and 11pm graphed above, it helps to look only at consumer Internet traffic (i.e. as opposed to enterprise and tier1 transit). Below we overlay in yellow the average daily traffic from <em>only</em> US and Canadian consumer providers (i.e. only showing cable / DSL and excluding tier2, research, content, tier1, etc.).</p>
<p><center><br />
<img src="http://farm3.static.flickr.com/2476/3846417437_f8bcb2f4cf.jpg"><br />
</center></p>
<p>From the graph its pretty clear consumer traffic plays a large role in the midnight North American traffic peak. We also see consumer traffic tends to climb later in the day  (i.e. consumer traffic crosses 50% threshold after 9am as opposed to the broader Internet average of 6am) and consumer traffic trends towards filling the bulk of after-hours traffic. Perhaps most telling is the change in slope of graphed average consumer traffic around 6pm and then again around 8-9pm &#8212; all likely related to Americans turning to the Internet after dinner and during evening leisure hours.</p>
<p>But though we now know it is consumers  driving the late night Internet traffic peak, we still have not answered what they are doing.</p>
<p>In response to our last post on the somewhat mysterious differences between American and European traffic patterns, readers offered a range of theories including:</p>
<ul>
<li>More so than Europe, American traffic grows with web surfing and at night
<li>Larges surges of P2P would explain North American traffic spikes
<li>Americans watch more video and related adult entertainment late at night
<li>In general, Europeans use the Internet less at night, have better social interactions, eat better food and generally live better lives
</ul>
<p>We finish this blog post by exploring which of the above theories do <em><b>not</b></em> account for the large midnight spike in North American traffic.  I have no way to evaluate the last bullet point around higher European quality of life (although I&#8217;m pretty sure my high school French teacher is still insisting this is true).</p>
<h3>Web</h3>
<p>During both the day and night the single largest Internet application is the web (52% of all Internet traffic on average). </p>
<p>But while web surfing  plays a large role in North American traffic trends, the graph below shows web does not provide the complete explanation behind the American bandwidth peaks. </p>
<p>The &#8220;Daily Web Traffic&#8221; graph shows web as an average daily percentage of all North American Internet traffic. For purposes of this blog post, we define &#8220;web&#8221; as traffic on port 80, 8080 and 443.  We note that web traffic includes both html page downloads as well as video and other applications running over HTTP.</p>
<p>From a daily low of 42%, web traffic grows by 10% at night to account for 52% of all Internet traffic. So web accounts for slightly over half of the late night traffic, but what is consuming the other half of American traffic?</p>
<p><center><br />
<!-- img src="http://farm4.static.flickr.com/3430/3846714111_6888c6bea4.jpg" --><br />
<img src="http://farm3.static.flickr.com/2441/3850346110_de447c5b27.jpg"><br />
</center></p>
<h3>P2P</h3>
<p>Given all the press and provider angst over P2P traffic, many commenters suggested (incorrectly) that P2P is the source of the post midnight bulge in American Internet traffic.  As a category, P2P is the second largest source of American Internet traffic coming in at roughly 15-20% of all North American  traffic. </p>
<p> <em>[Note: We'll devote an article  on the evolution of P2P traffic in an upcoming post. And, of course, the upcoming "2009 Internet Observatory" report goes into far more detail on the statistics and methodology than our more casual blog postings.]</em></p>
<p>Since most P2P does not use standard ports and/or includes encryption, we extrapolate the data below using a combination of  Observatory port data with statistics from application payload characterization across several large US and Canadian cable operators. We again graph P2P as an average daily percentage of all North American Internet traffic.</p>
<p><center><br />
<img src="http://farm3.static.flickr.com/2097/3849122145_f48a67d258.jpg"><br />
</center></p>
<p>Unlike the web and almost all other applications, the daily average P2P cycle does not coincide with broader traffic trends. In fact, the P2P daily trend is pretty much completely inverted from daily traffic. In other words, P2P reaches it low at 4pm when web and overall Internet traffic approaches its peak. P2P traffic only bursts from a low of 8% to a high of 17% of Internet traffic after midnight and then drops off at 6am.</p>
<p>As a side note, the cyclical inverted traffic pattern of P2P is interesting in its own accord. The inversion is highly suggestive of either persistent  congestion or, more likely, evidence of widespread provider manipulation of P2P traffic rates.</p>
<p>So P2P also does not explain the midnight spike of American Internet traffic. What does? Next week we&#8217;ll complete this blog post in Part II and explore the applications behind North American traffic after dark.</p>
<p>&nbsp;</p>
<p><h2><b>September 2, 2009 Update:</b></h2>
<p>Given some of the comments / questions around P2P as a percentage of Internet traffic versus a percentage of peak, a new graph below:</p>
<p><center><br />
<a href="http://www.flickr.com/photos/39604891@N02/3882350276/" title="p2pnight2 by labovit, on Flickr"><img src="http://farm3.static.flickr.com/2458/3882350276_83538003f0_o.jpg" width="382" height="452" alt="p2pnight2" /></a><br />
</center></p>
<p>Looking at P2P as a percentage of P2P peak traffic shows even more clearly the inverted pattern (i.e. since Internet traffic begins to climb at 6am, the earlier graph previously obscured the even more pronounced 6am peak in relative P2P traffic levels).</p>
<p>&nbsp;</p>
<p>
<em><br />
Editor&#8217;s Note: This blog is the second in a series of weekly (or possibly semimonthly) posts leading up to the publication of the joint University of Michigan, Merit Network and Arbor Networks &#8220;2009 Internet Observatory Report&#8221;. The full technical reports goes into  detail on the evolving Internet topology, commercial ecosystem and traffic patterns &#8212; available this October.  Next week: &#8220;The Internet After Dark (Part II)&#8221;</p>
<p></em></p>
<p>
&nbsp;<br />
&nbsp;<br />
&nbsp;</p>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F08%2Fthe-internet-after-dark%2F&amp;title=The+Internet+After+Dark+%28Part+1%29', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/08/the-internet-after-dark/feed/</wfw:commentRss>
		<slash:comments>41</slash:comments>
		</item>
		<item>
		<title>July 2009 Malicious Links: 14 Hotspots</title>
		<link>http://asert.arbornetworks.com/2009/08/july-2009-malicious-links-14-hotspots/</link>
		<comments>http://asert.arbornetworks.com/2009/08/july-2009-malicious-links-14-hotspots/#comments</comments>
		<pubDate>Thu, 20 Aug 2009 20:49:23 +0000</pubDate>
		<dc:creator>Jose Nazario</dc:creator>
				<category><![CDATA[ATLAS]]></category>
		<category><![CDATA[Adware]]></category>
		<category><![CDATA[Botnets]]></category>
		<category><![CDATA[Malware]]></category>
		<category><![CDATA[Spyware]]></category>
		<category><![CDATA[Trojan Horses]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/?p=1259</guid>
		<description><![CDATA[Inspired by a friend&#8217;s question of which CIDRs to block first, I went looking into our malicious URL database for July, 2009, data and dug for the top IPs and netblocks. This was pretty easy: what URLs did the malware we analyze go to, what were the IP addresses associated, and then process that list [...]]]></description>
			<content:encoded><![CDATA[<p>Inspired by a friend&#8217;s question of which CIDRs to block first, I went looking into our malicious URL database for July, 2009, data and dug for the top IPs and netblocks. This was pretty easy: what URLs did the malware we analyze go to, what were the IP addresses associated, and then process that list with &#8220;aguri&#8221; to discover trends and hot spots. Some of the results are malicious and run by abusers, some are abused networks that are run by otherwise responsible network admins. I&#8217;ve tried to describe what we&#8217;ve found in each of them and note that none of them are the next &#8220;McColo&#8221; or &#8220;RBN&#8221;, just the loving locations that malware phones home to.</p>
<p>The list below shows the IP or narrow CIDR blocks we found that popped out, together with the contributions (raw number of observations and percentage of overall activity seen for the month).</p>
<h3>8.12.206.126    263 (1.09%)</h3>
<p>Located in AS3356 (Level 3 Communications). Appears to be related to MSN hosting. Often contacted by what appear to be a lot of games and executables of dubious repute. We get a lot of Trojan horse programs in here, no surprise they piggyback on otherwise healthy networks.</p>
<h3>60.173.8.0/21        661 (2.73%/2.73%)</h3>
<p>AS4134, ChinaNet Backbone. Lots of malcode hosted here that we see, and the network is a victim of its own success. Downloaders, infostealers, etc. Been seeing a lot of downloaders phoning back here that install dozens (!) of pieces of malware in one shot all hosted on the same host.</p>
<h3>64.34.228.126   311 (1.28%)</h3>
<p>AS13678, Peer 1 Network. A lot of search hijack and toolbars associated with this IP. A lot of &#8220;hxxp://64.34.228.126/tba/p&#8221; in our database where we see stuff like this posted:<br />
<code><br />
POST /tba/p HTTP/1.1<br />
Content-Length: 269<br />
Content-Type: application/x-www-form-urlencoded<br />
User-Agent: Mozilla/4.0 (compatible; MSIE 6.0; 6.0.79.0; Windows NT 5.1)<br />
Accept-Encoding: gzip<br />
Host: ads.netbios-local.com<br />
.<br />
guid=2923514082588C8C84CB8C4B77FE87C3334E&amp;version=86442206692A&amp;clientid=696CD7897DEF73884430&amp;time=AE5E7DD0AE33F9&amp;idle=925089&amp;locale=F94122913C22&amp;session=B10B&amp;activeWindows=E17B02&amp;ticksBoot=AB363FD944633BEE&amp;ticksAlive=336CA641989A53&amp;installTime=0F0C26&amp;launchCount=9E3962<br />
</code></p>
<h3>66.220.17.154   647 (2.67%)</h3>
<p>AS6939, Hurricane Electric. Lots of <a href="http://www.virustotal.com/analisis/c183027d96313b757be9d9d066742e793127858b6c89a132d826b0cde9f529f7-1247764552">Swizzor related activity</a>.</p>
<h3>67.29.139.153   400 (1.65%)</h3>
<p>AS3356, Level 3. Lots of FakeAV associated with this IP, such as <a href="http://www.virustotal.com/analisis/2850db5b2c1a00c13725aa2918004c9f408b245419ba5398ae057924d835aded-1238509260">this sample</a>.</p>
<h3>68.169.70.134   247 (1.02%)</h3>
<p>AS23393, ISPrime. Seems to be associated with &#8220;Fake Alert&#8221; or &#8220;Renos&#8221; based on some Google searches and <a href="http://www.virustotal.com/analisis/f4c31d3973c7280e83bf5886577fb2117750a0599fdd7c7966316fb4cf364d4f-1243890680">VTotal results</a> for some samples.</p>
<h3>78.108.0.0/14    281 (1.16%/1.16%)</h3>
<p>Associated with Cutwail botnet activity, porn, and even Koobface activity. Spread over a few providers, but lumped into this /14.</p>
<h3>94.75.207.219   293 (1.21%)</h3>
<p>Coincident with 68.169.70.134 above, hosted in AS16265 LEASEWEB. Fake Alerts and such &#8230;</p>
<h3>121.11.0.0/16   244 (1.01%/1.01%) and 121.12.0.0/16   438 (1.81%/1.81%)</h3>
<p>Associated with AS4134, ChinaNet Backbone. Lots of malware in this space from random individuals.</p>
<h3>195.2.253.240/30 328 (1.35%/2.41%)</h3>
<p>AS12695, Digital Network JSC. Lots of malware in the family of <a href="http://www.virustotal.com/analisis/0354ec5c893ed9446e0cdeb0dea7a50a8b36bc7a07c2040830351be86106da11-1250693322">Alureon</a> associate with URLs in this small netblock.</p>
<h3>209.84.29.126   273 (1.13%)</h3>
<p>AS3356, Level 3. Looks similar to what we&#8217;re seeing on the IP 8.12.206.126 above.</p>
<h3>209.205.196.16  286 (1.18%)</h3>
<p>AS20228,  Pacnet, S.A. de C.V. Lots of random malware, appears to be a free hosting provider in South America that kids are abusing.</p>
<h3>216.240.157.91  305 (1.26%)</h3>
<p>AS7796, ATMLink. More Renos and Fake Alert stuff associated with the malware we&#8217;re analyzing phoning back here.</p>
<h3>218.149.84.0/25    251 (1.04%/1.04%)</h3>
<p>AS4766, Korea Telecom. Lots of KwSearchGuide Adware associated with this netblock. Lots of EXEs, DLLs, and PHP scripts called here.</p>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F08%2Fjuly-2009-malicious-links-14-hotspots%2F&amp;title=July+2009+Malicious+Links%3A+14+Hotspots', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/08/july-2009-malicious-links-14-hotspots/feed/</wfw:commentRss>
		<slash:comments>3</slash:comments>
		</item>
		<item>
		<title>What Europeans do at Night</title>
		<link>http://asert.arbornetworks.com/2009/08/what-europeans-do-at-night/</link>
		<comments>http://asert.arbornetworks.com/2009/08/what-europeans-do-at-night/#comments</comments>
		<pubDate>Tue, 18 Aug 2009 02:38:59 +0000</pubDate>
		<dc:creator>Craig Labovitz</dc:creator>
				<category><![CDATA[Arbor Networks]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/?p=1208</guid>
		<description><![CDATA[The New York Times recently had an interesting piece on the changing daily Internet usage patterns in the US. The basic gist of the article was Americans are using the Internet more than in the past and starting to twitter / surf / email much earlier in the day.
Which made us wonder if Europeans are [...]]]></description>
			<content:encoded><![CDATA[<p>The New York Times recently had <a href="http://www.nytimes.com/2009/08/10/technology/10morning.html">an interesting piece</a> on the changing daily Internet usage patterns in the US. The basic gist of the article was Americans are using the Internet more than in the past and starting to twitter / surf / email much earlier in the day.</p>
<p>Which made us wonder if Europeans are any different?</p>
<p>It turns out &#8212; yes.</p>
<p>We took a look using  the <a href="http://www.nanog.org/meetings/nanog43/abstracts.php?pt=NjgmbmFub2c0Mw==&#038;nm=nanog43">Internet Observatory</a> at daily traffic through roughly 40 North American  and 25 European consumer / regional providers (taking the average of 10 weekdays in July). </p>
<p>We graph the daily average of European and North American Internet traffic  below. To make the graph more readable, we show both European and US traffic as a percentage of their respective peak traffic levels (i.e. 100% is the respective peak of each Europe and US traffic). All times are EDT. The yellow shaded area represents daylight hours in Europe and the US.</p>
<p><center><br />
<img src="http://farm4.static.flickr.com/3564/3830743072_7be63a8bd8.jpg"><br />
</center></p>
<p>As expected, both Europe and US Internet traffic have a lot in common. Both show regular, daily cyclical traffic patterns with Internet traffic dropping at night and growing during the day.</p>
<p>Also expected, we  see the two graph lines offset by their roughly 5 hour timezone differences, i.e. European traffic bottoms out at 12am EDT / 5am BST / 6am CEST followed by US traffic reaching its low at 5am EDT.</p>
<p>But what is really interesting is how the daily US and Europe Internet traffic trends differ.</p>
<p>To make some of these differences more obvious,  we show European and North American  traffic on a single daily timeline. In other words, 5am for European is 5am GMT and 5am for the US is 5am EDT.</p>
<p><center><br />
<img src="http://farm3.static.flickr.com/2446/3829956477_a0beb9a45b.jpg"><br />
</center></p>
<p>Even after we account for the multiple time zones in both Europe (3 if we exclude Russia) and the US (4 if we exclude Halifax and Alaska), European traffic really is different. </p>
<p>Some observations:</p>
<ul>
<li><b>We all share the same morning and evening Internet addiction:</b> On average, European traffic starts picking up around 5am GMT / 7 am CEST and similarly US traffic takes off around the same time at 7am EDT. Internet traffic also reaches its peaks in the early evening (7pm GMT / 9pm CEST in Europe and 10pm EDT / 7 pm PDT in the US).<br />
&nbsp;</p>
<li><b>North American&#8217;s don&#8217;t surf over dinner:</b> Unlike European traffic, US daily Internet percentages take a small dip in the early evening between 6pm and 10pm EDT. In contrast, Europe traffic keeps climbing through the evening until a marked 9pm GMT / 11pm CEST drop off. Of course, Europeans tend towards later (and longer) dinner hours than their North American counterparts.<br />
&nbsp;</p>
<li><b>What Europeans do at night:</b> Actually, this bullet point should be what Europeans <em>don&#8217;t</em> do at night &#8212; spend a lot of time on the Internet. In contrast to North America, European traffic plummets much more steeply and reaches a lower daily minimum than US traffic (US traffic never drops below 50% whereas Europe declines more more than 60% from its peak). Apparently, North American Internet users stay up later and use the Internet longer (next blog post we&#8217;ll explore what they&#8217;re doing on the Internet late at night).
</ul>
<p>&nbsp;</p>
<p><em><br />
Editor&#8217;s Note: This blog is the first in a series of weekly (or more likely semimonthly) posts leading up to the publication of the joint University of Michigan, Merit Network and Arbor Networks &#8220;2009 Internet Observatory Report&#8221;. The full technical reports goes into  detail on the evolving Internet topology, commercial ecosystem and traffic patterns &#8212; available this October. </p>
<p></em></p>
<p>
&nbsp;<br />
&nbsp;<br />
&nbsp;</p>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F08%2Fwhat-europeans-do-at-night%2F&amp;title=What+Europeans+do+at+Night', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/08/what-europeans-do-at-night/feed/</wfw:commentRss>
		<slash:comments>25</slash:comments>
		</item>
		<item>
		<title>Twitter-based Botnet Command Channel</title>
		<link>http://asert.arbornetworks.com/2009/08/twitter-based-botnet-command-channel/</link>
		<comments>http://asert.arbornetworks.com/2009/08/twitter-based-botnet-command-channel/#comments</comments>
		<pubDate>Thu, 13 Aug 2009 18:47:30 +0000</pubDate>
		<dc:creator>Jose Nazario</dc:creator>
				<category><![CDATA[Botnets]]></category>
		<category><![CDATA[Malware]]></category>
		<category><![CDATA[Twitter]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/?p=1199</guid>
		<description><![CDATA[UPDATED TO ADD STATS AND JAIKU PROFILE AND A TUMBLR PROFILE
While digging around I found a botnet that uses Twitter as its command and control structure. Basically what it does is use the status messages to send out new links to contact, then these contain new commands or executables to download and run. It&#8217;s an [...]]]></description>
			<content:encoded><![CDATA[<p><b>UPDATED TO ADD STATS AND JAIKU PROFILE AND A TUMBLR PROFILE</b></p>
<p>While digging around I found a botnet that uses Twitter as its command and control structure. Basically what it does is use the status messages to send out new links to contact, then these contain new commands or executables to download and run. It&#8217;s an infostealer operation.</p>
<p>The account in question is under analysis by Twitter&#8217;s security team. I spotted it because a bot uses the RSS feed to get the status updates.</p>
<p><a title="upd4t3 twitter profile.png by jose_, on Flickr" href="http://www.flickr.com/photos/jose_/3818524810/"><img src="http://farm3.static.flickr.com/2500/3818524810_e8e3ee3c30.jpg" alt="upd4t3 twitter profile.png" width="500" height="427" /></a></p>
<p>As for the original bot in question that fetches the updates, here&#8217;s the <a href="http://www.virustotal.com/analisis/6a6c334ffe5c8e60b1de37582b73a642c68d2b02b0284000d24c93f899122139-1249801350">VirusTotal analysis</a>, where you can see it&#8217;s detected by 19/41 (46.34%) AV tools under evaluation. We can look at the status messages and discover more nefarious activity; the bot&#8217;s hiding new malcode which is poorly detected this way. The original link from the malcode came from a <a href="http://shadowserver.org/wiki/">ShadowServer</a> nightly link report, which they make available to folks. Many thanks to them.</p>
<p>Let&#8217;s look at one of the update messages; it&#8217;s pretty clearly base64 encoded. What does it say?<br />
<code><br />
$ echo "aHR0cDovL2JpdC5seS9SNlNUViAgaHR0cDovL2JpdC5seS8yS29Ibw==" | openssl base64 -d<br />
hxxp://bit.ly/R6STV  hxxp://bit.ly/2KoHo<br />
</code><br />
OK, a couple of links. One is dead (to a pastebin), one is live.</p>
<p>That second link yields a base64 encoded block of text. When we un-encode it using base64 we see a PKZIP archive (which we have dumped as &#8220;out.qqq&#8221; since we don&#8217;t know what the extension would have been beforehand). We can then unpack this and see what we find:<br />
<code><br />
$ unzip out.qqq<br />
Archive:  out.qqq<br />
inflating: gbpm.dll<br />
inflating: gbpm.exe<br />
$ openssl md5 gbpm.*<br />
MD5(gbpm.dll)= ceb8d7fd74da0a187cc39ced4550ddb4<br />
MD5(gbpm.exe)= a5cc8140e783190efb69d38c2be4393f<br />
</code></p>
<p>gbpm.dll is UPX packed, so we can unpack this:<br />
<code><br />
$ upx2 -d gbpm.dll.upx<br />
Ultimate Packer for eXecutables<br />
Copyright (C) 1996,1997,1998,1999,2000,2001,2002,2003,2004,2005,2006<br />
UPX 2.02        Markus Oberhumer, Laszlo Molnar &amp; John Reiser   Aug 13th 2006<br />
.<br />
File size         Ratio      Format      Name<br />
--------------------   ------   -----------   -----------<br />
263680 &lt;-    103424   39.22%    win32/pe     gbpm.dll.upx<br />
.<br />
Unpacked 1 file.<br />
</code><br />
This file looks like an infostealer. Here are some of the URLs it will send data to:</p>
<pre>hxxp://64.79.197.110/friends/alert/new.php
hxxps://www2.bancobrasil.com.br/aapf/login.jsp?aapf.IDH=sim
hxxp://64.79.197.110/friends/post.php
hxxps://www2.bancobrasil.com.br/aapf/
hxxps://www2.bancobrasil.com.br/aapf/</pre>
<p>gbpm.exe is packed with a different packer.</p>
<p>That DLL is very poorly detected, the EXE has <a href="http://www.virustotal.com/analisis/14fd37ef063f3c13d667e7483803a17ec493395a0d0e0365da4bed60272f311e-1250187288">a VTotal result of 9/41 (21.95%)</a> and appears to be a Buzus sample according to one vendor.</p>
<p>The account is presently live but under review by Twitter, and is just one of what appear to be a handful of Twitter C&amp;C accounts.</p>
<p><b>UPDATE</b> 14 Aug 2009</p>
<p>Via bit.ly, some statistics that suggest the malcode has infected a couple hundred PCs, mostly in Brazil.</p>
<p><a href="http://www.flickr.com/photos/jose_/3820617030/" title="bitly twitter botnet geo.png by jose_, on Flickr"><img src="http://farm3.static.flickr.com/2652/3820617030_8ed81d4f3d.jpg" width="500" height="272" alt="bitly twitter botnet geo.png" /></a></p>
<p>Now that it&#8217;s disabled, &#8220;upd4t3&#8243; had a similar profile on Jaiku.com:</p>
<p><a href="http://www.flickr.com/photos/jose_/3821210028/" title="upd4t3 jaiku profile.png by jose_, on Flickr"><img src="http://farm3.static.flickr.com/2645/3821210028_443512536f.jpg" width="500" height="380" alt="upd4t3 jaiku profile.png" /></a></p>
<p>Many thanks to the Jaiku team for reviewing and shutting this account down. Still looking for more services &#8220;upd4t3&#8243; is abusing &#8230; looks like Tumblr has also been used by &#8220;upd4t3&#8243;:</p>
<p><a href="http://www.flickr.com/photos/jose_/3821660542/" title="upd4t3 tumblr profile.png by jose_, on Flickr"><img src="http://farm3.static.flickr.com/2455/3821660542_3f57daf09d.jpg" width="500" height="289" alt="upd4t3 tumblr profile.png" /></a></p>
<p>Still poking around various micro-blogging services. I wonder why he abandoned Tumblr. (There are more microblogging tools than I had anticipated &#8230;)</p>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F08%2Ftwitter-based-botnet-command-channel%2F&amp;title=Twitter-based+Botnet+Command+Channel', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/08/twitter-based-botnet-command-channel/feed/</wfw:commentRss>
		<slash:comments>93</slash:comments>
		</item>
		<item>
		<title>The Other Attacks Last Thursday</title>
		<link>http://asert.arbornetworks.com/2009/08/a-busy-morning/</link>
		<comments>http://asert.arbornetworks.com/2009/08/a-busy-morning/#comments</comments>
		<pubDate>Fri, 07 Aug 2009 17:20:26 +0000</pubDate>
		<dc:creator>Craig Labovitz</dc:creator>
				<category><![CDATA[Arbor Networks]]></category>
		<category><![CDATA[Twitter]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/?p=1168</guid>
		<description><![CDATA[Yesterday morning was a busy time for Internet security. 
As an illustration of this activity, the graph below shows a summary of attack traffic across the 77 Observatory ISPs reporting anonymized attack statistics.

Each line or rectangle represents a distinct attack (we saw over 770 attacks Thursday covering a wide variety of scale and targets). Each [...]]]></description>
			<content:encoded><![CDATA[<p>Yesterday morning was a busy time for Internet security. </p>
<p>As an illustration of this activity, the graph below shows a summary of attack traffic across the 77 Observatory ISPs reporting anonymized attack statistics.</p>
<p><img src="http://farm4.static.flickr.com/3514/3797341882_2666bdc15b.jpg"></p>
<p>Each line or rectangle represents a distinct attack (we saw over 770 attacks Thursday covering a wide variety of scale and targets). Each color represents a different ISP under attack.</p>
<p>Though most of the press and blogosphere  focused on Twitter, Facebook and LiveJournal, from an Observatory perspective those weren&#8217;t even the biggest attacks (at least in terms of traffic rate / volume). Turns out that the 30 Gbps spike in the above graph represents a withering attack against the web portal of a 3G mobile operator in Asia. </p>
<p>The press and various public / private mailing lists have generated a lot of discussion (and quite a bit of speculation) on the execution and motives behind the Twitter / Facebook / LiveJournal attacks (including this <a href="http://it.slashdot.org/story/09/08/07/1235257/Twitter-Facebook-DDoS-Attack-Targeted-One-User">Slashot</a> overview). I don&#8217;t have much new to add to this part of the discussion, but I can share a few anecdotal bits of data the Observatory saw on these attacks.</p>
<p>First, some background: the Observatory monitors both coarse grain Internet traffic and attack DDoS statistics. The DDoS portion of the Observatory is designed to provide visibility into broad  trends, i.e. what are the new types of attacks, how are attacks growing  against specific services (and ports / protocols), etc.  As part of the data data sharing arrangement with Observatory participants, the system goes to great lengths to protect the commercial privacy and anonymity of the actual companies and ISPs under attack.</p>
<p>So, for example, we generally have visibility into, say the growth of  <a href="http://en.wikipedia.org/wiki/Christmas_tree_packet">&#8220;Christmas Tree&#8221;</a> attacks against web servers in Asia, but the actual victims are anonymous. In particular, this means we cannot correlate most of the attack traffic yesterday with specific sites like  Twitter / Facebook / etc. (though we can monitor aggregate traffic levels to these sites using the traffic portion of the Observatory as in our <a href="http://asert.arbornetworks.com/2009/08/where-did-all-the-tweets-go/">previous post</a>).</p>
<p>The one exception to this anonymity is outbound attacks. In other words, the Observatory does monitor the destination of an attack if the provider has explicitly configured their DDoS detection to alert when machines within their network or customer base attack services in <em><b>another</b></em> ISP. </p>
<p>Since each individual  ISP in a well-distributed DDoS attack may originate relatively little traffic (i.e. the attack does not impact <em><b>their</b></em> infrastructure, many providers only focus detection on inbound attacks (i.e. when the attack does impact their customers or infrastructure).</p>
<p>The data below is an example snippet of a dozen or so such outgoing attacks yesterday (all times are EDT). Note that destinations of outgoing attacks are not anonymized but specific source addresses have the first two octets replaced with &#8220;XX&#8221;.</p>
<p><img src="http://farm4.static.flickr.com/3537/3797751687_7be2379791.jpg"></p>
<p>The first two DDoS look like small run of the mill TCP Syn attacks against a Twitter IP from both randomized sources and an individual host. The two attacks originate in an anonymous North American tier1 and MSO, respectively. The third attack example occurred later in the day (5:30pm EDT) and  consisted of a 80 Kpps UDP flood.</p>
<p>While <a href="http://www.theregister.co.uk/2004/04/06/joejoe_dos_attack">&#8220;Joe Job&#8221;</a> SPAM links may have comprised a significant portion of the attacks yesterday (as others have reported), the Observatory saw a range of additional attack vectors including TCP Syn, UDP flood, and Christmas Tree attacks.</p>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F08%2Fa-busy-morning%2F&amp;title=The+Other+Attacks+Last+Thursday', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/08/a-busy-morning/feed/</wfw:commentRss>
		<slash:comments>5</slash:comments>
		</item>
		<item>
		<title>Where Did All the Tweets Go?</title>
		<link>http://asert.arbornetworks.com/2009/08/where-did-all-the-tweets-go/</link>
		<comments>http://asert.arbornetworks.com/2009/08/where-did-all-the-tweets-go/#comments</comments>
		<pubDate>Thu, 06 Aug 2009 17:43:41 +0000</pubDate>
		<dc:creator>Craig Labovitz</dc:creator>
				<category><![CDATA[Arbor Networks]]></category>
		<category><![CDATA[Twitter]]></category>

		<guid isPermaLink="false">http://asert.arbornetworks.com/2009/08/where-did-all-the-tweets-go/</guid>
		<description><![CDATA[At roughly 9:00am (EDT) this morning, the Twitisphere fell silent (or at least significantly fewer twitters).
And though you could not follow the outage via tweets,  Twitter&#8217;s blog announced the popular site was under DDoS.
The below graph shows Observatory data from 55 providers around the world to Twitter&#8217;s two NTT hosted addresses blocks: 168.143.0.0/16, 128.121.0.0/16.

From [...]]]></description>
			<content:encoded><![CDATA[<p>At roughly 9:00am (EDT) this morning, the Twitisphere fell silent (or at least significantly fewer twitters).</p>
<p>And though you could not follow the outage via tweets,  <a href="http://status.twitter.com/post/157191978/ongoing-denial-of-service-attack">Twitter&#8217;s blog</a> announced the popular site was under DDoS.</p>
<p>The below graph shows Observatory data from 55 providers around the world to Twitter&#8217;s two <a href="http://blog.twitter.com/2008/02/twitter-chooses-ntt-america-enterprise.html">NTT hosted</a> addresses blocks: 168.143.0.0/16, 128.121.0.0/16.</p>
<p><img src="http://farm4.static.flickr.com/3466/3796094964_bbf4c543b3.jpg"></p>
<p>From the data, Twitter traffic declined abruptly around 9am EDT this morning.</p>
<p>We generally don&#8217;t see a lot of data (i.e. it takes thousands of tweets to match the bandwidth of a single video), but 55 ISPs in the Internet Observatory were exchanging roughly 200 Mbps with Twitter before the DDoS. Then traffic dropped to a low of 60 Mbps around 10:40am and began climbing after that. As of 1pm EDT, Twitter traffic was still down by 50% at 150 Mbps (normally we see close to 300 Mbps for this time of day).</p>
<p>From DNS, it looks like Twitter has moved some of their infrastructure  to different address blocks as of 2pm EDT.</p>
<div><a href="http://www.addthis.com/bookmark.php" onclick="window.open('http://www.addthis.com/bookmark.php?pub=&amp;url=http%3A%2F%2Fasert.arbornetworks.com%2F2009%2F08%2Fwhere-did-all-the-tweets-go%2F&amp;title=Where+Did+All+the+Tweets+Go%3F', 'addthis', 'scrollbars=yes,menubar=no,width=620,height=520,resizable=yes,toolbar=no,location=no,status=no'); return false;" title="Bookmark using any bookmark manager!" target="_blank"><img src="http://s3.addthis.com/button1-bm.gif" width="125" height="16" border="0" /></a></div>]]></content:encoded>
			<wfw:commentRss>http://asert.arbornetworks.com/2009/08/where-did-all-the-tweets-go/feed/</wfw:commentRss>
		<slash:comments>19</slash:comments>
		</item>
	</channel>
</rss>
