crawl page url digest estim. 1-(urls/pages) 1-(digests/pages) 0 CC-MAIN-2013-20 1796098643 1666857706 1675186145 7.2% 6.7% 1 CC-MAIN-2013-48 2245773667 2085501361 2123908635 7.1% 5.4% 2 CC-MAIN-2014-10 2301223474 2032050611 2115654671 11.7% 8.1% 3 CC-MAIN-2014-15 2641371316 1718646762 2250363653 34.9% 14.8% 4 CC-MAIN-2014-23 3608720876 2116640253 3127260498 41.3% 13.3% 5 CC-MAIN-2014-35 2870692423 1877746879 2513136600 34.6% 12.5% 6 CC-MAIN-2014-41 2979743543 1980620845 2643268717 33.5% 11.3% 7 CC-MAIN-2014-42 3722131678 1602175249 3004865099 57.0% 19.3% 8 CC-MAIN-2014-49 1948510433 1321875973 1675826663 32.2% 14.0% 9 CC-MAIN-2014-52 2085977207 1905493151 1917739931 8.7% 8.1% 10 CC-MAIN-2015-06 1826024103 1679287071 1663353964 8.0% 8.9% 11 CC-MAIN-2015-11 1837196089 1685659195 1660875177 8.2% 9.6% 12 CC-MAIN-2015-14 1646697534 1514869973 1497626091 8.0% 9.1% 13 CC-MAIN-2015-18 2115818059 1934559347 1910978257 8.6% 9.7% 14 CC-MAIN-2015-22 2015461448 1836492906 1821352251 8.9% 9.6% 15 CC-MAIN-2015-27 1675619098 1531042999 1525928862 8.6% 8.9% 16 CC-MAIN-2015-32 1815492409 1649248826 1613612273 9.2% 11.1% 17 CC-MAIN-2015-35 1848022475 1673197542 1677929649 9.5% 9.2% 18 CC-MAIN-2015-40 1321987379 1215112821 1188702135 8.1% 10.1% 19 CC-MAIN-2015-48 1824170527 1644173738 1643268398 9.9% 9.9% 20 CC-MAIN-2016-07 1733285122 1560185771 1546567872 10.0% 10.8% 21 CC-MAIN-2016-18 1335046923 1335046923 1211048216 0.0% 9.3% 22 CC-MAIN-2016-22 1466220798 1466220798 1308787436 0.0% 10.7% 23 CC-MAIN-2016-26 1236815660 1236815660 1080537066 0.0% 12.6% 24 CC-MAIN-2016-30 1737322304 1632457174 1537831071 6.0% 11.5% 25 CC-MAIN-2016-36 1611613090 1558553055 1435966389 3.3% 10.9% 26 CC-MAIN-2016-40 1722656393 1690810255 1538695808 1.8% 10.7% 27 CC-MAIN-2016-44 3254976731 3200654906 3040453061 1.7% 6.6% 28 CC-MAIN-2016-50 2866282390 2822871128 2835369567 1.5% 1.1% 29 CC-MAIN-2017-04 3146498026 3116143133 3124474229 1.0% 0.7% 30 CC-MAIN-2017-09 3084366662 2927969262 3075159558 5.1% 0.3% 31 CC-MAIN-2017-13 3070720576 3036216177 3076918527 1.1% -0.2% 32 CC-MAIN-2017-17 2942930482 2907715349 2915114582 1.2% 0.9% 33 CC-MAIN-2017-22 2967293699 2918934207 2913487045 1.6% 1.8% 34 CC-MAIN-2017-26 3165214086 3134206224 3090678021 1.0% 2.4% 35 CC-MAIN-2017-30 2892213652 2845357895 2731370763 1.6% 5.6% 36 CC-MAIN-2017-34 3280080910 3256820690 3321321532 0.7% -1.3% 37 CC-MAIN-2017-39 3017180563 2981741134 2954936664 1.2% 2.1%