This page links to various places where large (hundreds of megabytes to gigabytes) open data sets can be obtained for analysis using big data techniques.

• Statistical Linked Datasets
• mingle.io (Swiss open data startup)

• DBpedia Downloads - semantically interlinked Wikipedia content
• Planet.osm - bulk downloads of Open Street Map
• GeoFabrik.de - extracts of OSM per-content
• Arxiv bulk access - science articles preprints
• Open Library - 20 million editions, 6 million authors
• BioTorrents - (legal!) open data torrents
• Visible Earth - NASA's image archives
• ESA Mission data - some data in the products and campaigns require registration/application
• Public Library of Science - can be scraped

• Open States - bills & legislatures from the US
• Geospatial Data Gateway - USDA environmental and natural resources data
• Enron Email Dataset - 500K messages